Data Engineer

2 days ago

Chicago, Illinois, United States Lorven Technologies Full time
Job Description

Lorven Technologies is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing robust machine learning models and algorithms that solve complex business problems.

You will work closely with cross-functional teams to understand business requirements and translate them into machine learning solutions. Your expertise in machine learning libraries such as TensorFlow, PyTorch, or scikit-learn will be essential in developing high-performance analytic solutions based on data sets measured in the billions of transactions.

Responsibilities:

  • Collaborate with cross-functional teams to understand business requirements and translate them into machine learning solutions
  • Design and develop robust machine learning models and algorithms that solve complex business problems
  • Clean, preprocess, and analyze data to ensure its suitability for machine learning applications
  • Implement end-to-end machine learning pipelines, from data collection and feature engineering to model training and deployment
  • Select appropriate machine learning techniques and algorithms based on the problem's requirements and constraints
  • Perform exploratory data analysis and generate insights to guide model development
  • Evaluate and fine-tune machine learning models for performance, accuracy, and reliability
  • Deploy machine learning models into production environments, ensuring scalability and maintainability
  • Collaborate with technical team to integrate machine learning solutions into applications
  • Stay up-to-date with the latest advancements in machine learning and recommend innovative approaches to enhance our capabilities
  • Document and communicate machine learning solutions, findings, and insights to technical and non-technical stakeholders

Requirements:

  • Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field
  • Proven experience as a machine learning engineer, working on complex machine learning projects
  • Strong programming skills in languages like Python, R, or similar
  • Solid understanding of machine learning algorithms, deep learning frameworks, and statistical modeling techniques
  • Hands-on experience with machine learning libraries such as TensorFlow, PyTorch, or scikit-learn
  • Proficiency in data preprocessing, feature engineering, and data visualization
  • Experience with cloud platforms such as AWS, Azure, or GCP for deploying machine learning models
  • Familiarity with version control systems (e.g., Git) and collaborative development practices
  • Strong problem-solving skills and ability to troubleshoot and optimize machine learning models
  • Excellent communication skills to convey technical concepts to both technical and non-technical stakeholders
  • Proven ability to work in a collaborative team environment and drive projects to completion

Preferred Qualifications:

  • Working proficiency in using Python/Scala, Spark (tuning jobs), SQL, Hadoop platforms to build Big Data products & platforms
  • Good programming skills in Java and spring boot and Junit
  • Knowledge in software development test approaches & frameworks
  • Familiarity with RESTful APIs and micro-services architectures
  • Experience in working with CI/CD
  • Experience in working with SQL database like Postgres, Oracle
  • Preferably with hands-on experience with Hadoop big data tools (Hive, Impala, Spark)
  • Experience with data pipeline and workflow management tools: NIFI, Airflow
  • Comfortable in developing shell scripts for automation
  • Good troubleshooting and debugging skills
  • Proficient in standard software development, such as version control, testing, and deployment
  • Demonstrated basic knowledge of statistical analytical techniques, coding, and data engineering
  • Ability to quickly learn and implement new technologies
  • Ability to Solve complex problems with multi-layered data sets
  • Ability to innovate and determine new approaches & technologies to solve business problems and generate business insights & recommendations
  • Ability to multi-task and strong attention to detail
  • Flexibility to work as a member of a matrix based diverse and geographically distributed project teams
  • Good communication skills
  • both verbal and written and strong relationship, collaboration skills, and organizational skills

  • Data Theorem Security Specialist

    3 weeks ago

    Chicago, Illinois, United States Data Theorem Full time

    Job Title: Systems EngineerWe are seeking a highly skilled Systems Engineer to join our team at Data Theorem. As a Systems Engineer, you will work closely with customers and prospects to understand their security needs and provide solutions that meet their requirements.Key Responsibilities:Develop and deliver product demonstrations and sales presentations to...

  • Senior Software Engineer

    3 weeks ago

    Chicago, Illinois, United States Spline Data Full time

    Spline Data is a pioneering company in the field of modern quantitative market data feeds and visualizations for fixed income trading desks, portfolio managers, and issuers. We strive for excellence in every aspect of our business, ensuring that the data we create is of the highest quality, detail, and robustness.We believe that innovation often lies in the...

  • Data Engineer

    4 weeks ago

    Chicago, Illinois, United States WHIZTEK CORP Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Whiztek Corp. As a Data Engineer, you will play a critical role in designing, building, and maintaining large-scale data pipelines and architectures.Key Responsibilities:Design and implement data pipelines using AWS services such as Redshift, S3, and AthenaDevelop and...

  • Data Engineer

    2 weeks ago

    Chicago, Illinois, United States eTek IT Services, Inc. Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at eTek IT Services, Inc. in Chicago, IL. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities:Collaborate with cross-functional teams to understand data requirements and...

  • Data Engineer

    3 weeks ago

    Chicago, Illinois, United States IFF Full time

    Job Title: Data EngineerIFF is seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining data integration and synchronization processes across our core business applications and data warehouses.Key Responsibilities:Collaborate with the Data Architect and Chief Data Officer to...

  • Data Engineer

    2 days ago

    Chicago, Illinois, United States TechnoGen Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at TechnoGen. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems to support our business needs.Key Responsibilities:Design and implement data pipelines to collect, process, and analyze large datasetsDevelop and...

  • Data Engineer

    14 hours ago

    Chicago, Illinois, United States Publicis Groupe Full time

    Job Title: Data EngineerPublicis Groupe is seeking a highly motivated and skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data processing systems.Key Responsibilities:Analyze business requirements and partner with product owners to build scalable solutions.Integrate...

  • Data Engineer

    4 weeks ago

    Chicago, Illinois, United States SpiderRock Holdings LLC Full time

    Job OpportunityWe are seeking a highly skilled Data Engineer to join our team at SpiderRock Holdings LLC. As a Data Engineer, you will play a critical role in developing and maintaining our data infrastructure, ensuring the accuracy and reliability of our data products.Key ResponsibilitiesDesign, develop, and implement data pipelines and architectures to...

  • Data Engineer

    2 weeks ago

    Chicago, Illinois, United States Selby Jennings Full time

    We are seeking a skilled Data Engineer to collaborate with our commodities team at Selby Jennings, where you will be responsible for designing and implementing data pipelines to support the ingestion, management, and analysis of datasets used by traders.Key Responsibilities:Develop and maintain efficient ETL pipelines using Python, ensuring data accuracy and...

  • Data Engineer

    14 hours ago

    Chicago, Illinois, United States Syntricate Technologies Full time

    Job Description:We are seeking a highly skilled Data Engineer to join our team at Syntricate Technologies. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems using Azure Databricks services. Your expertise in working with Azure Databricks services, including creating services, reading and...

  • Data Engineer

    3 weeks ago

    Chicago, Illinois, United States Publicis Media Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Publicis Media. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Analyze business requirements and collaborate with product owners to develop scalable...

  • Data Engineer

    4 weeks ago

    Chicago, Illinois, United States Publicis Media Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Publicis Media. As a Data Engineer, you will play a critical role in the development, implementation, and ongoing support of our data-driven software platform.Key Responsibilities:Analyze business requirements and collaborate with product owners to build scalable...

  • Data Engineer

    10 hours ago

    Chicago, Illinois, United States SpiderRock Platform Services, LLC Full time

    We are seeking a highly skilled Data Engineer to join our team in Chicago. The ideal candidate will have a passion for data, technology, and finance, and will be responsible for developing various ETL pipelines, data warehouse architecture, and streamlining data processing.The successful candidate will contribute to the software development lifecycle,...

  • Senior Data Engineer

    3 weeks ago

    Chicago, Illinois, United States Trajektory Full time

    Trajektory is seeking a highly skilled Senior Data Engineer to join our team in Chicago, IL. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems, as well as collaborating with cross-functional teams to drive business growth through data-driven insights. Key responsibilities include data...

  • Data Engineer

    9 hours ago

    Chicago, Illinois, United States Dentsu Full time

    Job Title: Data EngineerAt Dentsu, we're seeking a talented Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems using Python and SQL.Key Responsibilities:Design and implement data pipelines using Apache Airflow, AWS, and SnowflakeContainerize business...

  • Senior Data Engineer

    3 weeks ago

    Chicago, Illinois, United States Trajektory Full time

    Company OverviewTrajektory is a leading provider of data management solutions for the sports and entertainment industries. Our cutting-edge tools help brands evaluate sponsorship impact and make data-driven decisions. As a Senior Data Engineer at Trajektory, you will play a key role in developing and maintaining our data engineering capabilities.Job...

  • Data Engineer

    6 hours ago

    Chicago, Illinois, United States Publicis Media Full time

    Job DescriptionPublicis Media is seeking a highly motivated and skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for the development, implementation, and ongoing support of a data-driven software platform.Key Responsibilities:Analyze business requirements and partner with product owners to build a scalable...

  • Senior Data Engineer

    1 month ago

    Chicago, Illinois, United States InterEx Group Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to design and build data pipelines using Azure Data Factory, Python, and Databricks.Key Responsibilities:Design and implement data pipelines to efficiently process and transfer dataCollaborate with cross-functional teams to develop solutions using DatabricksDevelop and maintain code in...

  • Data Engineer

    2 days ago

    Chicago, Illinois, United States Ahold Delhaize Full time

    Job DescriptionAhold Delhaize USA, a leading food retailer, is seeking a highly skilled Lead Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining our data pipelines and architecture.Key Responsibilities:Design and develop data transformations and data pipelinesEnsure...

  • Data Engineer

    2 days ago

    Chicago, Illinois, United States SpiderRock Holdings LLC Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at SpiderRock Holdings LLC. The successful candidate will be responsible for designing, developing, and maintaining large-scale data pipelines and architectures. This role will play a critical part in improving our data product and driving business growth.Key...