AI Data Engineer

4 weeks ago

Troy, United States Hearst Transportation Full time
Job Description

MOTOR Information Systems, an operating group of Hearst, is actively seeking a team of enthusiastic, creative, and driven technologists. People with a proven track record, who are willing to experiment with new ideas, invest time in them, fail-fast, and move on if they don't work out. We want team members who have shown a consistent interest in continuous learning, especially in Generative AI, who are aware of, and follow the latest and best generative AI technologies and trends, can learn by themselves, are self-motivated and value self-directed initiative with technology and AI exploration.

Summary

As a Data Engineer, you will design, develop, and maintain data pipelines, data warehouses, and data platforms that support the analytics and business intelligence needs of our clients. You will work with cutting-edge technologies and tools, such as Spark, Kafka, AWS, Azure, and Elastic, to handle large-scale and complex data challenges. You will also collaborate with data scientists, analysts, and stakeholders to ensure data quality, reliability, and usability.

Main Responsibilities
  • Build automated pipelines to extract and process data from a variety of legacy platforms (predominantly SQL Server), e.g., in stored procedures, Glue processing, etc.
  • Implement data-related business logic on modern data platforms, such as AWS Glue, Databricks, Snowflake, Elastic, and Azure Cognitive Search using best practices and industry standards.
  • Optimize and monitor the performance, reliability, and security of data systems and processes.
  • Integrate and transform data from various sources and formats, such as structured, unstructured, streaming, and batch.
  • Develop and maintain data quality checks, tests, and documentation.
  • Support data analysis, reporting, and visualization using tools such as SQL, Python, R, Tableau, and Power BI
  • Research and evaluate new data technologies and trends to improve data solutions and existing capabilities.
Qualifications and Skills
  • Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or a related field
  • At least 5 years of experience in data engineering or a similar role (previous DBA experience is a plus)
  • Expert in SQL, including a knowledge of efficient query and schema design, DDL, and use of stored procedures
  • Proficient in at least one programming language, such as Python, Scala, or Java
  • Experience with data modeling, data warehousing, and ETL processes
  • Experience building production systems with more modern ETL and data systems, such as AWS Glue, Databricks, Snowflake, Elastic, and Azure Cognitive Search
  • Experience deploying data infrastructure on public cloud platforms (AWS, Azure, or GCP)
  • Experience with big data frameworks and tools, such as Spark, Hadoop, Kafka, Hive, and Airflow
  • Familiarity with pandas, polars, and similar data analysis libraries
  • Strong knowledge of data quality, data governance, and data security principles and practices
  • Excellent communication, collaboration, and problem-solving skills

EEO EMPLOYER

  • Sr. Research Engineer

    2 weeks ago

    Troy, United States Magna International Full time

    About us We see a future where everyone can live and move without limitations. That's why we are developing technologies, systems and concepts that make vehicles safer and cleaner, while serving our communities, the planet and, above all, people. Forward. For all. Group Summary Magna is more than one of the world's largest suppliers in the automotive space....

  • Sr. Research Engineer

    1 month ago

    Troy, United States Magna International Inc. Full time

    About us We see a future where everyone can live and move without limitations. That’s why we are developing technologies, systems and concepts that make vehicles safer and cleaner, while serving our communities, the planet and, above all, people.   Forward. For all.   Group Summary Magna is more than one of the world’s largest...

  • Data Scientist Intern

    4 weeks ago

    Troy, Michigan, United States Magna International Inc. Full time

    Job Number: 65822 Group: Magna Corporate Division: Magna Design and Engineering (USA) Job Type: Intern/Co-op Location: TROY Work Style: About usWe see a future where everyone can live and move without limitations. That's why we are developing technologies, systems and concepts that make vehicles safer and cleaner, while serving our communities, the planet...

  • Product Engineer

    1 week ago

    Troy, United States Altair Full time

    Transforming the Future with Convergence of Simulation and Data Product Engineer - Steel Stampings and Structures Job Summary: Our client in Warren, MI is looking for a Product Engineer - Steel Stampings and Structures. This is a Contract position. Qualifications: Concept, design, develop, and release automotive general stampings and engineered chassis...

  • Data Management Specialist Controls

    2 days ago

    Troy, United States Altair Full time

    Transforming the Future with Convergence of Simulation and Data Data Management Specialist Controls Job Summary: Our client in Dearborn, MI is looking for a Data Management Specialist Controls. This is a contract position. What You Will Do: Quality data analysis for Chassis Controls modules. Requires analyzing connected vehicle data, warranty data, and...

  • Data Management Specialist Controls

    14 hours ago

    Troy, United States Altair Full time

    Transforming the Future with Convergence of Simulation and Data Data Management Specialist Controls Job Summary: Our client in Dearborn, MI is looking for a Data Management Specialist Controls. This is a contract position. What You Will Do: Quality data analysis for Chassis Controls modules. Requires analyzing connected vehicle data, warranty data, and...

  • Powertrain Engineer

    3 days ago

    Troy, United States Altair Full time

    Transforming the Future with Convergence of Simulation and DataProduct Engineer PowertrainJob Summary:Our client in Dearborn, MI is looking for a Product Engineer Powertrain. This is a contract position.What You Will Do:Project Purpose: Deliver, validate, and maintain on-board diagnostic (OBD) solutions for powertrain technologies needed to meet global...

  • Powertrain Engineer

    1 hour ago

    Troy, United States Altair Full time

    Transforming the Future with Convergence of Simulation and Data Product Engineer Powertrain Job Summary: Our client in Dearborn, MI is looking for a Product Engineer Powertrain. This is a contract position. What You Will Do: Project Purpose: Deliver, validate, and maintain on-board diagnostic (OBD) solutions for powertrain technologies needed to meet global...

  • Software Engineer Controls

    1 day ago

    Troy, United States Altair Full time

    Transforming the Future with Convergence of Simulation and Data Software Engineer Controls Job Summary: Our client in Allen Park, MI is looking for a Software Engineer Controls. This is a contract position. What You Will Do: Architect, design and implement Infotainment embedded software solutions utilizing Android operating systems (OS) and platform...

  • Analyst General/Engineering

    9 hours ago

    Troy, United States Altair Full time

    Transforming the Future with Convergence of Simulation and Data Analyst General/Engineering Job Summary: Our client in Dearborn, MI is looking for an Analyst General/Engineering. This is a contract position. What You Will Do: Support Sign-off of Feature Level performance for a given vehicle via data exploration and analysis of ADAS Features. Develop and...

  • Design Release Engineer

    2 days ago

    Troy, United States Altair Full time

    Our client in Troy, MI is looking for a Design Release Engineer - Airbag. This is a Contract position.This Engineer will report to the Lead – Restraints Systems Engineering manager and will be responsible for driving the development of the restraints system components of the battery electric vehicles.The engineer will be challenged to develop unique...

  • Design Release Engineer

    1 day ago

    Troy, United States Altair Full time

    Our client in Troy, MI is looking for a Design Release Engineer - Airbag. This is a Contract position. This Engineer will report to the Lead Restraints Systems Engineering manager and will be responsible for driving the development of the restraints system components of the battery electric vehicles. The engineer will be challenged to develop unique...

  • Design Release Engineer

    2 days ago

    Troy, United States Altair Full time

    Our client in Troy, MI is looking for a Design Release Engineer - Airbag. This is a Contract position.This Engineer will report to the Lead – Restraints Systems Engineering manager and will be responsible for driving the development of the restraints system components of the battery electric vehicles.The engineer will be challenged to develop unique...

  • Battery Test Engineer

    1 day ago

    Troy, United States Altair Full time

    Transforming the Future with Convergence of Simulation and Data Test Engineer Job Summary: Our client in Auburn Hills, MI is looking for a Test Engineer. This is a contract position. What You Will Do: The Battery Component Testing Engineer. The Battery Component Testing Engineer is responsible for ensuring that each kitted set of components for a high...

  • Powertrain Engineer

    1 day ago

    Troy, United States Altair Full time

    Transforming the Future with Convergence of Simulation and Data Product Engineer Powertrain Job Summary: Our client in Dearborn, MI is looking for a Product Engineer Powertrain. This is a contract position. What You Will Do: Project Purpose: Deliver, validate, and maintain on-board diagnostic (OBD) solutions for powertrain technologies needed to meet global...

  • Airbag - Control Unit Engineer

    1 day ago

    Troy, United States Altair Full time

    Transforming the Future with Convergence of Simulation and Data Airbag - Control Unit Engineer Job Summary: Our client in Troy, MI is looking for a Airbag - Control Unit Engineer. This is a Contract position. This Engineer will report to the Lead - Restraints Systems Engineering manager and will be responsible for driving the development of the restraints...

  • Software Engineer Controls

    6 days ago

    Troy, United States Altair Full time

    Transforming the Future with Convergence of Simulation and Data Software Engineer Controls Job Summary: Our client in Allen Park, MI is looking for a Software Engineer Controls. This is a contract position. What You Will Do: The ideal candidate will take part in the creation of test automation for infotainment systems. We are looking for an energetic and...

  • Senior Project Engineer, Engine and Hybrid Powertrain Development

    1 day ago

    Troy, United States Altair Full time

    Transforming the Future with Convergence of Simulation and Data Senior Project Engineer, Engine and Hybrid Powertrain Development Job Summary: Our client in Auburn Hills, MI is looking for a Senior Project Engineer, Engine and Hybrid Powertrain Development. This is a Contract position. seeking a Sr. Project Engineer with specialization in engine and hybrid...

  • Senior Project Engineer, Engine and Hybrid Powertrain Development

    1 day ago

    Troy, United States Altair Full time

    Transforming the Future with Convergence of Simulation and Data Senior Project Engineer, Engine and Hybrid Powertrain Development Job Summary: Our client in Auburn Hills, MI is looking for a Senior Project Engineer, Engine and Hybrid Powertrain Development. This is a Contract position. seeking a Sr. Project Engineer with specialization in engine and hybrid...

  • Battery Test Engineer

    1 day ago

    Troy, United States Altair Full time

    Transforming the Future with Convergence of Simulation and Data Test Engineer Job Summary: Our client in Auburn Hills, MI is looking for a Test Engineer. This is a contract position. What You Will Do: The Battery Component Testing Engineer. The Battery Component Testing Engineer is responsible for ensuring that each kitted set of components for a high...