AI Big Data Engineer

1 week ago


Troy, United States Robert Half Full time
Job DescriptionJob Description

Job Summary:

As a Data Engineer, you will play a key role in building a Unified Data Platform that empowers our clients with advanced analytics and business intelligence. You will design, develop, and maintain data pipelines, data lakes, and platforms using cutting-edge technologies like Spark, Kafka, AWS, Azure, and Kubernetes to tackle large-scale data challenges. Collaborating with cross-functional teams, you’ll ensure data quality, reliability, and usability to support data-driven decision-making.

Key Responsibilities:

  • Build automated pipelines to extract and process data from legacy systems, primarily using SQL Server and AWS Glue.
  • Implement business logic on modern data platforms (AWS Glue, Databricks, Azure) using best practices.
  • Create vector databases, data marts, and design data models to support business needs.
  • Optimize and monitor the performance, reliability, and security of data systems.
  • Integrate and transform data from structured, unstructured, streaming, and batch sources.
  • Develop and maintain data quality checks, tests, and comprehensive documentation.
  • Support data analysis and visualization efforts using tools such as SQL, Python, Tableau, and Quicksight.
  • Stay informed on new data technologies and trends to continuously improve our data platforms.


Qualifications and Skills:

  • Bachelor’s degree or higher in Computer Science, Engineering, Mathematics, or a related field.
  • 5+ years of experience in data engineering or a similar role (DBA experience is a plus).
  • Proficiency with big data frameworks and tools like Spark, Hadoop, Kafka, and Hive.
  • Expert knowledge of SQL, including query optimization, schema design, DDL, and stored procedures.
  • Proficient in at least one programming language (Python, Go, or Java).
  • Experience with CI/CD, containerization (Docker, Kubernetes), and orchestration tools (Airflow).
  • Hands-on experience with modern ETL/ELT systems and data platforms (AWS Glue, Databricks, Snowflake, Elastic, Azure Cognitive Search).
  • Experience deploying data infrastructure on cloud platforms (AWS, Azure, or GCP).
  • Strong understanding of data governance, data security, and data quality principles.
  • Excellent communication, collaboration, and problem-solving skills.




  • Troy, United States Jobot Full time

    This Jobot Consulting Job is hosted by: Amanda PrestonAre you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume.Salary: $65 - $73 per hourA bit about us:Automotive Information Systems Group Actively building out their AI teamWhy join us?Competitive Compensation PackageHybridAccelerated Growth PotentialJob DetailsJob...


  • Troy, United States Jobot Full time

    Dice is the leading career destination​ for tech experts at every stage of their careers.  Our client, Jobot, is seeking the following.  Apply via Dice today!This Jobot Consulting Job is hosted by: Amanda PrestonAre you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume.Salary: $65 - $73 per hourA bit about us:Automotive...


  • Troy, Michigan, United States Beacon Hill Full time

    Job Title: AI Big Data EngineerWe are seeking an experienced AI Big Data Engineer to join our team at Beacon Hill. As an AI Big Data Engineer, you will play a key role in designing, developing, and maintaining a Unified Data Platform.Main Responsibilities:Data Pipeline Development: Design and implement automated pipelines to extract and process data from...


  • Troy, Michigan, United States Rose International Full time

    Job Title: AI Big Data EngineerWe are seeking an experienced AI, Big Data Engineer to join our team at Rose International. As a key member of our data engineering team, you will play a crucial role in designing, developing, and maintaining data pipelines, data lakes, and data platforms that support the analytics and business intelligence needs of our...


  • Troy, United States Rose International Full time

    Date Posted: 10/04/2024Hiring Organization: Rose InternationalPosition Number: 472324Job Title: AI Big Data EngineerJob Location: Troy, MI, USA, 48098Work Model: HybridEmployment Type: TemporaryEstimated Duration (In months): 12Min Hourly Rate($): 75.00Max Hourly Rate($): 80.00Must Have Skills/Attributes: AWS, Azure, Databricks, GCP, Hadoop, Hive, Kafka,...

  • Big Data Engineer

    2 days ago


    Troy, United States A-Line Staffing Solutions Full time

    AI Big Data Engineer Hybrid to Troy, MI 60-70/hr W2 This is NOT a C2C Position Job Description: We are actively building our AI team. We are looking for people with a proven track record, who are willing to experiment with new ideas, invest time in them, fail-fast, and move on if they don't work out. We want team members who have shown a consistent interest...


  • Troy, United States Rose International Full time

    •**Only qualified AI Big Data Engineer candidates located near the Troy, MI area to be considered due to the position requiring an onsite presence***Qualifications: Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or a related field At least 5 years of experience in data engineering or a similar role (previous DBA...

  • AI Big Data Engineer

    2 weeks ago


    Troy, United States Rose International Full time

    We are seeking an experienced AI, Big Data Engineer for the MOTOR Information Systems operating group. As a Data Engineer, you will focus on creating a Unified Data Platform. You will design, develop, and maintain data pipelines, data lakes, and data platforms that support the analytics and business intelligence needs of our clients. You...


  • Troy, United States Mondo Full time

    Job Title: AI Big Data EngineerLocation-Type: Hybrid - Troy, MI - T/W/Th on-siteStart Date Is: 10/21/24Duration: 12+ month contractCompensation Range: $60-$75/hrRole Overview:As a Data Engineer with our client, you will contribute to building a Unified Data Platform, focusing on designing, developing, and maintaining data pipelines, data lakes, and platforms...


  • Troy, United States Everest Consultants, Inc. Full time

    Job Title: AI Big Data Engineer Location: Troy, Michigan Duration: 12 months Hours: 8.00am 5.00pm Pay Rate - $65 - $69.5/hr on W-2 (No 1099 or C2C) Summary As a Data Engineer, you will focus on creating a Unified Data Platform. You will design, develop, and maintain data pipelines, data lakes, and data platforms that support the analytics...


  • Troy, United States Beacon Hill Full time

    Summary: As an AI Big Data Engineer, you will focus on creating a Unified Data Platform. You will design, develop, and maintain data pipelines, data lakes, and data platforms to support analytics and business intelligence needs. This role involves working with cutting-edge technologies and tools like Spark, Kafka, AWS, Azure, and Kubernetes to manage...


  • Troy, United States A-Line Staffing Solutions Full time

    Title: AI Big Data Engineer Rate: $65/hr Location: Troy, MI - HybridNote: This is a contract on W2. THIS IS NOT OPEN TO C2C.We are looking for people with a proven track record, who are willing to experiment with new ideas, invest time in them, fail-fast, and move on if they don't work out. We want team members who have shown a consistent interest in...

  • AI Data Engineer

    1 day ago


    Troy, Michigan, United States Beacon Hill Full time

    Job Title: AI Big Data EngineerBeacon Hill is seeking a highly skilled AI Big Data Engineer to join our team. As an AI Big Data Engineer, you will play a critical role in designing, developing, and maintaining a Unified Data Platform.Main Responsibilities:Design and implement automated data pipelines to extract and process data from legacy platforms using...


  • Troy, United States A-Line Staffing Solutions Full time

    Job DescriptionJob DescriptionTitle: AI Big Data EngineerRate: $65/hrLocation: Troy, MI - Hybrid Note: This is a contract on W2. THIS IS NOT OPEN TO C2C. We are looking for people with a proven track record, who are willing to experiment with new ideas, invest time in them, fail-fast, and move on if they don't work out. We want team members who have...

  • AI Data Engineer

    4 days ago


    Troy, Michigan, United States MASHPOINT LLC Full time

    Job Title: AI Big Data EngineerMASHPOINT LLC is seeking a highly skilled AI Big Data Engineer to join our team. As a key member of our AI team, you will be responsible for designing, developing, and maintaining data pipelines, data lakes, and platforms that meet the analytics and business intelligence needs of our organization.Key Responsibilities:Design and...


  • Troy, United States Robert Half Full time

    Job Summary:As a Data Engineer, you will play a key role in building a Unified Data Platform that empowers our clients with advanced analytics and business intelligence. You will design, develop, and maintain data pipelines, data lakes, and platforms using cutting-edge technologies like Spark, Kafka, AWS, Azure, and Kubernetes to tackle large-scale data...


  • Troy, United States Robert Half Full time

    Job Summary:As a Data Engineer, you will play a key role in building a Unified Data Platform that empowers our clients with advanced analytics and business intelligence. You will design, develop, and maintain data pipelines, data lakes, and platforms using cutting-edge technologies like Spark, Kafka, AWS, Azure, and Kubernetes to tackle large-scale data...


  • Troy, United States Yoh, A Day & Zimmermann Company Full time

    Job DescriptionJob DescriptionAs a Data Engineer, you will focus on creating a Unified Data Platform. You will design, develop, and maintain data pipelines, data lakes, and data platforms that support the analytics and business intelligence needs of our clients. You will work with cutting-edge technologies and tools, such as Spark, Kafka, AWS, Azure, and...


  • Troy, Michigan, United States Randstad Full time

    Job SummaryWe are seeking a highly skilled AI Quality Assurance Engineer to join our team. As a key member of our AI/ML team, you will be responsible for ensuring the quality and reliability of our AI-powered solutions.ResponsibilitiesDevelop and implement quality assurance strategies and processes to ensure the highest level of quality in our AI/ML...


  • Troy, United States A-Line Staffing Solutions Full time

    Job DescriptionJob Description    We Are actively building out an AI team. We are looking for people with a proven track record, who are willing to experiment with new ideas, invest time in them, fail-fast, and move on if they don't work out. We want team members who have shown a consistent interest in continuous learning, especially in Cloud...