Data Engineer Lead

2 weeks ago

Dearborn, United States Damco Solutions Full time
Position Description:
  • The GDIA Data Factory Platform covers all business processes and technical components involved in ingesting a wide range of enterprise data into the GDIA Data Factory (Data Lake) and the transformation of that data into consumable data sets in support of analytics.
  • The Data Factory Enablement Team, as the name suggests enables teams build their solutions in the GCP Data Factory Platform by proving Tools, Guidelines, processes and support.
  • We are looking for candidates who have a broad set of technology skills across areas and come from a background of DevOps, with exposure to infrastructure and solution monitoring. This person will be expected to provide consultative services to the Software Development and Database Engineering teams.

Key responsibilities include:
Work as part of an implementation team from concept to operations, providing deep technical subject matter expertise for successfully deployment of Ford's Data Platform
Implement methods for standardization of all parts of the pipeline to maximize data usability and consistency
Test and compare competing solutions and report out a point of view on the best solution
Design and Build CICD Pipelines for Google Cloud Platform (GCP) services: BigQuery,DataFlow,Pub/Sub, Data Fusion and others
Work with stakeholders including Analytics, Product, and Design teams to assist with data related technical issues and support their data infrastructure needs
Develop IAC tekton pipelines to execute pattern playbooks and templates
Designing cloud performance and monitoring strategies
Designing and implementing workflows to automate the infrastructure release and upgrade process for applications in Dev, UAT and Production environments
Mentor and grow technical skills of engineers across multiple sprint teams by giving high quality feedback in design and code reviews and providing training for new methods, tools, and patterns

Skills Required:
Someone who understands Cloud as being a way to operate and not a place to host systems
In-depth understanding of GCP product technology and underlying architectures.
Experience and very strong with development eco-system such as Git, Jenkins, Terraform and Tekton for CI/CD
Experience in working with Agile and Lean methodologies

Experience Required:
1. At least 2 years of tekton experience
2. At least 5 years of Terraform experience or 3 years with terraform certification
3. At least 3 years of experience in Google cloud and Google cloud professional architect certification

Education Preferred: MINIMUM BACHELORS in CS/IT

Certifications:
1. HashiCorp Certified: Terraform Associate
2. Google Cloud Certified Associate Cloud Engineer
3. Google Cloud Certified

NOTE: MUST HAVE SKILLS
  1. Google Cloud experience of 3 years.
  2. t least 2 years of Tekton.
  3. Experience with Terraform.
  4. Good Communication as this will be a Lead Role

  • Lead data engineer

    5 days ago

    Dearborn, United States JRD Systems Full time

    Job Description:As a lead cloud engineer for Azure, you will be responsible for designing and implementing scalable, high-performance data engineering solutions using Azure Databricks and Azure Data FactoryEssential Job Functions: Lead the design and implementation of complex cloud solutions using Microsoft Azure, focusing on integration with Databricks and...

  • Lead data engineer

    1 week ago

    Dearborn, United States JRD Systems Full time

    Job Description:As a lead cloud engineer for Azure, you will be responsible for designing and implementing scalable, high-performance data engineering solutions using Azure Databricks and Azure Data Factory. Essential Job Functions: Lead the design and implementation of complex cloud solutions using Microsoft Azure, focusing on integration with Databricks...

  • Lead data engineer

    1 week ago

    Dearborn, United States JRD Systems Full time

    Job Description:As a lead cloud engineer for Azure, you will be responsible for designing and implementing scalable, high-performance data engineering solutions using Azure Databricks and Azure Data Factory. Essential Job Functions: Lead the design and implementation of complex cloud solutions using Microsoft Azure, focusing on integration with Databricks...

  • Lead data engineer

    1 week ago

    Dearborn, United States JRD Systems Full time

    Job Description:As a lead cloud engineer for Azure, you will be responsible for designing and implementing scalable, high-performance data engineering solutions using Azure Databricks and Azure Data Factory. Essential Job Functions: Lead the design and implementation of complex cloud solutions using Microsoft Azure, focusing on integration with Databricks...

  • Lead Azure Data engineer

    11 hours ago

    Dearborn, United States Info.nl Full time

    Essential Job Functions: *Responsibilities:* - Lead the design and implementation of complex cloud solutions using Microsoft Azure, focusing on integration with Databricks and Azure Data Factory. - Develop and maintain scalable and efficient data pipelines and architectures. - Ensure optimal architecture and performance of applications deployed on Azure. -...

  • Lead Azure Data engineer

    3 days ago

    Dearborn, United States Info Services Full time

    Essential Job Functions:*Responsibilities:*- Lead the design and implementation of complex cloud solutions using Microsoft Azure, focusing on integration with Databricks and Azure Data Factory.- Develop and maintain scalable and efficient data pipelines and architectures.- Ensure optimal architecture and performance of applications deployed on Azure.-...

  • Lead Azure Data engineer

    3 days ago

    Dearborn, United States Info Services Full time

    Essential Job Functions:*Responsibilities:*- Lead the design and implementation of complex cloud solutions using Microsoft Azure, focusing on integration with Databricks and Azure Data Factory.- Develop and maintain scalable and efficient data pipelines and architectures.- Ensure optimal architecture and performance of applications deployed on Azure.-...

  • Lead Azure Data engineer

    2 days ago

    Dearborn, United States Info Services Full time

    Essential Job Functions:*Responsibilities:*- Lead the design and implementation of complex cloud solutions using Microsoft Azure, focusing on integration with Databricks and Azure Data Factory.- Develop and maintain scalable and efficient data pipelines and architectures.- Ensure optimal architecture and performance of applications deployed on Azure.-...

  • Data Engineer

    1 week ago

    Dearborn, United States JRD Systems Full time

    Position: Lead Cloud Data EngineerLocation: REMOTE/ Hybrid - 2 days onsite per week, Dearborn, MIPay/ Salary: + $120,000Job Type: Full-time/W2/ Open-Ended Contract-----------------If you are in the market for a new opportunity, JRD Systems is looking to hire a Lead Cloud/ Data engineer for Azure, that would be responsible for designing and implementing...

  • Data Engineer

    1 week ago

    Dearborn, United States JRD Systems Full time

    Position: Lead Cloud Data EngineerLocation: REMOTE/ Hybrid - 2 days onsite per week, Dearborn, MIPay/ Salary: + $120,000Job Type: Full-time/W2/ Open-Ended Contract-----------------If you are in the market for a new opportunity, JRD Systems is looking to hire a Lead Cloud/ Data engineer for Azure, that would be responsible for designing and implementing...

  • Lead Cloud Data Engineer

    1 week ago

    Dearborn, United States DATAMAXIS Full time

    Rate: Depending on experienceWork location: Dearborn, MI (hybrid)*Must-Have: - Bachelor's degree in science, Technology, Engineering, or Mathematics. - 7+ years of experience as a data engineer, with strong proficiency in Azure cloud services, Databricks, and Azure Data Factory - 3+ years of experience with designing and implementing data solutions using...

  • Lead Cloud Data Engineer

    2 weeks ago

    Dearborn, United States AB2 Consulting, Inc. Full time

    Job DescriptionJob DescriptionJob Summary:As a lead cloud engineer for Azure, you will be responsible for designing and implementing scalable, high-performance data engineering solutions using Azure Databricks and Azure Data Factory.Essential Job Functions:- Lead the design and implementation of complex cloud solutions using Microsoft Azure, focusing on...

  • Data Engineer

    2 weeks ago

    Dearborn, United States EPITEC Full time

    W2Position - HYBRID In Dearborn MichiganPosition Description:GDIA Data Engineer Job Description A position is open for a data engineer in the GDI&A Customer 360.The successful candidate will be responsible for designing, developing the transformation and modernization of big data solutions on GCP cloud integrating native GCP services and 3rd party data...

  • Data Engineer

    2 weeks ago

    Dearborn, United States EPITEC Full time

    W2Position - HYBRID In Dearborn MichiganPosition Description:GDIA Data Engineer Job Description A position is open for a data engineer in the GDI&A Customer 360.The successful candidate will be responsible for designing, developing the transformation and modernization of big data solutions on GCP cloud integrating native GCP services and 3rd party data...

  • Data Engineer

    7 days ago

    Dearborn, United States Ciber Full time

    HTC Global Services wants you. Come build new things with us and advance your career. At HTC Global you'll collaborate with experts. You'll join successful teams contributing to our clients' success. You'll work side by side with our clients and have long-term opportunities to advance your career with the latest emerging technologies. At HTC Global Services...

  • Data Engineer

    1 week ago

    Dearborn, United States Stefanini North America and APAC Full time

    The successful candidate will be responsible for designing, developing the transformation and modernization of big data solutions on GCP cloud integrating native GCP services and 3rd party data technologies also build new data products in GCP. We are looking for candidates who have a broad set of technology skills across these areas and who can demonstrate...

  • Data Engineer

    2 weeks ago

    Dearborn, United States Stefanini North America and APAC Full time

    The successful candidate will be responsible for designing, developing the transformation and modernization of big data solutions on GCP cloud integrating native GCP services and 3rd party data technologies also build new data products in GCP. We are looking for candidates who have a broad set of technology skills across these areas and who can demonstrate...

  • Data Engineer

    2 weeks ago

    Dearborn, United States Mindlance Full time

    We're seeking a Data Engineer who has experience building data products on a cloud analytics platform. You will work on ingesting, transforming, and analyzing large datasets to support the Enterprise in the Data Factory on Google Cloud Platform (GCP). Experience with large scale solution and operationalization of data lakes, data warehouses, and analytics...

  • Lead Cloud Engineer

    1 week ago

    Dearborn, United States Aventurine Technologies Inc Full time

    Job Description·      Lead Cloud Data Engineer (Azure & Databricks) Dearborn, MI (hybrid) USC – GC Only $70-75/hr c2c Must-Have:- Bachelor’s degree in science, Technology, Engineering, or Mathematics.- 7+ years of experience as a data engineer, with strong proficiency in Azure cloud services, Databricks, and Azure Data Factory- 3+ years of...

  • Data Engineer General

    2 weeks ago

    Dearborn, United States Apex Systems Full time

    Job#: 2021773 Job Description: Position Description: Position Responsibilities * Design, Develop and Implement data engineering solutions using standards, templates, patterns and best practices in the Google Cloud Platform o Full stack data engineering solutions utilizing both structured and unstructured data: development, ingestion, curation,...