Data Engineer

2 weeks ago

Dearborn, United States EPITEC Full time

W2Position - HYBRID In Dearborn Michigan


Position Description:

GDIA Data Engineer Job Description A position is open for a data engineer in the GDI&A Customer 360.The successful candidate will be responsible for designing, developing the transformation and modernization of big data solutions on GCP cloud integrating native GCP services and 3rd party data technologies also build new data products in GCP. We are looking for candidates who have a broad set of technology skills across these areas and who can demonstrate an ability to design and develop right solutions with appropriate combination of GCP and 3rd party technologies for deploying on GCP cloud.

Responsibilities Key Responsibilities:

  • Work as part of an implementation team from concept to operations, providing deep technical subject matter expertise for successfully deployment of Data Platform Implement methods for automation of all parts of the pipeline to minimize labor in development and production.
  • Identify, develop, evaluate, and summarize Proof of Concepts to prove out solutions
  • Test and compare competing solutions and report out a point of view on the best solution
  • Experience with large scale solutioning and operationalization of data warehouses, data lakes and analytics platforms on GCP
  • Design and build production data engineering solutions to deliver our pipeline patterns using Google Cloud Platform (GCP) services:
  • BigQuery, DataFlow (Apache Beam), Pub/Sub, BigTable, Data Fusion, DataProc, Cloud Composer (Apache Airflow), Cloud SQL, Compute Engine, Cloud Functions, and App Engine
  • Migrate existing Big Data pipelines into Google Cloud Platform .
  • Build new data products in GCP.

Skills Required:

  • Minimum 3 Years of Experience in Java/python in-depth
  • Minimum 2 Years of Experience in data engineering pipelines/ building data warehouse systems with ability to understand ETL principles and write complex sql queries.
  • Minimum 5 Years of GCP experience working in GCP based Big Data deployments (Batch/Real-Time) leveraging Big Query, Big Table, Google Cloud Storage, PubSub, Data Fusion, Dataflow, Dataproc
  • Minimum 2 years of experience in development using Data warehousing, Big Data Eco System Hive (Hql) & Oozie Scheduler, ETL IBM Data Stage, Informatica IICS with Teradata
  • 1 Year experience of deploying google cloud services using Terraform

Skills Preferred:

  • Understands Cloud as being a way to operate and not a place to host systems
  • Understands data architectures and design independent of the technology
  • Experience with Python, Shell Script preferred
  • Exceptional problem solving and communication skills and management of multiple stakeholders
  • Experience in working with Agile and Lean methodologies
  • Experience with Test-Driven Development

Experience Required:

  • Minimum 3 Years of Experience in Java/python in-depth
  • Minimum 2 Years of Experience in data engineering pipelines/ building data warehouse systems with ability to understand ETL principles and write complex sql queries.
  • Minimum 5 Years of GCP experience working in GCP based Big Data deployments (Batch/Real-Time) leveraging Big Query, Big Table, Google Cloud Storage, PubSub, Data Fusion, Dataflow, Dataproc
  • Minimum 2 years of experience in development using Data warehousing, Big Data Eco System Hive (Hql) & Oozie Scheduler, ETL IBM Data Stage, Informatica IICS with Teradata
  • 1 Year experience of deploying google cloud services using Terraform

  • Data Engineer

    7 days ago

    Dearborn, United States JRD Systems Full time

    Position: Lead Cloud Data EngineerLocation: REMOTE/ Hybrid - 2 days onsite per week, Dearborn, MIPay/ Salary: + $120,000Job Type: Full-time/W2/ Open-Ended Contract-----------------If you are in the market for a new opportunity, JRD Systems is looking to hire a Lead Cloud/ Data engineer for Azure, that would be responsible for designing and implementing...

  • Data Engineer

    1 week ago

    Dearborn, United States JRD Systems Full time

    Position: Lead Cloud Data EngineerLocation: REMOTE/ Hybrid - 2 days onsite per week, Dearborn, MIPay/ Salary: + $120,000Job Type: Full-time/W2/ Open-Ended Contract-----------------If you are in the market for a new opportunity, JRD Systems is looking to hire a Lead Cloud/ Data engineer for Azure, that would be responsible for designing and implementing...

  • Data Engineer

    5 days ago

    Dearborn, United States Ciber Full time

    HTC Global Services wants you. Come build new things with us and advance your career. At HTC Global you'll collaborate with experts. You'll join successful teams contributing to our clients' success. You'll work side by side with our clients and have long-term opportunities to advance your career with the latest emerging technologies. At HTC Global Services...

  • Data Engineer

    1 week ago

    Dearborn, United States Stefanini North America and APAC Full time

    The successful candidate will be responsible for designing, developing the transformation and modernization of big data solutions on GCP cloud integrating native GCP services and 3rd party data technologies also build new data products in GCP. We are looking for candidates who have a broad set of technology skills across these areas and who can demonstrate...

  • Data Engineer

    1 week ago

    Dearborn, United States Stefanini North America and APAC Full time

    The successful candidate will be responsible for designing, developing the transformation and modernization of big data solutions on GCP cloud integrating native GCP services and 3rd party data technologies also build new data products in GCP. We are looking for candidates who have a broad set of technology skills across these areas and who can demonstrate...

  • Data Engineer

    2 weeks ago

    Dearborn, United States Mindlance Full time

    We're seeking a Data Engineer who has experience building data products on a cloud analytics platform. You will work on ingesting, transforming, and analyzing large datasets to support the Enterprise in the Data Factory on Google Cloud Platform (GCP). Experience with large scale solution and operationalization of data lakes, data warehouses, and analytics...

  • Lead data engineer

    7 days ago

    Dearborn, United States JRD Systems Full time

    Job Description:As a lead cloud engineer for Azure, you will be responsible for designing and implementing scalable, high-performance data engineering solutions using Azure Databricks and Azure Data Factory. Essential Job Functions: Lead the design and implementation of complex cloud solutions using Microsoft Azure, focusing on integration with Databricks...

  • Lead data engineer

    7 days ago

    Dearborn, United States JRD Systems Full time

    Job Description:As a lead cloud engineer for Azure, you will be responsible for designing and implementing scalable, high-performance data engineering solutions using Azure Databricks and Azure Data Factory. Essential Job Functions: Lead the design and implementation of complex cloud solutions using Microsoft Azure, focusing on integration with Databricks...

  • Lead data engineer

    1 week ago

    Dearborn, United States JRD Systems Full time

    Job Description:As a lead cloud engineer for Azure, you will be responsible for designing and implementing scalable, high-performance data engineering solutions using Azure Databricks and Azure Data Factory. Essential Job Functions: Lead the design and implementation of complex cloud solutions using Microsoft Azure, focusing on integration with Databricks...

  • Lead data engineer

    4 days ago

    Dearborn, United States JRD Systems Full time

    Job Description:As a lead cloud engineer for Azure, you will be responsible for designing and implementing scalable, high-performance data engineering solutions using Azure Databricks and Azure Data FactoryEssential Job Functions: Lead the design and implementation of complex cloud solutions using Microsoft Azure, focusing on integration with Databricks and...

  • Data Engineer General

    2 weeks ago

    Dearborn, United States Apex Systems Full time

    Job#: 2021773 Job Description: Position Description: Position Responsibilities * Design, Develop and Implement data engineering solutions using standards, templates, patterns and best practices in the Google Cloud Platform o Full stack data engineering solutions utilizing both structured and unstructured data: development, ingestion, curation,...

  • GCP Data Engineer

    2 days ago

    Dearborn, United States EPITEC Full time

    Looking for a GCP Cloud Data Engineer with Python to work hybrid in Dearborn, MIIdeally looking for GCP certified Data EngineersPosition Description:We’re seeking a Data Engineer who has experience building data products on a cloud analytics platform. You will work on ingesting, transforming, and analyzing large datasets to support the Enterprise in the...

  • GCP Data Engineer

    2 days ago

    Dearborn, United States EPITEC Full time

    Looking for a GCP Cloud Data Engineer with Python to work hybrid in Dearborn, MIIdeally looking for GCP certified Data EngineersPosition Description:We’re seeking a Data Engineer who has experience building data products on a cloud analytics platform. You will work on ingesting, transforming, and analyzing large datasets to support the Enterprise in the...

  • Data Engineer

    4 weeks ago

    Dearborn, Michigan, United States Stefanini North America And APAC Full time

    Stefanini is looking for Data Engineer, Location: Dearborn, MI (Hybrid)Develop EL/ELT/ETL pipelines by using Python/Pyspark to make data available in BigQuery analytical data store from disparate batch, streaming data sources for the Charging / Energy Analytics Product Line.Orchestrate workflows by using Astronomer (Airflow) that execute ETL data pipelines...

  • Data Engineer

    2 weeks ago

    Dearborn, United States Ciber Full time

    HTC Global Services wants you. Come build new things with us and advance your career. At HTC Global you'll collaborate with experts. You'll join successful teams contributing to our clients' success. You'll work side by side with our clients and have long-term opportunities to advance your career with the latest emerging technologies. At HTC Global Services...

  • GCP Data Engineer

    1 day ago

    Dearborn, United States Stefanini North America and APAC Full time

    The successful candidate will be responsible for designing, developing the transformation and modernization of big data solutions on GCP cloud integrating native GCP services and 3rd party data technologies also build new data products in GCP. We are looking for candidates who have a broad set of technology skills across these areas and who can demonstrate...

  • GCP Data Engineer

    24 hours ago

    Dearborn, United States Stefanini North America and APAC Full time

    The successful candidate will be responsible for designing, developing the transformation and modernization of big data solutions on GCP cloud integrating native GCP services and 3rd party data technologies also build new data products in GCP. We are looking for candidates who have a broad set of technology skills across these areas and who can demonstrate...

  • GCP Data Engineer

    18 hours ago

    Dearborn, United States Stefanini North America and APAC Full time

    The successful candidate will be responsible for designing, developing the transformation and modernization of big data solutions on GCP cloud integrating native GCP services and 3rd party data technologies also build new data products in GCP. We are looking for candidates who have a broad set of technology skills across these areas and who can demonstrate...

  • Data Engineer Lead

    2 weeks ago

    Dearborn, United States Damco Solutions Full time

    Position Description: The GDIA Data Factory Platform covers all business processes and technical components involved in ingesting a wide range of enterprise data into the GDIA Data Factory (Data Lake) and the transformation of that data into consumable data sets in support of analytics. The Data Factory Enablement Team, as the name suggests enables...

  • Lead Azure Data engineer

    1 day ago

    Dearborn, United States Info Services Full time

    Essential Job Functions:*Responsibilities:*- Lead the design and implementation of complex cloud solutions using Microsoft Azure, focusing on integration with Databricks and Azure Data Factory.- Develop and maintain scalable and efficient data pipelines and architectures.- Ensure optimal architecture and performance of applications deployed on Azure.-...