Senior Data Engineer

Found in: beBee jobs US - 3 weeks ago

Dearborn, Michigan, United States Cognizant Technology Solutions Full time

This in-person position isopen to any qualified applicant in the United States.

This position is on-site in Dearborn, Michigan.

Practice - AIA - Artificial Intelligence and Analytics

About AI & Analytics: Artificial intelligence (AI) and the data it collects and analyzes will soon sit at the core of all intelligent, human-centric businesses. By decoding customer needs, preferences, and behaviors, our clients can understand exactly what services, products, and experiences their consumers need. Within AI & Analytics, we work to design the future—a future in which trial-and-error business decisions have been replaced by informed choices and data-supported strategies

By applying AI and data science, we help leading companies to prototype, refine, validate, and scale their AI and analytics products and delivery models Cognizant's AIA practice takes insights that are buried in data and provide businesses with a clear way to transform how they source, interpret, and consume their information. Our clients need flexible data structures and a streamlined data architecture that quickly turns data resources into informative, meaningful intelligence.

Job Duties and Responsibilities:
  • Design and develop change data capture processes between BigQuery tables to efficiently process data
  • Write and deploy custom BigQuery UDFs to implement data validation checks at scale, ensuring accuracy.
  • Create reusable Airflow DAGs leveraging advanced features like SLAs, custom operator plugins, and parallel task execution.
  • Utilize Terraform to automate provisioning of analytics infrastructure on GCP; automated tables, views, and other services on GCP.
  • Migrate legacy data from Teradata EDW into BigQuery leveraging custom Spark ETL code.
  • Build custom Airflow failure notification plugin using Python for error handling and SLA tracking.
  • Optimize BigQuery SQL performance through query partitioning, clustering reducing run times by 90%.
  • Profile query execution plans and create appropriate aggregations to improve read throughput for core business analytics workloads.
  • Establish SQL coding best practices in team including commenting, indenting, table aliasing for easier debugging and maintenance.
  • Create views, tables leveraging SQL for addressing ad-hoc analysis requests on enterprise data warehouse.
  • Conduct full data profiling and standardized data quality checks; implement a set of validation test cases in Python to ensure integrity.
Position Qualifications:
  • At least 5 to 8 years of work experience.
  • Required skills: GCP Big Query, PySpark, Python, and Google Cloud Composer
Salary and Other Compensation:

Applications will be accepted until 04/08/2024.

The annual salary for this position is between $95,000 to $140,000 depending on experience and other qualifications of the successful candidate.

This position is also eligible for Cognizant's discretionary annual incentive program and stock awards, based on performance and is subject to the terms of Cognizant's applicable plans.

Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:

  • Medical/Dental/Vision/Life Insurance
  • Paid holidays plus Paid Time Off
  • 401(k) plan and contributions
  • Long-term/Short-term Disability
  • Paid Parental Leave
  • Employee Stock Purchase Plan

Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.

  • Data Engineer

    Found in: beBee jobs US - 3 weeks ago

    Dearborn, Michigan, United States Stefanini North America And APAC Full time

    Stefanini is looking for Data Engineer, Location: Dearborn, MI (Hybrid)Develop EL/ELT/ETL pipelines by using Python/Pyspark to make data available in BigQuery analytical data store from disparate batch, streaming data sources for the Charging / Energy Analytics Product Line.Orchestrate workflows by using Astronomer (Airflow) that execute ETL data pipelines...

  • Senior GCP Data Engineer

    2 weeks ago

    Dearborn, United States Agile Tech Labs Full time

    Job DescriptionJob DescriptionJob Title: Senior GCP Data Engineer Job Location: Dearborn, MI (Hybrid) Job Type: Full TimeJob Description/ Requirement:5+ years of SQL development experience 5+ years of analytics/data product development experience required 3+ years of cloud experience (GCP preferred) with solutions designed and implemented at production scale...

  • Senior Data Engineer

    2 days ago

    Dearborn, United States Advanced Business Analytics Full time

    Dearborn, MI and various unanticipated locations throughout the U.S. Responsibilities: Design and Build world class high-volume real-time and near-real-time data processing frameworks for advanced analytics on big data platforms. Apply expertise in data integration technologies including: Informatica Big Data Management, PowerCenter, Big Data Edition,...

  • Data Engineer

    Found in: Appcast US C2 - 3 days ago

    Dearborn, United States EPITEC Full time

    W2Position - HYBRID In Dearborn MichiganPosition Description:GDIA Data Engineer Job Description A position is open for a data engineer in the GDI&A Customer 360.The successful candidate will be responsible for designing, developing the transformation and modernization of big data solutions on GCP cloud integrating native GCP services and 3rd party data...

  • Data Engineer

    Found in: Appcast Linkedin GBL C2 - 2 days ago

    Dearborn, United States EPITEC Full time

    W2Position - HYBRID In Dearborn MichiganPosition Description:GDIA Data Engineer Job Description A position is open for a data engineer in the GDI&A Customer 360.The successful candidate will be responsible for designing, developing the transformation and modernization of big data solutions on GCP cloud integrating native GCP services and 3rd party data...

  • GCP Data Engineer

    22 hours ago

    Dearborn, United States Kyyba Full time

    Job Title: GCP Data Engineer Duration: Long Term Location: 22001 Michigan Avenue,Dearborn,MI,48124 Payrate is 55 – 65 Position Description: GDIA Data Engineer Job Description A position is open for a data engineer in the GDI&A Customer 360.The successful candidate will be responsible for designing, developing the transformation and modernization of...

  • Data Engineer General

    5 days ago

    Dearborn, United States Ciber Full time

    HTC Global Services wants you. Come build new things with us and advance your career. At HTC Global you'll collaborate with experts.You'll join successful teams contributing to our clients' success.You'll work side by side with our clients and have long-term opportunities to advance your career with the latest emerging technologies.At HTC Global Services our...

  • Data Engineer

    6 days ago

    Dearborn, United States Akkodis Full time

    Akkodis is seeking a Data Engineer who has experience building data products on a cloud analytics platform. You will work on ingesting, transforming, and analyzing large datasets to support the Enterprise in the Data Factory on Google Cloud Platform (GCP). Experience with large scale solution and operationalization of data lakes, data warehouses, and...

  • Data Engineer General

    2 weeks ago

    Dearborn, United States Ciber Full time

    HTC Global Services wants you. Come build new things with us and advance your career. At HTC Global you'll collaborate with experts.You'll join successful teams contributing to our clients' success.You'll work side by side with our clients and have long-term opportunities to advance your career with the latest emerging technologies. At HTC Global Services...

  • GCP Data Engineer

    6 days ago

    Dearborn, United States SmartIPlace Full time

    Job DescriptionJob DescriptionRole: GCP Data EngineerLocation: Dearborn, MI (Hybrid)Visa: No h1B and CPTHire Mode: W2Job Description: A position is open for a data engineer in the GDI&A Customer 360. The successful candidate will be responsible for designing, developing the transformation and modernization of big data solutions on GCP cloud integrating...

  • GCP Data Engineer

    Found in: Appcast US C2 - 7 days ago

    Dearborn, United States EPITEC Full time

    Looking for a GCP Cloud Data Engineer with Python to work hybrid in Dearborn, MIPosition Description:We’re seeking a Data Engineer who has experience building data products on a cloud analytics platform. You will work on ingesting, transforming, and analyzing large datasets to support the Enterprise in the Data Factory on Google Cloud Platform (GCP)....

  • GCP Data Engineer

    Found in: Appcast Linkedin GBL C2 - 7 days ago

    Dearborn, United States EPITEC Full time

    Looking for a GCP Cloud Data Engineer with Python to work hybrid in Dearborn, MIPosition Description:We’re seeking a Data Engineer who has experience building data products on a cloud analytics platform. You will work on ingesting, transforming, and analyzing large datasets to support the Enterprise in the Data Factory on Google Cloud Platform (GCP)....

  • Data Engineer

    21 hours ago

    Dearborn, United States Ciber Full time

    HTC Global Services wants you. Come build new things with us and advance your career. At HTC Global you'll collaborate with experts.You'll join successful teams contributing to our clients' success.You'll work side by side with our clients and have long-term opportunities to advance your career with the latest emerging technologies. At HTC Global Services...

  • Data Engineer

    6 days ago

    Dearborn, United States Diverse Lynx Full time

    Job Title Data Engineer - Testing Relevant Experience (in Yrs) 3-4 years Technical/Functional Skills GCP and GCP functionalities like running DAGs, troubleshooting when there is a failure, console, and all other features present in GCP tool. Complex query writing, procedures, routines in BigQuery. ETL Testing, BigData testing and tools. ny...

  • Senior Software Engineer

    Found in: Appcast US C2 - 2 weeks ago

    Dearborn, United States Advantage Technical Full time

    Software Engineer Fulltime opportunity Location: Dearborn , MIHybrid role ( Must be local )Advantage technical has partnered with an American multinational automobile manufacturer on a search for a Senior Software Engineer to join their company . We’re seeking a software engineer with multi-year experience and specializes on web services and UI...

  • Senior Software Engineer

    Found in: Appcast Linkedin GBL C2 - 3 weeks ago

    Dearborn, United States Advantage Technical Full time

    Software Engineer Fulltime opportunity Location: Dearborn , MIHybrid role ( Must be local )Advantage technical has partnered with an American multinational automobile manufacturer on a search for a Senior Software Engineer to join their company . We’re seeking a software engineer with multi-year experience and specializes on web services and UI...

  • Senior Software Engineer

    Found in: Talent US C2 - 15 hours ago

    Dearborn, United States SkySys Full time

    Title: Software Engineer Senior Location: DEARBORN, MI Position Description: • Develops software and services in support of design, infrastructure, and technology platforms, including applications, utilities, databases, cloud-based and Internet-related tools. Build reusable code and libraries. • Ensure the technical feasibility of UI/UX designs....

  • Data & Analytics Architect

    5 days ago

    Dearborn, United States Stefanini Full time

    Stefanini is looking for a Data Engineer, Location: We're seeking a Data Engineer who has experience building data products on a cloud analytics platform. You will work on ingesting, transforming, and analyzing large datasets to support the Enterprise in the Data Factory on Google Cloud Platform (GCP). Experience with large scale solution and...

  • Data Scientist

    2 weeks ago

    Dearborn, United States McCulloh Consulting Full time

    Job DescriptionJob DescriptionAre you a Data Professional with Engineering experience and a desire to work in Data Science? Do you possess a strong background in providing data solutions with R or Python? Do you want to live in the Detroit area and find out what all the buzz is about!? If so, keep reading about this amazing...

  • Data Scientist

    3 days ago

    Dearborn, United States McCulloh Consulting Full time

    Job DescriptionJob DescriptionAre you a Data Professional with Engineering experience and a desire to work in Data Science? Do you possess a strong background in providing data solutions with R or Python? Do you want to live in the Detroit area and find out what all the buzz is about!? If so, keep reading about this amazing...

  • Data Architect Data Analytics

    Found in: Jooble US O C2 - 3 days ago

    Dearborn, MI, United States Stefanini Full time

    Stefanini is looking for a Data Engineer, Location: We're seeking a Data Engineer who has experience building data products on a cloud analytics platform. You will work on ingesting, transforming, and analyzing large datasets to support the Enterprise in the Data Factory on Google Cloud Platform (GCP). Experience with large scale solution and...