Data Engineer

3 weeks ago


Fountain Hills, United States Zortech Solutions Full time
Job DescriptionJob Description

Role: Data Engineer (Digital Wallet)

Location: Scottsdale AZ (hybrid)

Duration: FTE & C2C

Job Description:

Must have : Skillset: Java, Scala, S3, Glue, Python, AWS.

6-8 years of IT experience focusing on enterprise data architecture and management.

Experience in Conceptual/Logical/Physical Data Modeling & expertise in Relational and Dimensional Data Modeling

Experience with Databricks & on Prem, Structured Streaming, Delta Lake concepts, and Delta Live Tables required

Experience with Spark Scala and Java programming

Data Lake concepts such as time travel and schema evolution and optimization

Structured Streaming and Delta Live Tables with Databricks as a bonus

Experience leading and architecting enterprise-wide initiatives specifically system integration, data migration, transformation, data warehouse build, data

mart build, and data lakes implementation/support

Advanced level understanding of streaming data pipelines and how they differ from batch systems

Formalize concepts of how to handle late data, defining windows, and data freshness

Advanced understanding of ETL and ELT and ETL/ELT tools such as Data Migration Service etc

Understanding of concepts and implementation strategies for different incremental data loads such as tumbling window, sliding window, high watermarks, etc.

Familiarity and/or expertise with Great Expectations or other data quality/data validation frameworks a bonus

Familiarity with concepts such as late data, defining windows, and how window definitions impact data freshness

Advanced level SQL experience (Joins, Aggregation, Windowing functions, Common Table Expressions, RDBMS schema design performance optimization)

Indexing and partitioning strategy experience

Debug, troubleshoot, design, and implement solutions to complex technical issues

Experience with large-scale, high-performance enterprise big data application deployment and solution

Architecture experience in AWS environment a bonus

Familiarity working with Lambda specifically with how to push and pull data, how to use AWS tools to view data for processing massive data at scale a bonus

Experience with Gitlabs and CloudWatch and ability to write and maintain Gitlabs for supporting CI/CD pipelines

Experience working with AWS Lambdas for configuration and optimization and experience with S3

Familiarity with Schema Registry, and message formats such as Avro, ORC, etc.

Ability to thrive in a team-based environment

Experience briefing the benefits and constraints of technology solutions to technology partners, stakeholders, team members, and senior-level of management


  • Data Engineer

    2 weeks ago


    Vernon Hills, United States Precise Solutions Full time

    At Precise Solutions, we are looking for top talent consultants to bring on as employees of our organization and service our clients in the various Life Sciences Industries. We are much more than a consulting firm! Precise Solutions provides competitive compensation packages with great salaries, benefits, health insurance, paid time off and employer-based...

  • Data Engineer

    2 days ago


    Auburn Hills, United States HRU Inc Technical Resources Full time

    Title: Data Engineer Product Support is the primary quality liaison group between the factories and Volkswagen of America. The primary role of the Data Engineer position is to design, construct, test and maintain data sources for deeper analysis. Additionally, the Data Engineer will be responsible for monitoring/improving work processes, and developing and...

  • Data Engineer

    4 days ago


    Auburn Hills, United States Akkodis Full time

    Job Title: Data Engineer / Business Analyst Type of Role: Long-term, ongoing contract Location: Auburn Hills, MI (hybrid) Pay Rate: $40.00/hour-$42.00/hour Product Support is the primary quality liaison group between the factories and company. The primary role of the Data Engineer position is to design, construct, test and maintain data sources for deeper...

  • Data Engineer

    2 weeks ago


    Auburn Hills, United States Akkodis Full time

    Job Title: Data Engineer / Business AnalystType of Role: Long-term, ongoing contractLocation: Auburn Hills, MI (hybrid)Pay Rate: $40.00/hour-$42.00/hourProduct Support is the primary quality liaison group between the factories and company. The primary role of the Data Engineer position is to design, construct, test and maintain data sources for deeper...

  • Data Engineer

    3 weeks ago


    Auburn Hills, United States Akkodis Full time

    Job Title: Data Engineer / Business AnalystType of Role: Long-term, ongoing contractLocation: Auburn Hills, MI (hybrid)Pay Rate: $40.00/hour-$42.00/hourProduct Support is the primary quality liaison group between the factories and company. The primary role of the Data Engineer position is to design, construct, test and maintain data sources for deeper...


  • Auburn Hills, United States SEGULA Technologies Full time

    Company Description Do you want to shape the world of tomorrow and work on innovative projects? Then you're a good fit for us! We are a global engineering group with 15,000 employees and 140 locations worldwide. With our services, we are driving the topics of energy efficiency, climate protection and decarbonization and developing tech industries into...


  • Auburn Hills, United States SEGULA Technologies Full time

    Company Description Do you want to shape the world of tomorrow and work on innovative projects? Then you're a good fit for us! We are a global engineering group with 15,000 employees and 140 locations worldwide. With our services, we are driving the topics of energy efficiency, climate protection and decarbonization and developing tech industries into new...

  • Data Engineer

    2 weeks ago


    Bloomfield Hills, United States Unified Tech Group Inc Full time

    Job DescriptionJob DescriptionSalary: Job Title:  Data Engineer                                          Job Duties: Perform full life cycle of data project architecture implementation. Design, code and debug database and business intelligence applications in various platforms including Oracle and MS SQL Server....


  • Farmington Hills, United States Hitachi Data Systems Full time

    Description Position Overview and Objectives: Seeking a talented and self-motivated automotive System Engineer located in Farmington Hills, MI. The ideal candidate will have experience in system engineering principles as applied to complex electronic controllers. The electronic control units may integrate with other mechatronic components such as sensors and...


  • Auburn Hills, Michigan, United States Segula Technologies Full time

    Job Description The Data Acquisition engineer works closely with the platform engineers, CAE and modeling groups to help define the test and determine the required channels needed to record to support the engineering needs for the project. The Data Acquisition Engineer is responsible for performing Powertrain and or Body Chassis data acquisitions for all...


  • Fountain Hills, United States Saxon Global Full time

    No H1B Operations/SRE Engineer CVS Rate: $55/hr C2C Location: Scottsdale, AZ **HYBRID** We have a requirement that has come up with the below skill set to be filled from US and mandatorily at Scottsdale, AZ location. s. Job description 3+ Years of Experience in Incident Management, Change Management and Problem Management. 1-2 years of...

  • AWS Data Engineer

    3 weeks ago


    Parsippany-Troy Hills, United States Iris Software Inc. Full time

    IRIS direct end client which is one of the leading American provider of human resources management software and services is urgently looking to hire AWS Data Engineer – Parsippany, NJ 07054 (Hybrid - 3 days per week). This is a Contract to hire Role opportunity.AWS Data EngineerParsippany, NJ 07054 (Hybrid - 3 days per week)Nature of Contract – Contract...


  • Auburn Hills, United States Zobility Full time

    Job Description: The Autonomous Driving Data Management Engineer will be responsible for expanding and optimizing the Autonomous Driving Data Management Toolchain, as well as optimizing data flow and collection requirements for cross functional teams. He/She will work within the Data Management team and in close collaboration with reprocessing and vehicle...

  • Data Engineer

    2 days ago


    Farmington Hills, United States Dechen Consulting Full time

    Perform full life cycle of project architecture Concierge CV Data use cases through the current process and enablers to solutions/answers. Support and enhance the supply side of Connected Vehicle Data, Measure success through the improvement of the CV Data journey and process. Leverage domain network to identify/categorize/rank the connectivity usefulness...


  • Beverly Hills, United States VeeRteq Solutions Inc. Full time

    Job DescriptionJob DescriptionLead AWS Data Engineer (DBT/Redshift)Duration- Long ContractLocation-Beverly Hills, CA (LA Area)Job Type- Onsite onlyExperience Range- 8+ years of experienceKey Expectation:If you are very strong with SQL & Pyspark & Databricks along with DBT tool use/AWS Redshift experience and a Lead Data Engineer with very strong hands on SQL...

  • Data Centre Engineer

    3 weeks ago


    Beverly Hills, United States DeRisk Technologies Full time

    A DC engineer is needed to work on-demand for one of our clients. The following duties should be able to be carried out by the engineer:Deployment / In-Scope Configuration Items Servers (Virtual & Physical) Storage & Backup Devices Server Appliances Hyper Converged Infrastructure (E.g. Nutanix, Cisco UCS) Tape Storage Units Power Distribution Units rated...


  • Auburn Hills, United States Comerica Bank Full time

    PRINCIPAL DATA ENGINEERThe Principal Data Engineer (IICS & Snowflake ETL) will provide data engineering and architecture support for complex Data management activities related to system software, hardware, performance, problem determination or resource management requiring communication and coordination with vendors, technicians, clients, and management....


  • Auburn Hills, United States Comerica Management Co Inc Full time

    Data Engineering Domain Architect The Data Engineering Domain Architect will participate in the creation and evolution of the technology road map that defines current technical architectures and future architectures for the Domain. The Domain Architect is the end-to-end subject matter expert for architectural frameworks, methods, design patterns and tools...


  • Auburn Hills, United States Comerica Full time

    Data Engineering Domain ArchitectThe Data Engineering Domain Architect will participate in the creation and evolution of the technology road map that defines current technical architectures and future architectures for the Domain. The Domain Architect is the end-to-end subject matter expert for architectural frameworks, methods, design patterns and tools...


  • Auburn Hills, United States Comerica Bank Full time

    Data Engineering Domain ArchitectThe Data Engineering Domain Architect will participate in the creation and evolution of the technology road map that defines current technical architectures and future architectures for the Domain. The Domain Architect is the end-to-end subject matter expert for architectural frameworks, methods, design patterns and tools...