Data Engineer

2 weeks ago

Scottsdale, AZ, United States Zortech Solutions Full time
Role: Data Engineer (Digital Wallet)
Location: Scottsdale AZ (hybrid)
Duration: FTE & C2C

Job Description:

Must have : Skillset: Java, Scala, S3, Glue, Python, AWS.

6-8 years of IT experience focusing on enterprise data architecture and management.

• Experience in Conceptual/Logical/Physical Data Modeling & expertise in Relational and Dimensional Data Modeling

• Experience with Databricks & on Prem, Structured Streaming, Delta Lake concepts, and Delta Live Tables required

• Experience with Spark Scala and Java programming

• Data Lake concepts such as time travel and schema evolution and optimization

• Structured Streaming and Delta Live Tables with Databricks as a bonus

• Experience leading and architecting enterprise-wide initiatives specifically system integration, data migration, transformation, data warehouse build, data

mart build, and data lakes implementation/support

• Advanced level understanding of streaming data pipelines and how they differ from batch systems

• Formalize concepts of how to handle late data, defining windows, and data freshness

• Advanced understanding of ETL and ELT and ETL/ELT tools such as Data Migration Service etc

• Understanding of concepts and implementation strategies for different incremental data loads such as tumbling window, sliding window, high watermarks, etc.

• Familiarity and/or expertise with Great Expectations or other data quality/data validation frameworks a bonus

• Familiarity with concepts such as late data, defining windows, and how window definitions impact data freshness

• Advanced level SQL experience (Joins, Aggregation, Windowing functions, Common Table Expressions, RDBMS schema design performance optimization)

• Indexing and partitioning strategy experience

• Debug, troubleshoot, design, and implement solutions to complex technical issues

• Experience with large-scale, high-performance enterprise big data application deployment and solution

• Architecture experience in AWS environment a bonus

• Familiarity working with Lambda specifically with how to push and pull data, how to use AWS tools to view data for processing massive data at scale a bonus

• Experience with Gitlabs and CloudWatch and ability to write and maintain Gitlabs for supporting CI/CD pipelines

• Experience working with AWS Lambdas for configuration and optimization and experience with S3

• Familiarity with Schema Registry, and message formats such as Avro, ORC, etc.

• Ability to thrive in a team-based environment

• Experience briefing the benefits and constraints of technology solutions to technology partners, stakeholders, team members, and senior-level of management

  • Data Engineer

    6 days ago

    Scottsdale, AZ, United States Insight Global Full time

    As a Data Engineer, your day begins by syncing with business stakeholders often on calls to understand their evolving data needs and operational challenges, particularly in the U.S. healthcare space. You'll spend a significant portion of your time diving into large datasets, using SQL and ETL tools like SSIS and .NET to extract, transform, and load data from...

  • Data Engineer

    2 weeks ago

    Scottsdale, AZ, United States Concord IT Systems Full time

    Job Title: Data Engineer Location: Scottsdale, AZ (onsite day 1) Key Responsibilities: Build frameworks for data ingestion pipeline for a variety of data sources: batch and real-time Participate in technical decisions Design, develop, test, and maintain data processing pipelines Design and build scalable, reliable data infrastructure with paramount focus on...

  • AWS Data Engineer

    2 weeks ago

    Scottsdale, AZ, United States Concord IT Systems Full time

    Role: AWS Data Engineer Work Location & Reporting Address: Scottsdale, AZ (Onsite) Contract duration (in months): 12 Job Details: AWS Cloud Watch, Kinesis, RedShift, S3, Dynamo DB, IAM, RDS SQL Server Python, Hadoop, Scala Nice to have skills Java, Tableau JIRA, Harness, DevOps Responsibilities: • Highly skilled AWS Data Engineer with 10 years of...

  • AWS Data Engineer

    4 days ago

    Scottsdale, AZ, United States Concord IT Systems Full time

    Role: AWS Data Engineer Work Location & Reporting Address: Scottsdale, AZ (Onsite) Contract duration (in months): 12 Job Details: AWS Cloud Watch, Kinesis, RedShift, S3, Dynamo DB, IAM, RDS SQL Server Python, Hadoop, Scala Nice to have skills Java, Tableau JIRA, Harness, DevOps Responsibilities: • Highly skilled AWS Data Engineer with 10 years of...

  • Senior Azure Data Engineer

    2 days ago

    Scottsdale, AZ, United States Motion Recruitment Full time

    A fast-growing and innovative workforce travel technology company based in Scottsdale, Arizona is seeking a highly skilled Senior Data Engineer to join our expanding Data Platform & Engineering team. This hybrid role includes regular in-office collaboration with up to 20% flexibility to work from home. We're looking for an experienced data engineer with a...

  • Data Engineer

    8 hours ago

    Scottsdale, AZ, United States Zortech Solutions Full time

    Role: Data Engineer (DE) Location: Scottsdale AZ (day 1 onsite) Duration:: FTE /CTH Job Description: Skill set: Java/Scala/Python, Spark, S3, Glue, Redshift Masking tools: Data Masking tools- who should have PII knowledge, Data Stewardship Job Description (Lead Data Engineer) • You have 8-10 years of relevant software development experience • You have...

  • Data Engineer

    11 hours ago

    Scottsdale, AZ, United States Zortech Solutions Full time

    Role: Data Engineer (DE) Location: Scottsdale AZ (day 1 onsite) Duration:: FTE /CTH Job Description: Skill set: Java/Scala/Python, Spark, S3, Glue, Redshift Masking tools: Data Masking tools- who should have PII knowledge, Data Stewardship Job Description (Lead Data Engineer) • You have 8-10 years of relevant software development experience • You have...

  • Data Engineer-DE 1

    11 hours ago

    Scottsdale, AZ, United States Zortech Solutions Full time

    Role: Data Engineer-DE 1 Location: Scottsdale AZ (day 1 onsite) Suration:: FTE /CTH Skill set: Java/Scala/Python, Spark, S3, Glue, Redshift Masking tools: Data Masking tools- who should have PII knowledge, Data Stewardship Job Description (Lead Data Engineer) • You have 8-10 years of relevant software development experience • You have hands-on...

  • Senior Data Engineer III

    4 days ago

    Scottsdale, AZ, United States arrivia Full time

    At arrivia, we’re transforming the travel experience for millions of members worldwide through our high-performance, scalable, and personalized platform. We are seeking a motivated experienced Senior Data Engineer III to join our team. In this role, you'll work primarily with Microsoft SQL Server, SSIS, mySQL and Azure to manage, transform large volumes of...

  • Senior Data Engineer III

    4 days ago

    Scottsdale, AZ, United States arrivia Full time

    At arrivia, we’re transforming the travel experience for millions of members worldwide through our high-performance, scalable, and personalized platform. We are seeking a motivated experienced Senior Data Engineer III to join our team. In this role, you'll work primarily with Microsoft SQL Server, SSIS, mySQL and Azure to manage, transform large volumes of...