Senior Data Engineer

4 weeks ago

Scottsdale, United States Techwizens LLC Full time
  • Must have : Skillset: Java, Scala, S3, Glue, aws , Redshift.
  • 6-8 years of IT experience focusing on enterprise data architecture and management.
  • • Experience in Conceptual/Logical/Physical Data Modeling & expertise in Relational and Dimensional Data Modeling
  • • Experience with Databricks & on Prem, Structured Streaming, Delta Lake concepts, and Delta Live Tables required
  • • Experience with Spark Scala and Java programming
  • • Data Lake concepts such as time travel and schema evolution and optimization
  • • Structured Streaming and Delta Live Tables with Databricks as a bonus
  • • Experience leading and architecting enterprise-wide initiatives specifically system integration, data migration, transformation, data warehouse build, data
  • mart build, and data lakes implementation/support
  • • Advanced level understanding of streaming data pipelines and how they differ from batch systems
  • • Formalize concepts of how to handle late data, defining windows, and data freshness
  • • Advanced understanding of ETL and ELT and ETL/ELT tools such as Data Migration Service etc
  • • Understanding of concepts and implementation strategies for different incremental data loads such as tumbling window, sliding window, high watermarks, etc.
  • • Familiarity and/or expertise with Great Expectations or other data quality/data validation frameworks a bonus
  • • Familiarity with concepts such as late data, defining windows, and how window definitions impact data freshness
  • • Advanced level SQL experience (Joins, Aggregation, Windowing functions, Common Table Expressions, RDBMS schema design performance optimization)
  • • Indexing and partitioning strategy experience
  • • Debug, troubleshoot, design, and implement solutions to complex technical issues
  • • Experience with large-scale, high-performance enterprise big data application deployment and solution
  • • Architecture experience in AWS environment a bonus
  • • Familiarity working with Lambda specifically with how to push and pull data, how to use AWS tools to view data for processing massive data at scale a bonus
  • • Experience with Gitlabs and CloudWatch and ability to write and maintain Gitlabs for supporting CI/CD pipelines
  • • Experience working with AWS Lambdas for configuration and optimization and experience with S3
  • • Familiarity with Schema Registry, and message formats such as Avro, ORC, etc.
  • • Ability to thrive in a team-based environment
  • • Experience briefing the benefits and constraints of technology solutions to technology partners, stakeholders, team members, and senior-level of management

  • Senior Data Engineer

    2 weeks ago

    Scottsdale, United States RiverPoint Full time

    Job DescriptionJob DescriptionInfomatics is hiring a Senior Data Engineer on a direct hire/FTE basis to lead design, development and implementation efforts on our client’s Enterprise Analytics platform which includes an MPP Enterprise Data Warehouse, cloud-based Data Lake and other Big Data technologies. Essential Duties and Responsibilities:Guides the...

  • Senior Data Engineer

    4 days ago

    Scottsdale, United States RiverPoint Full time

    Job DescriptionJob DescriptionInfomatics is hiring a Senior Data Engineer on a direct hire/FTE basis to lead design, development and implementation efforts on our client’s Enterprise Analytics platform which includes an MPP Enterprise Data Warehouse, cloud-based Data Lake and other Big Data technologies. Essential Duties and Responsibilities:Guides the...

  • Senior Data Engineer

    2 months ago

    Scottsdale, United States Cardone Ventures Full time

    POSITION SUMMARYThe Senior Data Engineer will play a vital role in designing, developing, and maintaining the data pipelines and infrastructure that ingests, transforms, and stores massive datasets from various sources to support our evolving business needs. You'll be at the forefront of implementing a cutting-edge lake house architecture, ensuring efficient...

  • Senior Data Engineer

    2 months ago

    Scottsdale, United States Cardone Ventures Full time

    POSITION SUMMARYThe Senior Data Engineer will play a vital role in designing, developing, and maintaining the data pipelines and infrastructure that ingests, transforms, and stores massive datasets from various sources to support our evolving business needs. You'll be at the forefront of implementing a cutting-edge lake house architecture, ensuring efficient...

  • Senior Data Engineer

    2 months ago

    Scottsdale, United States Cardone Ventures Full time

    POSITION SUMMARYThe Senior Data Engineer will play a vital role in designing, developing, and maintaining the data pipelines and infrastructure that ingests, transforms, and stores massive datasets from various sources to support our evolving business needs. You'll be at the forefront of implementing a cutting-edge lake house architecture, ensuring efficient...

  • Senior Data Engineer

    4 days ago

    Scottsdale, United States Cardone Ventures Full time

    POSITION SUMMARY The Senior Data Engineer will play a vital role in designing, developing, and maintaining the data pipelines and infrastructure that ingests, transforms, and stores massive datasets from various sources to support our evolving business needs. You'll be at the forefront of implementing a cutting-edge lake house architecture, ensuring...

  • Senior Data Engineer

    2 months ago

    Scottsdale, United States Ignitec Inc Full time

    Job DescriptionJob DescriptionWe are seeking a Senior Data Engineer - Direct Hire to become an integral part of our development team! You will design strategies for database systems as well as set standards for operations, programming and security. Design and construct large relational databases and expertise in Relational & Dimensional Data...

  • Senior Manager of Software Engineering, Data Integration

    2 weeks ago

    Scottsdale, United States Onsemi Full time

    Senior Manager of Software Engineering,  Data Integration Location: US (Scottsdale, AZ)   About the Role:   We are seeking a highly skilled and experienced software engineering leader to lead the design and development of our modern enterprise data integration platform. This role will focus on designing and implementing a new data...

  • Senior Manager of Software Engineering, Data Integration

    5 days ago

    Scottsdale, United States Onsemi Full time

    Senior Manager of Software Engineering,  Data Integration Location: US (Scottsdale, AZ)   About the Role:   We are seeking a highly skilled and experienced software engineering leader to lead the design and development of our modern enterprise data integration platform. This role will focus on designing and implementing a new data...

  • Data Engineer

    3 weeks ago

    Scottsdale, United States CBTS Full time

    CBTS is currently seeking a Data Engineer for a position located in Scottsdale, AZ. Responsibilities:Collaborate with fellow data engineering and cross-functional data teams to build and deliver custom enterprise data warehousing and database applications.Accurately estimate tasks, bugs, and spikes in your domain.Develop software that meets code quality...

  • Data Engineer

    5 days ago

    Scottsdale, United States CBTS Full time

    CBTS is currently seeking a Data Engineer for a position located in Scottsdale, AZ. Responsibilities:Collaborate with fellow data engineering and cross-functional data teams to build and deliver custom enterprise data warehousing and database applications.Accurately estimate tasks, bugs, and spikes in your domain.Develop software that meets code quality...

  • Lead Data Engineer

    1 week ago

    Scottsdale, United States E-Solutions Full time

    Role : Lead Data Engineer Location : Scottsdale AZ (100% onsite)Must have skill set: Spark, S3, Glue, AWS Redshift , python and stream set exp 6-8 years of IT experience focusing on enterprise data architecture and management.• Experience in Conceptual/Logical/Physical Data Modelling & expertise in Relational and Dimensional Data Modelling• Experience...

  • Lead Data Engineer

    1 week ago

    Scottsdale, United States E-Solutions Full time

    Role : Lead Data Engineer Location : Scottsdale AZ (100% onsite)Must have skill set: Spark, S3, Glue, AWS Redshift , python and stream set exp 6-8 years of IT experience focusing on enterprise data architecture and management.• Experience in Conceptual/Logical/Physical Data Modelling & expertise in Relational and Dimensional Data Modelling• Experience...

  • Lead Data Engineer

    5 days ago

    Scottsdale, United States E-Solutions Full time

    Role : Lead Data Engineer Location : Scottsdale AZ (100% onsite)Must have skill set: Spark, S3, Glue, AWS Redshift , python and stream set exp 6-8 years of IT experience focusing on enterprise data architecture and management.• Experience in Conceptual/Logical/Physical Data Modelling & expertise in Relational and Dimensional Data Modelling• Experience...

  • Lead Data Engineer

    4 days ago

    Scottsdale, United States E-Solutions Full time

    Role : Lead Data Engineer Location : Scottsdale AZ (100% onsite)Must have skill set: Spark, S3, Glue, AWS Redshift , python and stream set exp 6-8 years of IT experience focusing on enterprise data architecture and management.• Experience in Conceptual/Logical/Physical Data Modelling & expertise in Relational and Dimensional Data Modelling• Experience...

  • Sr. Information Security Engineer

    3 weeks ago

    Scottsdale, United States People, Data & Solutions Full time

    We're seeking a Senior Information Security Engineer with expertise in Application Security, Cloud Security (AWS and Azure), Network Security, and Vulnerability Management. In this role, you'll be responsible for designing, implementing, and managing security solutions across diverse environments. Your duties will include assessing security risks, developing...

  • Principle Data Engineer

    4 weeks ago

    Scottsdale, United States CBTS Full time

    Position Information:Seeking skilled Principal Data Engineers who thrive in a highly collaborative, agile team environment. Engineers design elegant technical solutions for complex product requirements, deliver high quality code as part of a fast-moving agile team, and own the stability and quality of their domain. We would love to hear from talented...

  • Principle Data Engineer

    3 weeks ago

    Scottsdale, United States CBTS Full time

    Position Information:Seeking skilled Principal Data Engineers who thrive in a highly collaborative, agile team environment. Engineers design elegant technical solutions for complex product requirements, deliver high quality code as part of a fast-moving agile team, and own the stability and quality of their domain. We would love to hear from talented...

  • Principal Data Engineer

    4 days ago

    Scottsdale, United States CBTS Full time

    Position Information:Seeking skilled Principal Data Engineers who thrive in a highly collaborative, agile team environment. Engineers design elegant technical solutions for complex product requirements, deliver high quality code as part of a fast-moving agile team, and own the stability and quality of their domain. We would love to hear from talented...

  • Senior system engineer

    2 weeks ago

    Scottsdale, United States GeoLogics Full time

    Role: Senior Advanced System Engineer Client: Defense-Aerospace Salary: $80-85/hr W2, non-benefited Length: Long-term Location: Scottsdale, AZ Must be a United States Citizen to apply. Responsibilities: As a systems engineer, you'll join a cross-functional team tasked with crafting and implementing cutting-edge ground operational systems. We're seeking...