Senior Data Engineer

4 weeks ago


Scottsdale, United States RiverPoint Full time
Job DescriptionJob DescriptionInfomatics is hiring a Senior Data Engineer on a direct hire/FTE basis to lead design, development and implementation efforts on our client’s Enterprise Analytics platform which includes an MPP Enterprise Data Warehouse, cloud-based Data Lake and other Big Data technologies. Essential Duties and Responsibilities:
  • Guides the the strategic capabilities and architecture design related to Data Warehousing, Big Data and Data analytics in close collaboration with Technical Leadership.
  • Architects and develops code for large-scale ETL pipelines with data processing frameworks supporting distributed data warehouse and distributed analytic systems running in the cloud.
  • Leads side-by-side design sessions with our business experts and engineers to understand our product and business to design, socialize, and implement proper conceptual, logical and physical data models.
  • Spearheads efforts with multiple, disparate, data providers, as well as downstream consumers, to engineer efficient, tracable, and fault tolerant, batch and streaming, data pipelines to that support complex analytical analysis and enterprise-wide Business Intelligence applications
  • In collaoration with our Data Science team, lead efforts to develop and implement production grade code/pipelines, in laguages including Python, leveraging advanced statistical routines, Machine Learning and other AI technologies.
  • Responsible for oversight and improvements on approaches to monitor and support data quality automation efforts. Working along side QA Engineering, implement quality check routines as part of data processing frameworks and validates flow of information.
  • Drives engineering efforts for Data Warehouse and Big Data infrastructure needs, including but not limited to, automation of system builds, security requirements, performance requirements and logging/monitoring in collaboration with DevOps engineers
  • Resolves escalated issues related to complex data anomolies and performance. In addition, implements adjustments, conducts after action reviews to determine root cause/corrective measures, and ensures knowledge transfer to operations support team.
  • Provides mentorship and guidance to help guide and grow the technical depth of junior Data Engineers and across the BI & Analytics team.
  • Ensures documentation is complete and up to date with regard to standards, best practices and technical specifications.
  • Leads design and code review sessions and provides feedback and mentorship to peers.
  • Educates the BI & Analytics team on the latest industry technologies, trends and strategies; Provides thought leadership around approaches, patterns and best practices in the Data Engineering domain.
  • Assists employees, vendors or other customers by answering questions related to Data Warehousing and Big Data processes, procedures and services
  • Collaborate with data team, product owners, Scrum-master to refine and estimate stories/epics to deliver on commitments on time and with high quality while providing exceptional customer service
  • Provides Tier 3 support and create run books to mentor Tier 1 and Tier 2 support staff
  • Other duties as assigned
Background & Experience Required:
  • This position requires a minimum of 10 years of progressive database development and integration experience.
  • Demonstrated experience in designing and implementing large-scale logical and physical data model with expert knowledge of Kimball methodologies.
  • Demonstrated advanced/expert level experience in multiple relational (RDMS) and non-relational (NoSQL) data platforms is required.
  • Demonstrated advanced experience in SQL tuning, indexing, distribution, partitioning, data access patterns and scaling strategies is required.
  • Demonstrated advanced scripting knowledge with Jupyter/Python or R is required.
  • Demonstrated expert experience with data integrations and data processing for business intelligence and analytics workloads is required.
  • Experience in software versioning tools including git, SVN or related.
  • Advanced experience with AWS S3 or other distributed object stores, MPP Data Warehousing, (e.g. AWS Redshift), Elastic MapReduce is needed.
  • Experience implementing statistical models, ML and other AI technologies into production data is required.
  • Experience developing container
  • Demonstrated experience implamenting Big Data pipelines including Spark, Hive, Sqoop or related technologies.
  • Experience implementing streaming data pipelines to support realtime and near realtime decision making.
  • Understanding of Software Development Life Cycle (SDLC) methodologies such as Agile and Waterfall is needed.
  • Proven track record of designing data platforms leveraging large complex data sets.
Educational Requirements:This position requires a Bachelors Degree in Computer Science, Computer Information Systems or related or equivalent experience.Data or cloud related certifications are a plus.

  • Scottsdale, Arizona, United States Cardone Ventures Full time

    POSITION SUMMARY The Senior Data Engineer will play a vital role in designing, developing, and maintaining the data pipelines and infrastructure that ingests, transforms, and stores massive datasets from various sources to support our evolving business needs. You'll be at the forefront of implementing a cutting-edge lake house architecture, ensuring...


  • Scottsdale, Arizona, United States Nextiva Full time

    It's about more than the right fit. We're looking for the right connection.At Nextiva, it's our team members that make Nextiva a great place to work. Nexties are smart, driven, and the best in class at what they do. We're changing the game in the software industry with the first of its kind, conversation-centric work hub that unifies team collaboration,...

  • Senior Data Engineer

    2 months ago


    Scottsdale, United States Cardone Ventures Full time

    POSITION SUMMARYThe Senior Data Engineer will play a vital role in designing, developing, and maintaining the data pipelines and infrastructure that ingests, transforms, and stores massive datasets from various sources to support our evolving business needs. You'll be at the forefront of implementing a cutting-edge lake house architecture, ensuring efficient...

  • Senior Data Engineer

    3 weeks ago


    Scottsdale, United States Cardone Ventures Full time

    POSITION SUMMARY The Senior Data Engineer will play a vital role in designing, developing, and maintaining the data pipelines and infrastructure that ingests, transforms, and stores massive datasets from various sources to support our evolving business needs. You'll be at the forefront of implementing a cutting-edge lake house architecture, ensuring...

  • Senior Data Engineer

    2 months ago


    Scottsdale, United States Cardone Ventures Full time

    POSITION SUMMARYThe Senior Data Engineer will play a vital role in designing, developing, and maintaining the data pipelines and infrastructure that ingests, transforms, and stores massive datasets from various sources to support our evolving business needs. You'll be at the forefront of implementing a cutting-edge lake house architecture, ensuring efficient...


  • Scottsdale, United States Onsemi Full time

    Senior Manager of Software Engineering,  Data Integration Location: US (Scottsdale, AZ)   About the Role:   We are seeking a highly skilled and experienced software engineering leader to lead the design and development of our modern enterprise data integration platform. This role will focus on designing and implementing a new data...


  • Scottsdale, United States Onsemi Full time

    Senior Manager of Software Engineering,  Data Integration Location: US (Scottsdale, AZ)   About the Role:   We are seeking a highly skilled and experienced software engineering leader to lead the design and development of our modern enterprise data integration platform. This role will focus on designing and implementing a new data...

  • Data Engineer

    1 month ago


    Scottsdale, United States CBTS Full time

    CBTS is currently seeking a Data Engineer for a position located in Scottsdale, AZ. Responsibilities:Collaborate with fellow data engineering and cross-functional data teams to build and deliver custom enterprise data warehousing and database applications.Accurately estimate tasks, bugs, and spikes in your domain.Develop software that meets code quality...

  • Data Engineer

    3 weeks ago


    Scottsdale, United States CBTS Full time

    CBTS is currently seeking a Data Engineer for a position located in Scottsdale, AZ. Responsibilities:Collaborate with fellow data engineering and cross-functional data teams to build and deliver custom enterprise data warehousing and database applications.Accurately estimate tasks, bugs, and spikes in your domain.Develop software that meets code quality...

  • Data Engineer

    2 weeks ago


    Scottsdale, United States Stepstone Full time

    Company Description Appcast is the global leader in programmatic recruitment advertising technology and services. With advanced technology, unmatched market data and a team of the industry’s best recruitment marketers, Appcast’s technology and services manage job advertising annually for enterprise clients across industries. Headquartered in Lebanon,...

  • Lead Data Engineer

    3 weeks ago


    Scottsdale, United States E-Solutions Full time

    Role : Lead Data Engineer Location : Scottsdale AZ (100% onsite)Must have skill set: Spark, S3, Glue, AWS Redshift , python and stream set exp 6-8 years of IT experience focusing on enterprise data architecture and management.• Experience in Conceptual/Logical/Physical Data Modelling & expertise in Relational and Dimensional Data Modelling• Experience...

  • Lead Data Engineer

    4 weeks ago


    Scottsdale, United States E-Solutions Full time

    Role : Lead Data Engineer Location : Scottsdale AZ (100% onsite)Must have skill set: Spark, S3, Glue, AWS Redshift , python and stream set exp 6-8 years of IT experience focusing on enterprise data architecture and management.• Experience in Conceptual/Logical/Physical Data Modelling & expertise in Relational and Dimensional Data Modelling• Experience...

  • Lead Data Engineer

    3 weeks ago


    Scottsdale, United States E-Solutions Full time

    Role : Lead Data Engineer Location : Scottsdale AZ (100% onsite)Must have skill set: Spark, S3, Glue, AWS Redshift , python and stream set exp 6-8 years of IT experience focusing on enterprise data architecture and management.• Experience in Conceptual/Logical/Physical Data Modelling & expertise in Relational and Dimensional Data Modelling• Experience...

  • Lead Data Engineer

    4 weeks ago


    Scottsdale, United States E-Solutions Full time

    Role : Lead Data Engineer Location : Scottsdale AZ (100% onsite)Must have skill set: Spark, S3, Glue, AWS Redshift , python and stream set exp 6-8 years of IT experience focusing on enterprise data architecture and management.• Experience in Conceptual/Logical/Physical Data Modelling & expertise in Relational and Dimensional Data Modelling• Experience...

  • Data Engineer

    2 weeks ago


    Scottsdale, United States Collabera Full time

    Description Home Search Jobs Job Description Data Engineer Contract: Scottsdale, Arizona, US Salary: $50.00 Per Hour Job Code: 350344 End Date: 2024-07-05 Days Left: 23 days, 3 hours left Apply We are looking for Sr Data Engineer with one of our direct client. Location:-Scottsdale, AZ Duration:-10 monthsAbout the Role: We are looking for a Sr. Data...


  • Scottsdale, United States CBTS Full time

    Position Information:Seeking skilled Principal Data Engineers who thrive in a highly collaborative, agile team environment. Engineers design elegant technical solutions for complex product requirements, deliver high quality code as part of a fast-moving agile team, and own the stability and quality of their domain. We would love to hear from talented...


  • Scottsdale, United States CBTS Full time

    Position Information:Seeking skilled Principal Data Engineers who thrive in a highly collaborative, agile team environment. Engineers design elegant technical solutions for complex product requirements, deliver high quality code as part of a fast-moving agile team, and own the stability and quality of their domain. We would love to hear from talented...

  • Data Engineer

    6 days ago


    Scottsdale, United States Persistent Systems Full time

    About PersistentWe are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many...


  • Scottsdale, United States PayPal Full time

    What you need to know about the role- As a Senior Staff Software Engineer, you will act as a subject matter expert. We are looking for technologists with the highest levels of technical talent, programming, and communication skills with a keen desire to deeply understand our product and how to make our systems stronger and more resilient. Meet our...


  • Scottsdale, United States PayPal Full time

    What you need to know about the role- As a Senior Staff Software Engineer, you will act as a subject matter expert. We are looking for technologists with the highest levels of technical talent, programming, and communication skills with a keen desire to deeply understand our product and how to make our systems stronger and more resilient. Meet our...