Senior Data Engineer

5 days ago

Scottsdale, United States ZipRecruiter Full time

Job DescriptionJob DescriptionInfomatics is hiring a Senior Data Engineer on a direct hire/FTE basis to lead design, development and implementation efforts on our client’s Enterprise Analytics platform which includes an MPP Enterprise Data Warehouse, cloud-based Data Lake and other Big Data technologies. Essential Duties and Responsibilities:

  • Guides the the strategic capabilities and architecture design related to Data Warehousing, Big Data and Data analytics in close collaboration with Technical Leadership.
  • Architects and develops code for large-scale ETL pipelines with data processing frameworks supporting distributed data warehouse and distributed analytic systems running in the cloud.
  • Leads side-by-side design sessions with our business experts and engineers to understand our product and business to design, socialize, and implement proper conceptual, logical and physical data models.
  • Spearheads efforts with multiple, disparate, data providers, as well as downstream consumers, to engineer efficient, tracable, and fault tolerant, batch and streaming, data pipelines to that support complex analytical analysis and enterprise-wide Business Intelligence applications
  • In collaoration with our Data Science team, lead efforts to develop and implement production grade code/pipelines, in laguages including Python, leveraging advanced statistical routines, Machine Learning and other AI technologies.
  • Responsible for oversight and improvements on approaches to monitor and support data quality automation efforts. Working along side QA Engineering, implement quality check routines as part of data processing frameworks and validates flow of information.
  • Drives engineering efforts for Data Warehouse and Big Data infrastructure needs, including but not limited to, automation of system builds, security requirements, performance requirements and logging/monitoring in collaboration with DevOps engineers
  • Resolves escalated issues related to complex data anomolies and performance. In addition, implements adjustments, conducts after action reviews to determine root cause/corrective measures, and ensures knowledge transfer to operations support team.
  • Provides mentorship and guidance to help guide and grow the technical depth of junior Data Engineers and across the BI & Analytics team.
  • Ensures documentation is complete and up to date with regard to standards, best practices and technical specifications.
  • Leads design and code review sessions and provides feedback and mentorship to peers.
  • Educates the BI & Analytics team on the latest industry technologies, trends and strategies; Provides thought leadership around approaches, patterns and best practices in the Data Engineering domain.
  • Assists employees, vendors or other customers by answering questions related to Data Warehousing and Big Data processes, procedures and services
  • Collaborate with data team, product owners, Scrum-master to refine and estimate stories/epics to deliver on commitments on time and with high quality while providing exceptional customer service
  • Provides Tier 3 support and create run books to mentor Tier 1 and Tier 2 support staff
  • Other duties as assigned

Background & Experience Required:

  • This position requires a minimum of 10 years of progressive database development and integration experience.
  • Demonstrated experience in designing and implementing large-scale logical and physical data model with expert knowledge of Kimball methodologies.
  • Demonstrated advanced/expert level experience in multiple relational (RDMS) and non-relational (NoSQL) data platforms is required.
  • Demonstrated advanced experience in SQL tuning, indexing, distribution, partitioning, data access patterns and scaling strategies is required.
  • Demonstrated advanced scripting knowledge with Jupyter/Python or R is required.
  • Demonstrated expert experience with data integrations and data processing for business intelligence and analytics workloads is required.
  • Experience in software versioning tools including git, SVN or related.
  • Advanced experience with AWS S3 or other distributed object stores, MPP Data Warehousing, (e.g. AWS Redshift), Elastic MapReduce is needed.
  • Experience implementing statistical models, ML and other AI technologies into production data is required.
  • Experience developing container
  • Demonstrated experience implamenting Big Data pipelines including Spark, Hive, Sqoop or related technologies.
  • Experience implementing streaming data pipelines to support realtime and near realtime decision making.
  • Understanding of Software Development Life Cycle (SDLC) methodologies such as Agile and Waterfall is needed.
  • Proven track record of designing data platforms leveraging large complex data sets.

Educational Requirements:This position requires a Bachelors Degree in Computer Science, Computer Information Systems or related or equivalent experience.Data or cloud related certifications are a plus.

  • Senior Software Engineer, Data

    1 month ago

    Scottsdale, United States SKYTOUCH Solutions Full time

    Software Engineer, Senior (Data) Who are we looking for? SkyTouch Technology is an early innovator of cloud-based, mobile-enabled property management system (PMS) solutions for the hospitality industry. Over the last 10+ years, our PMS software, SkyTouch Hotel OS®, has been successfully implemented in over 6,500 properties worldwide. With our proven track...

  • Senior Software Engineer, Data

    1 week ago

    Scottsdale, United States Choice Hotels Full time

    Software Engineer, Senior (Data) Who are we looking for? SkyTouch Technology is an early innovator of cloud-based, mobile-enabled property management system (PMS) solutions for the hospitality industry. Over the last 10+ years, our PMS software, SkyTouch Hotel OS®, has been successfully implemented in over 6,500 properties worldwide. With our proven track...

  • Senior Software Engineer, Data

    3 weeks ago

    Scottsdale, United States SKYTOUCH Solutions Full time

    Software Engineer, Senior (Data) Who are we looking for? SkyTouch Technology is an early innovator of cloud-based, mobile-enabled property management system (PMS) solutions for the hospitality industry. Over the last 10+ years, our PMS software, SkyTouch Hotel OS®, has been successfully implemented in over 6,500 properties worldwide. With our proven track...

  • Senior Data Engineering Specialist

    3 weeks ago

    Scottsdale, Arizona, United States Goli Tech Full time

    Job OverviewGoli Tech is a leading technology company that seeks a highly skilled Senior Data Engineering Specialist to join our team.

  • Senior Software Engineer, Data

    1 month ago

    Scottsdale, United States Choice Hotels Full time

    Software Engineer, Senior (Data) Who are we looking for? SkyTouch Technology is an early innovator of cloud-based, mobile-enabled property management system (PMS) solutions for the hospitality industry. Over the last 10+ years, our PMS software, SkyTouch Hotel OS®, has been successfully implemented in over 6,500 properties worldwide. With our proven track...

  • Data Engineering Lead

    3 weeks ago

    Scottsdale, Arizona, United States RiverPoint Full time

    Job TitleSenior Data Engineer - Job SummaryAbout the RoleRiverPoint is seeking an experienced Data Engineering Lead to spearhead the design, development, and implementation of our Enterprise Analytics platform. This key position will be responsible for leading large-scale ETL pipelines, data processing frameworks, and distributed data warehouses running in...

  • Senior Software Engineer

    3 weeks ago

    Scottsdale, United States PayPal Holdings, Inc. Full time

    As part of the Issuance and Tokenization engineering organization, the Senior Software Engineer will be part of a team delivering high impact products for various segments. The focus area will be across various types of product issuing, lifecycle man Software Engineer, Engineer, Software, Senior, Monitoring, Data Architect, Technology

  • GCP Big Data Engineer

    2 weeks ago

    Scottsdale, United States Futran Tech Solutions Pvt. Ltd. Full time

    Role : GCP Big Data Engineer Type : Contract Scottsdale,Arizona- DaY 1 onsite Requirements JOB SPECIFICATIONS Education Bachelors Degree in Computer Science Information Technology Engineering or related field Experience Skills Qualifications 6 years of experience in Data Engineering with an emphasis on Data Warehousing and Data Analytics 4 years of...

  • GCP Data Engineer

    3 weeks ago

    Scottsdale, United States MSR Technology Group Full time

    Role: GCP Data EngineerExp: 12+Location: Scottsdale, ArizonaDescription:A solid experience and understanding of considerations for largescale solutioning and operationalization of data warehouses data lakes and analytics platforms on GCP is a mustMonitors the Data Lake constantly and ensures that the appropriate support teams are engaged at the right...

  • gcp data engineer

    2 weeks ago

    Scottsdale, United States Randstad Full time

    gcp data engineer. scottsdale , arizona posted november 26, 2024 job details summary $45 - $50 per hour contract bachelor degree category computer and mathematical occupations reference1073393 job details job summary: Experience Skills Qualifications 6 years of experience in Data Engineering with an emphasis on Data Warehousing and Data...

  • gcp data engineer

    3 weeks ago

    Scottsdale, United States Randstad Full time

    gcp data engineer. scottsdale , arizona posted 6 days ago job details summary $45 - $50 per hour contract bachelor degree category computer and mathematical occupations reference1073393 job details job summary: Experience Skills Qualifications 6 years of experience in Data Engineering with an emphasis on Data Warehousing and Data...

  • GCP Data Engineer | Scottsdale, Arizona

    3 weeks ago

    Scottsdale, United States TriOptus LLC Full time

    Experience Skills Qualifications 6 years of experience in Data Engineering with an emphasis on Data Warehousing and Data Analytics Very strong hands on Python expertise Strong Data and GCP Vertex AI knowledge 6 years of experience with one of the leading public clouds 6 years of experience in design and build of salable data pipelines that deal with...

  • Senior Cloud Data Engineer

    3 weeks ago

    Scottsdale, Arizona, United States LTIMindtree Full time

    Company OverviewAbout Us:LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700 clients, LTIMindtree brings extensive domain and...

  • Data Engineering Expert

    3 weeks ago

    Scottsdale, Arizona, United States ESB Technologies Full time

    Job OverviewWe are seeking an experienced Data Engineer to join our team at ESB Technologies. As a key member of our data engineering team, you will design, build, and maintain scalable data pipelines and systems to support data ingestion, transformation, and storage.The ideal candidate will have a strong background in data engineering, experience with...

  • Senior .NET Software Engineer

    4 days ago

    Scottsdale, Arizona, United States Encora Full time

    About the JobWe are seeking an experienced Senior .NET Software Engineer to join our team at Encora. As a Senior .NET Software Engineer, you will be responsible for designing, developing, and maintaining Microsoft-based software and web applications tailored to organizational needs using the .NET framework and various programming languages.Key...

  • Data Engineer

    18 hours ago

    Scottsdale, United States Persistent Systems Full time

    About PersistentWe are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many...

  • Data Engineering and Testing Lead

    4 days ago

    Scottsdale, Arizona, United States InterSources Full time

    Job Title: Data Engineering and Testing LeadWe are seeking a highly skilled Data Engineering and Testing Lead to join our team at InterSources Inc. As a key member of our Digital Transformation team, you will be responsible for designing, developing, and implementing big data engineering solutions using Java, Spark Scala, and other relevant...

  • Senior Advanced Systems Engineer

    3 weeks ago

    Scottsdale, United States APR Consulting Full time

    Senior Advanced Systems Engineer Location: Scottsdale, Arizona Type: Contract Job #78900 Our DOD/Aerospace client is looking to fill an Senior Advanced Systems Engineer position that just opened in Scottsdale, AZ. In this role you'll be a member of a cross functional team responsible for developing and deploying the state-of-the-art ground...

  • Senior Software Engineer

    5 months ago

    Scottsdale, United States HEAT Software Full time

    HEAT Software and LANDESK are now Ivanti!  With more than 1,600 employees in 23 countries and over 22,000 broadly diversified customers across all industries.  From patch and asset management to IT service delivery and security, our software is everything an organization needs to take their IT operations to the next level.”  Ivanti provides integrated...

  • Senior Data Strategist

    4 days ago

    Scottsdale, Arizona, United States Blockchain Technologies Corp. Full time

    Job Summary:We are looking for a highly skilled Senior Director of Data Science to join our team. The ideal candidate will have extensive experience in advanced analytics, machine learning, and AI.About the Role:The successful candidate will be responsible for developing and implementing data-driven solutions to drive business growth and improve...