Data Pipeline Engineer Lead

6 days ago


San Antonio, Texas, United States Diverse Lynx Full time
Job Description

We are seeking a highly skilled Data Pipeline Engineer Lead to join our team at Diverse Lynx LLC. The successful candidate will be responsible for developing and deploying high-quality, fault-tolerant data pipelines using Snowflake, DBT, and ETL Informatica.

Key Responsibilities:
  • Design and implement efficient data pipelines to move data between Snowflake data layers
  • Tune and optimize database performance, diagnosing and resolving issues with ELT and push-down techniques
  • Develop and maintain ETL frameworks, continuous data quality frameworks, and automation in data pipelines
  • Ensure service data availability SLOs and participate in triage meetings with Security, Infrastructure, and Workload management teams
  • Maintain compliance with Agile Jira SDLC controls, Service Now Change & Incident management, and Data Ops Gitlab CI/CD pipeline
Requirements:
  • Experience with Snowflake, DBT, and ETL Informatica
  • Proficiency in SQL development and/or NoSQL databases
  • Familiarity with cloud-based data offerings (Amazon AWS, Redshift, Snowflake, Google GCP, Microsoft Azure)
  • Experience with ETL Tools (Informatica, DataStage, Data Build Tool, etc.)
  • Experience in P&C Insurance Domain
What We Offer:
  • A competitive salary of $120,000 - $150,000 per year
  • A dynamic work environment with opportunities for growth and professional development
  • A comprehensive benefits package, including health insurance, retirement plan, and paid time off


  • San Antonio, Texas, United States H-E-B Full time

    About This RoleWe are seeking a highly skilled Data Engineering Expert to join our team at H-E-B Digital Technology. As a key member of our data engineering group, you will be responsible for designing, building, and maintaining large-scale data pipelines that support our business growth.Key ResponsibilitiesData Pipeline Development: Build complex data...


  • San Antonio, Texas, United States Diverse Lynx Full time

    Job Title:Data Engineer Expert">Salary:$120,000 - $180,000 per year">About the Role:We are seeking a highly skilled Data Engineer to join our team at Diverse Lynx LLC. As a Data Engineer, you will be responsible for designing, developing, and deploying high-quality data pipelines using Snowflake and other cloud-based data offerings.The ideal candidate will...


  • San Antonio, Texas, United States Diverse Lynx Full time

    Data Engineer RoleWe are seeking a skilled Data Engineer to join our team at Diverse Lynx LLC. In this role, you will design, develop, and deploy high-quality, fault-tolerant data pipelines using distributed data movement technologies and approaches.Key Responsibilities:Develop and deploy data pipelines using AWS services such as S3, EMR, DynamoDB, Kinesis,...


  • San Antonio, Texas, United States Syntricate Technologies Full time

    Key Responsibilities:As a Snowflake Data Engineer with P&C Insurance Domain expertise, you will be responsible for developing, deploying, and supporting high-quality, fault-tolerant data pipelines leveraging distributed data movement technologies and approaches. Your experience with AWS services such as S3, EMR, DynamoDB, Kinesis, Lambda, Glue, Redshift,...

  • Data Architect

    3 weeks ago


    San Antonio, Texas, United States Diverse Lynx Full time

    About the RoleDiverse Lynx LLC is seeking a highly skilled Data Engineer to join our team. As a key member of our data team, you will be responsible for designing, developing, and deploying high-quality, fault-tolerant data pipelines leveraging distributed data movement technologies and approaches.Key ResponsibilitiesAnalyze, develop, refactor, fix, test,...


  • San Antonio, Texas, United States eTek IT Services, Inc. Full time

    We are seeking a highly skilled Data Science and AI Engineer to join our dynamic team at eTek IT Services, Inc.About the RoleThis is a senior-level position that requires expertise in machine learning, statistical techniques, and analytical prowess to solve complex business challenges.Key ResponsibilitiesEngage in ideation and prototyping of new solutions to...


  • San Antonio, Texas, United States Diverse Lynx Full time

    Job Title: Data Engineer with Snowflake and Tableau ExperienceAbout the Company: Diverse Lynx LLC is an Equal Employment Opportunity employer. We promote and support a diverse workforce across all levels in the company.Location: San Antonio, TX - OnsiteSalary: $100,000 per year, based on industry standards for this role in San Antonio, TX.Job Description: As...


  • San Antonio, Texas, United States Vantage Data Centers Full time

    About Vantage Data CentersVantage Data Centers is a leading provider of hyperscale data center solutions, committed to delivering high-performance infrastructure that powers the world's most innovative companies.We're driven by a passion for innovation and a commitment to sustainability, with a focus on creating dynamic work environments that foster...


  • San Antonio, Texas, United States DEF Definitive Logic Full time

    Job DescriptionWe are seeking a highly skilled Salesforce/ServiceNow Data Engineer to join our team at DEF Definitive Logic. This is a unique opportunity to work with cutting-edge technologies and contribute to the development of innovative solutions.About the RoleThis role will focus on designing, developing, and maintaining complex data pipelines using...


  • San Antonio, Texas, United States Diverse Lynx Full time

    About the RoleDiverse Lynx LLC is seeking an experienced Software Engineering Lead to lead offshore teams and achieve non-functional requirements in API/UI development. The ideal candidate will have expertise in ReactJS, Core Java, and DevOps CICD pipelines.Key ResponsibilitiesLeading offshore teams to achieve a common mission and ensuring timely delivery of...


  • San Antonio, Texas, United States Saxon Global Full time

    About the Role:We are seeking an experienced Software Development Engineer in Test Lead to join our team at Saxon Global.Key Responsibilities:Supporting Workday upgradesMaintaining scripts running against WorkdayDeveloping test automation frameworksBuilding test pipelines using CI/CD toolsTesting tools like qtestRequirements:6+ years of experience as a...


  • San Antonio, Texas, United States EPIC Midstream Full time

    About the JobWe are seeking a highly skilled Pipeline Controller to join our team at EPIC Midstream in San Antonio, TX. As a key member of our operations team, you will play a critical role in ensuring the safe and efficient operation of our pipeline system.Key ResponsibilitiesMonitor and control natural gas and liquid pipelines to ensure optimal performance...


  • San Antonio, Texas, United States Grassroots Carbon Full time

    About the OpportunityWe are seeking an experienced Senior Data Architect to join our team at Grassroots Carbon. As a key member of our data science group, you will play a pivotal role in designing and implementing scalable data architectures, pipelines, and databases that support large-scale quantification of soil carbon removals.As a Senior Data Architect,...


  • San Antonio, Texas, United States Rackspace Full time

    We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team at Rackspace Technology.SalaryThe anticipated starting pay range for this role is $199,300 - $249,100 per year in California, New York City, and Washington, and $191,600 - $239,500 per year in Hawaii and New York (excluding NYC), and $182,100 - $227,600 per year...


  • San Antonio, Texas, United States City of San Antonio Full time

    Job Description: We are seeking a talented Data Engineer to join our team at the City of San Antonio. In this role, you will design and implement data management systems that combine core data sources into data warehouses or other accessible structures.This is a full-time position with an estimated salary of $65,000 - $90,000 per year, based on location and...


  • San Antonio, Texas, United States Diverse Lynx Full time

    We are looking for an experienced Machine Learning Engineer to lead the development and deployment of machine learning models that drive business growth. As a Machine Learning Engineer, you will design, develop, and maintain large-scale machine learning systems and pipelines using various techniques and tools.The ideal candidate will have a strong background...


  • San Antonio, Texas, United States Eateam Full time

    Eateam is a leading provider of innovative AI and machine learning solutions. We are seeking a highly skilled AI/ML Engineer to join our team and contribute to the development of cutting-edge technology.About the RoleThis is a unique opportunity to work with a talented team of engineers and scientists to design, develop, and deploy large-scale AI and machine...


  • San Antonio, Texas, United States NTT DATA Full time

    Job Summary:We are seeking a highly skilled Pharmacy Technician to join our team for a temporary assignment of 4 months or longer.About the Role:The successful candidate will be responsible for screening orders, interpreting and entering prescriptions into the computer system in a timely manner. They will also think through and solve escalated prescription...


  • San Antonio, Texas, United States Rackspace Full time

    About the Role:We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing batch processing systems, with extensive experience in the Apache Hadoop ecosystem (Map Reduce, Oozie, Hive, Pig, HBase, Storm). This role involves working in Java, and working on...


  • San Antonio, Texas, United States E-Z Bel Construction Full time

    E-Z Bel Construction is a leading civil and commercial construction company in Texas, with over 50 years of experience.We specialize in street reconstruction, underground utility installations, concrete work, bridges, and traffic signals. Our mission is to build opportunities through constructing our communities.Job Summary:The Pipeline Installation...