Data Pipeline Specialist

3 days ago


San Francisco, California, United States UnitedHealth Group Full time
About the Job\

This role involves working with distributed systems, designing and implementing data pipelines, and optimizing data delivery. The successful candidate will have 3+ years of experience in applied ML/AI engineering, 3+ years of experience in designing and managing distributed systems, and 3+ years of experience using Python or similar programming languages.

\Key Responsibilities\
  • \
  • Design and implement data pipelines to transform data from various sources.\
  • Assemble complex data sets that meet business requirements.\
  • Optimize data delivery and redesign infrastructure for greater scalability.\
  • Build analytics tools that provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.\\/ul>\Benefits\
    • \
    • A comprehensive benefits package, including medical, dental, and vision insurance.\
    • Flexible work arrangements, including remote work options.\
    • Professional development opportunities, including training and mentorship programs.\\/ul>\Requirements\
      • \
      • Bachelor's degree in Computer Science or related field.\
      • 3+ years of experience in applied ML/AI engineering.\
      • 3+ years of experience in designing and managing distributed systems.\
      • 3+ years of experience using Python or similar programming languages.\
      • Experience with CI/CD practices.\
      • Experience with AWS technologies (Lambda, EMR, EC2, SQS, and RDS).\
      • Proven experience with databases.\
      • Familiarity with shell scripting using Bash or Zsh.\\/ul>\Salary Range\

The estimated salary range for this role is $88,000 to $173,200 annually, based on local labor markets, education, work experience, certifications, and other factors.



  • San Francisco, California, United States Hinge Health Full time

    **Job Description**We are seeking an experienced Senior Data Pipeline Specialist to join our team at Hinge Health. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining complex data pipelines to support our business growth.In this role, you will work closely with our data scientists, product managers,...


  • San Francisco, California, United States ZipRecruiter Full time

    At ZipRecruiter, we're seeking a highly skilled Data Pipeline Architect to join our team. As a key member of our data engineering team, you'll be responsible for designing and implementing scalable data pipelines that support robust data architectures and facilitate seamless data flow.The ideal candidate will have experience with cloud data platforms such as...


  • San Francisco, California, United States Airtable Full time

    Job OverviewThe successful candidate will design and own mission-critical data pipelines to enable decision-making. They'll partner with company leaders to create scalable data solutions and launch innovative alerting and visualization tools. With a focus on collaboration, they'll work between our engineering organization and stakeholders from data science,...


  • San Francisco, California, United States CyberTec Full time

    OverviewCyberTec is seeking a highly experienced Senior Data Pipeline Architect to design and develop business-critical data pipelines using Kafka, DynamoDB, OpenSearch, and related AWS technologies.Job SummaryWe are looking for an exceptional professional with more than 7 years of experience in owning the design and development activities of complex data...

  • DevOps Engineer

    3 weeks ago


    San Jose, California, United States Diverse Lynx Full time

    Job Title: DevOps Engineer - Data Pipeline SpecialistSalary: $120,000 - $180,000 per year.About Diverse Lynx LLCDiverse Lynx LLC is an Equal Employment Opportunity employer. We promote and support a diverse workforce across all levels in the company.Job Description:We are seeking a skilled DevOps Engineer to join our team. The successful candidate will be...


  • San Francisco, California, United States EvenUp Inc. Full time

    About EvenUpEvenUp Inc. is revolutionizing the personal injury cases landscape with cutting-edge machine learning and AI-driven solutions. As a leading player in the industry, we empower top trial attorneys and largest personal injury firms to maximize case outcomes and reduce manual effort. Our proprietary AI model, PiaiTM, combines human legal expertise...


  • San Diego, California, United States Millennium Health Full time

    Position OverviewMillennium Health LLC is a leading healthcare organization, delivering cutting-edge medication monitoring and drug testing services. Our team of experts works closely with healthcare professionals to provide objective information about patients' recent use of prescription medications and/or illicit drugs. We seek a highly skilled Data...


  • San Francisco, California, United States Trunk Full time

    We're on a mission to empower software organizations to deliver high-quality projects quickly. Our unique approach enables engineering teams to stay focused on designing and implementing software, leading to the creation of magical projects and happier teams.Our team is growing rapidly, with our founders leveraging their experience from some of the world's...


  • San Francisco, California, United States Spire Full time

    Spire Global, a leading space-to-cloud analytics company, is seeking an experienced Principal Software Engineer to lead the development of its data pipelines.The Role:This is a critical position that requires expertise in designing, implementing, and maintaining robust and scalable data pipelines using Apache Flink and Java. As a key member of the US...


  • San Francisco, California, United States Fintool Full time

    Job DescriptionWe're seeking a highly skilled Financial Data Engineer to join our team in San Francisco. As a key member of our engineering team, you'll be responsible for building real-time data pipelines to process millions of financial documents, leveraging Spark/Databricks and Python to drive business growth. Your expertise in ML-based parsing and...


  • San Francisco, California, United States WEX Full time

    Key ResponsibilitiesCollaborate with partners and stakeholders to understand customer business needs and key challenges.Design, test, code, and implement data products, systems, platforms, and pipelines of small to medium complexity.Use data effectively to measure, inspect, and drive informed decisions.The successful candidate will have strong...


  • San Francisco, California, United States United Software Group Full time

    Job Description: Data Engineering SpecialistUnited Software Group is seeking a highly experienced Data Engineering Specialist to join our team in San Francisco, CA. As a key member of our engineering team, you will be responsible for designing and implementing data pipelines and architectures that support our AI solutions.Estimated Salary: $120,000 -...


  • San Francisco, California, United States Abridge Al, Inc Full time

    Job DescriptionDesign and build large-scale data infrastructure to drive business decisions and machine learning research.Build and maintain scalable data services, pipelines, and storage solutions for unstructured application data.


  • San Francisco, California, United States Aditi Consulting LLC Full time

    About Aditi Consulting LLCAditi Consulting LLC is a leading provider of consulting services, focusing on data engineering and analytics. Our team of experts helps clients build and manage complex data pipelines.


  • San Francisco, California, United States ZipRecruiter Full time

    ZipRecruiter is seeking a highly skilled Cloud Infrastructure Data Specialist to join our team. As a Cloud Infrastructure Data Specialist, you will play a critical role in designing and implementing cloud-based data infrastructures that meet the evolving needs of our organization. With a strong background in cloud data engineering and experience with data...


  • San Francisco, California, United States CyberTec Full time

    Job Summary:CyberTec is seeking an experienced Cloud Data Engineering Specialist to join our team. In this role, you will be responsible for designing and developing cloud-based data pipelines using Kafka, DynamoDB, and related AWS technologies.The ideal candidate will have more than 7 years of experience in owning the design and development activities of...


  • San Francisco, California, United States ZipRecruiter Full time

    Job Overview: As a Lead Machine Learning Infrastructure Engineer, you will play a pivotal role in leading our machine learning infrastructure initiatives and driving the design, development, and optimization of our infrastructure solutions. You will lead a team of skilled engineers, collaborating closely with cross-functional teams to deliver high-quality,...


  • San Francisco, California, United States Cruise Full time

    Cruise is looking for an expert Cloud Data Platform Specialist to join our data engineering team. As a key member of this team, you will be responsible for designing and implementing data management systems on Google Cloud Platform (GCP). This is a unique opportunity to work on innovative projects and collaborate with cross-functional teams to drive business...


  • San Francisco, California, United States Unreal Gigs Full time

    We're seeking a highly skilled Data Architect Specialist to join our team at Unreal Gigs. In this role, you'll play a key part in designing and implementing scalable data pipelines that handle high-volume, high-velocity data.The ideal candidate will have extensive experience with big data technologies such as Apache Spark, Hadoop, Kafka, and Hive. They'll be...


  • San Francisco, California, United States Rippling Full time

    Innovate with us at Rippling, a pioneering force in HR and IT solutions for businesses. As a Data Platform Specialist, you will spearhead the development of high-performance systems that empower our clients.Your expertise in designing and implementing data pipelines, architecting data storage solutions, and collaborating with cross-functional teams will be...