Senior Data Engineer

2 days ago


Palo Alto, California, United States Machinify Full time
Job Title: Staff/Lead Data Engineer

Machinify is a leading provider of AI-powered software products that transform healthcare claims and payment operations. Our revolutionary AI-platform enables us to develop and deploy industry-specific products that increase the speed and accuracy of claims processing by orders of magnitude.

Job Summary

We are seeking a Staff/Lead Data Engineer to build and own critical data pipelines. The ideal candidate will have a deep understanding of data engineering principles and experience in designing and implementing scalable data pipelines.

Key Responsibilities
  • Independently understand business problems and weigh pros and cons of different approaches to suggest ones likely to succeed
  • Work with cross-functional teams to deliver a scalable framework
  • Map customer data into Machinify's canonical form and identify non-canonical fields
  • Proactively design and adapt the canonical form to suit changing query patterns and needs
  • Own data availability and quality for the Data Science organization
Requirements
  • Deep experience as a hands-on Data Engineer building production data pipelines
  • Experience managing complex data delivery
  • Experience in ETL orchestration and workflow management tools with a strong preference for Apache Airflow
  • Experience in Spark or other distributed computing frameworks
  • SQL and Python
  • Advanced SQL performance tuning
  • Kubernetes and building Docker images
  • AWS & GCP
  • Experience working with APIs to collect or ingest data
  • Manage SLA for all pipelines in allocated areas of ownership
  • Streaming technologies like Kafka, Spark Streaming, etc.
  • ELK stack, Grafana, etc.
What We Offer

Machinify offers a competitive salary range of $220k-$270k, meaningful equity, excellent healthcare, flexible time off, and other benefits and perks. We are an equal employment opportunity employer and welcome candidates from diverse backgrounds.



  • Palo Alto, California, United States Tech Tammina Full time

    Job Summary:As a Senior Simulation and Data Modeling Quality Engineer at Tech Tammina, you will lead the testing of our core meso-scale agent-based simulation environment. This environment is used to develop and demonstrate algorithms to control and optimize goods delivery. You will work with product and engineering teams to understand new features and...

  • Senior Data Engineer

    24 hours ago


    Palo Alto, California, United States Tesla Full time

    Job DescriptionTesla is seeking a highly skilled Sr. Software Engineer, Data Platform to join our team of experts building the company's data platforms powered by all Tesla products.As a key member of our engineering team, you will be responsible for designing, developing, and maintaining scalable distributed systems that process terabytes of IoT data...


  • Palo Alto, California, United States Machinify Full time

    Job OverviewMachinify is a leading provider of AI-powered software products that transform healthcare claims and payment operations. Our revolutionary AI-platform enables us to develop and deploy industry-specific products that increase the speed and accuracy of claims processing by orders of magnitude.We are seeking a Data Scientist, a proven AI...


  • Palo Alto, California, United States Celonis Full time

    About the RoleCelonis is seeking a highly skilled Senior Product Data Scientist to join our Product Analytics & Data Sciences team. As a key member of our team, you will play a crucial role in developing and communicating data-informed insights that will help with strategic and tactical decision-making in a hyper-growth environment.Key ResponsibilitiesBuild...

  • Senior Data Analyst

    24 hours ago


    Palo Alto, California, United States Rivian Full time

    About RivianRivian is a pioneering company that's revolutionizing the automotive industry with its innovative electric adventure vehicles. We're on a mission to keep the world adventurous forever, and we're seeking a talented Senior Software Analyst to join our Self-Driving Data Team.Job SummaryWe're looking for a detail-oriented, data-driven problem solver...


  • Palo Alto, California, United States Amazon Full time

    About the RoleWe are seeking a highly skilled Senior Software Development Engineer II to join our Supply and Identity Data platform team. As a key member of this team, you will be responsible for designing, developing, and operating petabyte-scale data systems to support Amazon's advertising business.The ideal candidate will have a strong background in...


  • Palo Alto, California, United States Celonis Full time

    About the RoleWe're seeking a highly skilled Senior Product Data Scientist to join our Product Analytics & Data Sciences team at Celonis. As a key member of our Engineering organization, you will play a critical role in developing and communicating data-informed insights that drive strategic and tactical decision-making in a hyper-growth environment.Key...

  • Data Engineer

    3 weeks ago


    Palo Alto, California, United States Machinify Full time

    Job Title: Sr./Staff Data EngineerMachinify is a leading provider of AI-powered software products that transform healthcare claims and payment operations. The company's revolutionary AI-platform has enabled the development and deployment of industry-specific products that increase the speed and accuracy of claims processing by orders of magnitude.We are...


  • Palo Alto, California, United States Merico Full time

    Job OverviewMerico is seeking a highly skilled Senior Software Engineer to join our open-source project DevLake. As a key member of our team, you will design and build advanced data integration and transformation infrastructure, drive adoption of best practices in modern data stack, and support and grow the open-source community around DevLake.Key...


  • Palo Alto, California, United States Harnham Full time

    About the RoleWe are seeking a highly skilled Senior Data Platform Engineer to lead the design and development of our platform, ensuring it scales effectively and remains secure.Key ResponsibilitiesDesign and architect the platform, focusing on reliability, scalability, and security.Develop tools to verify the accuracy of AI-generated insights against...


  • Palo Alto, California, United States Lawton Senior Living Full time

    Senior iOS EngineerWe're seeking a seasoned iOS engineer to join our Growth Team who possesses a passion for pushing Apple technologies to the limits. You will work with our team of talented engineers and designers to plan and build a new generation of our iOS application to redefine how businesses use payments and expenses.What You'll Do:Re-imagine how...


  • Palo Alto, California, United States Mondo Full time

    Job Overview:Mondo is seeking a skilled Senior Android Engineer to develop a core business Android application that integrates with IoT devices, displaying real-time data to users. As an individual contributor, you will be responsible for building and maintaining Android applications using Kotlin and MVVM architecture, while occasionally collaborating with a...

  • Senior Cloud Engineer

    4 weeks ago


    Palo Alto, California, United States Tencent Full time

    Job Title: Senior Site Reliability EngineerTencent is a world-leading internet and technology company that develops innovative products and services to improve the quality of life of people around the world.About TencentFounded in 1998 with its headquarters in Shenzhen China, our guiding principle is to use technology for good. We are not only a major video...


  • Palo Alto, California, United States Knitit Full time

    Job Title: Senior Software EngineerWe are seeking a highly skilled Senior Software Engineer to join our team at Knitit. As a key member of our engineering team, you will play a crucial role in developing and maintaining our server-side logic.Key Responsibilities:Develop and maintain server-side logic using Python, FastAPI, Pydantic, and SQLAlchemy.Utilize...


  • Palo Alto, California, United States Tencent Full time

    Job DescriptionTencent is a world-leading internet and technology company that develops innovative products and services to improve the quality of life of people around the world.We are not only a major video game publisher in the world, we also produce other high-quality digital content, enriching interactive entertainment experiences for people around the...


  • Palo Alto, California, United States Knitit Full time

    Job Title: Senior Backend EngineerWe are seeking a highly skilled Senior Backend Engineer to join our team at Knitit. As a key member of our engineering team, you will play a crucial role in developing and maintaining the server-side logic for our services.Key Responsibilities:Develop and maintain server-side logic using Python, and related frameworks such...


  • Palo Alto, California, United States Tesla Full time

    Job Title: Senior Product Engineer - SuperchargerWe are seeking a highly skilled Senior Product Engineer to join our Tesla Energy team. As a key member of our Supercharger network team, you will be responsible for designing, developing, and deploying cutting-edge electric vehicle charging solutions.Responsibilities:Drive cross-functional efforts to implement...


  • Palo Alto, California, United States Guardant Health Full time

    Job Title: Senior HPC Infrastructure EngineerGuardant Health is a leading precision oncology company focused on helping conquer cancer globally through the use of its proprietary tests, vast data sets, and advanced analytics. We are seeking a highly skilled Senior HPC Infrastructure Engineer to join our team and help us build and operate the computational...


  • Palo Alto, California, United States Amazon Full time

    About the RoleWe are seeking a highly skilled Senior Performance Engineer to join our Redshift Performance Engineering team at Amazon. As a key member of our team, you will be responsible for identifying and optimizing performance bottlenecks in our cloud-based data warehouse platform.Key ResponsibilitiesDiagnose and resolve performance issues in our data...


  • Palo Alto, California, United States Machinify, Inc. Full time

    Machinify, Inc. is revolutionizing the healthcare industry with its AI-powered software products. We're seeking a highly skilled Data Engineering Lead to join our team and drive the development of critical data pipelines.The ideal candidate will have a deep understanding of data engineering principles and experience building production-ready data pipelines....