Senior Data Platform Engineer

1 month ago

San Jose, United States Mendel.ai Full time

About Mendel: At Mendel, we are enabling different stakeholders in healthcare to make better decisions by learning from every patient's journey— from a physician deciding on the best treatment for a patient to a pharma company discovering the next blockbuster drug. In creating depth and breadth for a patient’s health record journey, Mendel enables the right care to be delivered at the right time to the right person. This is an incredible opportunity to join a unique vision to improve healthcare using AI technology.


About the Role:

We seek an experienced and highly skilled Senior Data Platform Engineer to join our dynamic team. In this crucial role, you will be responsible for designing, building, and maintaining our organization's data platforms and infrastructure, ensuring efficient and reliable data processing, storage, and analysis capabilities. Your expertise in data engineering will contribute to our organization's data-driven decision-making and overall success.


Responsibilities:

  • Architect and build scalable and performing data platforms by leveraging technologies like Apache Spark, Elastic, Kafka, Kubernetes, and various cloud-based data services.
  • Design and develop data pipelines for ingesting, transforming, and processing large volumes of structured and unstructured data from multiple sources.
  • Collaborate with data engineers, data scientists, and business stakeholders to understand data requirements and translate them into robust and efficient scalable data solutions.
  • Optimize data workflows and processes for performance, reliability, and cost-effectiveness.
  • Implement data governance policies, data quality controls, and data security measures to ensure data integrity and compliance with regulatory requirements.
  • Automate and streamline data operations through scripting, containerization, and orchestration tools.
  • Participate in code reviews, knowledge sharing, and mentoring of junior team members.
  • Stay up-to-date with emerging data technologies, trends, and best practices, and contribute to the continuous improvement of our data platform.


Qualifications:

  • Bachelor's degree in Computer Science, Information Technology, or a related field, or equivalent professional experience.
  • Minimum of 5 years of experience in data engineering or a related role, with a strong focus on building and maintaining data platforms and infrastructure.
  • Proficient in programming languages such as Python, Scala, or Java, and experience with SQL and NoSQL databases.
  • Hands-on experience in distributed computing frameworks like Apache Spark, Ray, and related ecosystem tools.
  • Experience cloud platforms (e.g., AWS, GCP, Azure) and their data services.
  • Experience with containerization technologies like Docker and orchestration tools like Kubernetes.
  • Experience in solving complex problems using both structured and unstructured data.
  • Strong understanding of data modeling, data warehousing, and data integration concepts.
  • Excellent problem-solving, analytical, and troubleshooting skills.
  • Ability to work collaboratively in a team environment and communicate complex technical concepts effectively.


Preferred Skills:

  • Master's degree in a relevant field or equivalent experience.
  • Experience with real-time data processing and streaming technologies (e.g., Apache Kafka, Apache Flink).
  • Experience in data governance, data quality, and data security best practices.
  • Experience in agile software development methodologies and DevOps practices.
  • Experience with machine learning and data science workflows is a plus.


P.S.: This role will require you working out of our San Jose office. Please feel free to apply if you are local or open to relocation.


Why should you join our team:

Benjamin Franklin once said: “If you would not be forgotten as soon as you are dead, either write something worth reading, or do something worth writing.” — at Mendel you can do the latter. There are two things more devastating than learning that you or your loved ones have a terminal illness; getting the wrong treatment or not finding any. At Mendel, we are on a sincere mission to solve many never-solved-before technology challenges that can enable prescribers and drug makers to do their best

  • Senior Data Platform Engineer

    1 month ago

    San Jose, United States Mendel.ai Full time

    About Mendel: At Mendel, we are enabling different stakeholders in healthcare to make better decisions by learning from every patient's journey— from a physician deciding on the best treatment for a patient to a pharma company discovering the next blockbuster drug. In creating depth and breadth for a patient’s health record journey, Mendel enables the...

  • Senior Data Platform Engineer

    3 weeks ago

    San Jose, United States Mendel.ai Full time

    About Mendel: At Mendel, we are enabling different stakeholders in healthcare to make better decisions by learning from every patient's journey— from a physician deciding on the best treatment for a patient to a pharma company discovering the next blockbuster drug. In creating depth and breadth for a patient’s health record journey, Mendel enables the...

  • Platform Data Engineer

    2 weeks ago

    San Jose, United States Bayone Full time

    Location: San Francisco, Seattle, LA or PST Enterprise Data Platform to enable timely, effective and safe sharing of data to multiple engineering, operations and business teams for building world class data products Responsibilities Build data ingestion and processing pipelines to enable data analytics and data science use-cases in areas of digital...

  • Data Platform Engineer

    2 weeks ago

    San Jose, United States Cypress HCM Full time

    Job DescriptionJob DescriptionData Platform EngineerWe have an exciting opportunity for a Data Platform Engineer with the top leading multimedia and creative software company in the world. Responsibilities:Setup and maintain production scale Databricks environment on public cloud such as Microsoft Azure and AWSSetup and maintain production scale data storage...

  • Data Platform Engineer

    2 days ago

    San Jose, United States Cypress Human Capital Management, LLC Full time

    We have an exciting opportunity for a Data Platform Engineer with the top leading multimedia and creative software company in the world. Responsibilities Setup and maintain production scale Databricks environment on public cloud such as Microsoft Azure and AWS Setup and maintain production scale data storage such as ADLS and S3 for multiple tenant teams...

  • Senior Software Engineering, Data Platform

    4 weeks ago

    San Mateo, CA, United States Snowflake Full time

    Build the future of data. Join the Snowflake team. We're hiring talented Senior Engineers for our Container Platform team that are passionate about using software-based approaches to solve complex infrastructure challenges and automate those solutions. You'll be part of the cloud engineering organization where we have a strong focus on using...

  • Senior Software Engineering, Data Platform

    4 weeks ago

    San Mateo, CA, United States Snowflake Full time

    Build the future of data. We're at the forefront of the data revolution, committed to building the world's greatest data and applications platform. Snowflake started with a clear vision: develop a cloud data platform that is effective, affordable, and accessible to all data users. Snowflake developed an innovative new product with a built-for-the-cloud...

  • Data Platform Engineer

    4 days ago

    San Jose, California, United States Ipro Networks Pte. Ltd. Full time

    Job Title:Data Platform EngineerPosition Type:4-month contractLocation:Remote within the USASalary Range: $60-$62/hr. on w2 (This position does not accept C2C)Job Summary:- Setup and maintain Databricks environment on public clouds like Microsoft Azure and AWS- Configure and manage data storage such as ADLS and S3 for multiple tenant teams on the Data...

  • Senior Software Engineer, Data Platform

    4 days ago

    San Francisco, California, United States SoFi Full time

    Employee Applicant Privacy NoticeWho we are: Shape a brighter financial future with us. Together with our members, we're changing the way people think about and interact with personal finance. We're a next-generation financial services company and national bank using innovative, mobile-first technology to help our millions of members reach their goals. The...

  • Senior Software Engineering, Data Platform

    4 weeks ago

    San Mateo, CA, United States Snowflake Computing Full time

    Build the future of data. Join the Snowflake team. There is only one Data Cloud. Snowflake's founders started from scratch and designed a data platform built for the cloud that is effective, affordable, and accessible to all data users. But it didn't stop there. They engineered Snowflake to power the Data Cloud, where thousands of organizations unlock the...

  • Senior Software Engineer AI Platforms.

    2 months ago

    San Jose, United States Cisco Full time

    Who We Are The Cisco Security AI team delivers AI products and platform for all Cisco secure products and portfolios so businesses around the world defend against threats and safeguard the most vital aspects of your business with security resilience. We are passionate about making businesses secure and simplify security with zero compromise using AI...

  • Senior Software Engineer AI Platforms.

    3 weeks ago

    San Jose, United States Cisco Full time

    Who We Are The Cisco Security AI team delivers AI products and platform for all Cisco secure products and portfolios so businesses around the world defend against threats and safeguard the most vital aspects of your business with security resilience. We are passionate about making businesses secure and simplify security with zero compromise using AI...

  • Senior Software Engineering, Data Platform

    4 weeks ago

    San Diego, CA, United States Sony Playstation Full time

    Why PlayStation? PlayStation isn’t just the Best Place to Play — it’s also the Best Place to Work. Today, we’re recognized as a global leader in entertainment producing The PlayStation family of products and services including PlayStation5, PlayStation4, PlayStationVR, PlayStationPlus, acclaimed PlayStation software titles from PlayStation Studios,...

  • Data Platform Engineer

    4 weeks ago

    San Francisco, CA, United States Equilibrium Energy Full time

    About Our Company Equilibrium Energy is a well-funded, Series A clean energy startup backed by some of the most prominent institutional investors in climate. We are building a digital native power company operating at the intersection of grid variability, market volatility, economic optimization, commercial structuring, and risk management, across the...

  • Data Platform Engineer

    2 weeks ago

    San Jose, United States Intelliswift Software Full time

    Job Title: Data Platform Engineer (Remote) Duration: 4 Months Location: Remote Pay Rate: $62.32. Intelliswift Software Inc. conceptualizes, builds, and supports the world's most amazing technology products and solutions. Our team of rich experts from diverse backgrounds contributes to making Intelliswift one of the most reliable partners in IT and Talent...

  • Senior Software Engineer AI Platforms

    5 days ago

    San Jose, California, United States Cisco Full time

    Who We Are The Cisco Security AI team delivers AI products and platform for all Cisco secure products and portfolios so businesses around the world defend against threats and safeguard the most vital aspects of your business with security resilience. We are passionate about making businesses secure and simplify security with zero compromise using AI and...

  • Senior Data Scientist

    4 weeks ago

    San Francisco, CA, United States Data Masked Full time

    Neighbors around the world turn to Nextdoor daily to receive trusted information, give and get help, get things done, and build real-world connections with those nearby — neighbors, businesses, and public services. At Nextdoor, our Growth Marketing team is charged with driving member growth and revenues from businesses advertising on the platform. This...

  • Senior Software Engineer, Data Platform

    2 weeks ago

    San Francisco, United States SoFi Full time

    Employee Applicant Privacy NoticeWho we are: Shape a brighter financial future with us. Together with our members, we're changing the way people think about and interact with personal finance. We're a next-generation financial services company and national bank using innovative, mobile-first technology to help our millions of members reach their goals. The...

  • Hadoop Platform Engineer

    2 months ago

    San Jose, United States RAMPS International Inc. Full time

    Job DescriptionJob DescriptionHadoop Platform EngineerSan Jose, CA4-12 MonthsPosition summaryThe Data and Analytics Platform team resides within Adobe's Information and Data Services team and we are looking for a Hadoop Platform Engineer who will be responsible for the implementation and ongoing administration of Hadoop infrastructure including...

  • Hadoop Platform Engineer

    3 weeks ago

    San Jose, United States RAMPS International Inc. Full time

    Job DescriptionJob DescriptionHadoop Platform EngineerSan Jose, CA4-12 MonthsPosition summaryThe Data and Analytics Platform team resides within Adobe's Information and Data Services team and we are looking for a Hadoop Platform Engineer who will be responsible for the implementation and ongoing administration of Hadoop infrastructure including...