Senior Data Engineer

19 hours ago

Palo Alto, CA, United States Athena Full time
About Athena

At Athena, we empower possibility through transformative delegation. True leaders reflect on what they want and map the path to get there. We clear the way by pairing exceptional Executive Assistants with our driven clients and ensuring both receive ongoing support throughout the journey. The result is 10x more leverage, more time, and a greater impact on our clients' work and lives.

We are on a mission to build the best delegation platform in the world. We believe that the Human+AI combination will provide a superior experience to delegate complex tasks by combining the strengths of highly trained assistants leveraging highly trained AI.

Role Overview

The Senior Data Engineer will be a key contributor to Athena's data infrastructure and machine learning initiatives. This role requires deep expertise in building and managing robust data pipelines, data lakes, and real-time streaming services that can handle the scale and complexity of Athena's growing data needs. The Senior Engineer will be responsible for maintaining and optimizing Kafka clusters, managing data schemas, and ensuring efficient data ingestion and processing to support analytics and machine learning applications.

Responsibilities
  • Data Infrastructure Development: Design, build, and maintain scalable and reliable data infrastructure to support the company's data needs.
  • ML Infrastructure: Collaborate with the machine learning team to create and manage infrastructure that supports ML model training and deployment.
  • Pipeline Management: Develop and manage end-to-end data pipelines, from data ingestion to processing and storage.
  • Data Lake Architecture: Design and implement data lake solutions to store and organize with data scientists, product managers, and engineers to ensure data infrastructure aligns with company objectives and supports data-driven decision-making.
Qualifications
  • Experience: 7+ years of experience in data engineering or a related field, with a proven track record in managing large-scale data infrastructure.
  • Technical Expertise: Strong knowledge of data infrastructure technologies, including Kafka, data lakes, data warehousing, ETL processes, and cloud services (AWS, GCP, Azure).
  • Programming Skills: Proficient in programming languages such as Python, Java, or Scala and scripting languages for data processing.
  • Data Processing: Experience with data processing frameworks like Apache Spark, Flink, or Beam.
  • Database Management: Familiarity with database technologies, both SQL and NoSQL, and their application in large-scale environments.
  • ML Infrastructure: Understanding of machine learning infrastructure requirements and best practices.
  • System Design: Strong system design and architecture skills, with an ability to build for scalability, reliability, and performance.
  • Problem-Solving: Excellent problem-solving abilities with a focus on delivering scalable and efficient data solutions.
  • Communication: Clear communicator with the ability to explain complex technical concepts to non-technical stakeholders.
  • Education: Bachelor's or master's degree in Computer Science, Engineering, or a related technical field, or equivalent experience.

  • Senior Staff Data Engineer, Data Platform

    8 hours ago

    Palo Alto, CA, United States Grindr Full time

    This is a hybrid role based in Chicago or our Bay Area (San Francisco or Palo Alto) offices and will require you to be in office Tuesdays and Thursdays. Whats so interesting about this role? The big data space is growing rapidly at Grindr and were looking to build an exceptional data engineering team with chops in cutting edge real-time streaming...

  • Senior Data Engineer

    18 hours ago

    Palo Alto, CA, United States Mentor Talent Acquisition Full time

    Take the reins of data at a rapidly growing healthtech company poised to impact millions. As a pioneering Data Engineer, you will have the opportunity to establish the entire data platform from the ground up, setting architecture and selecting the tools that best suit our needs. This role is a fantastic opportunity to build a data infrastructure without the...

  • Senior Data Engineer

    3 days ago

    Palo Alto, CA, United States Mentor Talent Acquisition Full time

    Take the reins of data at a rapidly growing healthtech company poised to impact millions. As a pioneering Data Engineer, you will have the opportunity to establish the entire data platform from the ground up, setting architecture and selecting the tools that best suit our needs. This role is a fantastic opportunity to build a data infrastructure without the...

  • Senior Data Engineering Lead

    7 days ago

    Palo Alto, CA, United States Mentor Talent Acquisition Full time

    Join a transformative healthtech company poised to make a significant impact on millions of lives by leading the development of its data platform from the ground up. As the first Data Engineer, you will have complete ownership over the architecture, tooling, and data infrastructure, ensuring a seamless foundation for innovation. In this greenfield project,...

  • Senior Data Engineering Lead

    1 day ago

    Palo Alto, CA, United States Mentor Talent Acquisition Full time

    Join a transformative healthtech company poised to make a significant impact on millions of lives by leading the development of its data platform from the ground up. As the first Data Engineer, you will have complete ownership over the architecture, tooling, and data infrastructure, ensuring a seamless foundation for innovation. In this greenfield project,...

  • Senior Data Engineering Lead

    5 days ago

    Palo Alto, CA, United States Mentor Talent Acquisition Full time

    Join a transformative healthtech company poised to make a significant impact on millions of lives by leading the development of its data platform from the ground up. As the first Data Engineer, you will have complete ownership over the architecture, tooling, and data infrastructure, ensuring a seamless foundation for innovation. In this greenfield project,...

  • Senior Software Engineer

    2 weeks ago

    Palo Alto, CA, United States Woven by Toyota Full time

    Senior Software Engineer - Data Search Woven by Toyota is enabling Toyota's once-in-a-century transformation into a mobility company. Inspired by a legacy of innovating for the benefit of others, our mission is to challenge the current state of mobility through human-centric innovationexpanding what "mobility" means and how it serves society. Our work...

  • Principal Data Engineer

    1 day ago

    Palo Alto, CA, United States Wilson Sonsini Goodrich and Rosati Full time

    Wilson Sonsini is the premier legal advisor to technology, life sciences, and other growth enterprises worldwide. We represent companies at every stage of development, from entrepreneurial start-ups to multibillion-dollar global corporations, as well as the venture firms, private equity firms, and investment banks that finance and advise them. The firm has...

  • Principal Data Engineer

    5 days ago

    Palo Alto, CA, United States Wilson Sonsini Goodrich and Rosati Full time

    Wilson Sonsini is the premier legal advisor to technology, life sciences, and other growth enterprises worldwide. We represent companies at every stage of development, from entrepreneurial start-ups to multibillion-dollar global corporations, as well as the venture firms, private equity firms, and investment banks that finance and advise them. The firm has...

  • Senior Software Engineer

    6 days ago

    Palo Alto, CA, United States BioTalent Full time

    Business Manager, AI/ML recruitment at BioTalent part of the IN Group Introduction Join a pioneering HealthTech organisation developing the worlds first safety-focused AI platform designed to revolutionise healthcare accessibility and outcomes. This is an exciting opportunity to contribute to a mission?led team of engineers, clinicians, and AI researchers...