Data Engineering Lead
3 weeks ago
We offer a competitive salary of $120,000 - $150,000 per year, depending on experience. This role is based in the US, and we offer a hybrid work model that allows you to work from home and commute to our office when needed.
Key responsibilities include:
- Designing and implementing high-performance, scalable data solutions using Trino SQL/Spark SQL
- Collaborating with cross-functional teams to understand data requirements and implement robust data solutions
- Working closely with data domain experts to gather data requirements, translate business needs into technical specifications, and communicate data insights effectively
- Optimizing data storage for performance and scalability, ensuring efficient data Extraction, Transformation and Load (ETL)
- Developing and maintaining documentation related to data pipelines, QA, metrics, and data policy as it relates to best practice, compliance and GDPR
Requirements include:
- 2+ years in using SQL and experience optimizing SQL databases for performance (Trino SQL, or Spark)
- Demonstrated experience in managing data pipelines (like HDFS), data repository (like GitHub), workflows (like Apache Airflow), and ETL (best practice coding)
- Ability to communicate complex technical concepts to both technical and non-technical individuals
- Experience working with multiple stakeholders, setting project priorities and delivering on Objectives and Key Results (OKRs)
The ideal candidate will have a strong background in data engineering, excellent analytical skills, and experience working with large-scale data systems. If you are passionate about building high-quality data solutions and collaborating with cross-functional teams, please apply for this exciting opportunity.
-
Data Engineering Lead
3 weeks ago
San Francisco, California, United States WEX Full timeAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our dynamic team at WEX. The ideal candidate will have extensive experience in designing and implementing cloud-based data solutions, with a strong focus on scalability, performance, and data governance.The Data Engineering Lead will be responsible for leading the design and...
-
Data Engineering Lead
3 weeks ago
San Francisco, California, United States Federal Reserve Bank Full timeJob OverviewThe Federal Reserve Bank of San Francisco seeks a highly skilled Data Engineering Lead to join our team. As a key member of our data engineering group, you will be responsible for designing and implementing cloud-based data and AI solutions that meet the needs of our business stakeholders. This is an excellent opportunity to work with...
-
Software Engineering Lead
1 month ago
San Francisco, California, United States People Data Labs Full timeRole OverviewWe are seeking an exceptional Software Engineering Lead to join our team at People Data Labs. This role is a fantastic opportunity to drive our self-serve product offerings, grow new revenue, and develop innovative data products.
-
Data Engineer Lead
3 weeks ago
San Francisco, California, United States Tekfortune Inc Full timeJob Summary: Tekfortune Inc is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations. We are looking for an experienced GCP Data Engineer to fill this 12+ month contract position. The successful candidate will provide technical leadership and contribute to the definition,...
-
Technical Lead
3 weeks ago
San Francisco, California, United States Discord Full timeJob DescriptionWe are seeking a highly skilled Technical Lead - Data Engineering to join our team and help us build and maintain the data infrastructure that powers our platform. As a Technical Lead, you will be responsible for overseeing the development and implementation of data solutions that meet the needs of our business.You will work closely with our...
-
Enterprise Data Engineering Lead
3 weeks ago
San Francisco, California, United States Tekfortune Inc Full time**Job Title:** Enterprise Data Engineering Lead**Job Summary:**Tekfortune Inc is seeking an experienced enterprise data engineering lead to join our team. As a key contributor, you will design and implement PI systems, components, and interfaces, and lead our data engineering efforts to drive business growth.We offer a competitive salary package starting at...
-
Data Engineering Team Lead
2 weeks ago
San Francisco, California, United States DoorDash USA Full timeAbout the CompanyDoorDash is a leading food delivery and logistics company that relies heavily on data to drive its success. The company's Data Engineering team plays a critical role in building scalable and reliable database solutions to support various use cases.About the RoleWe are seeking an experienced Staff Software Engineer, Data to lead our data...
-
Data Engineer Architect Lead
1 month ago
San Francisco, California, United States DoorDash USA Full time**About DoorDash USA**We are a technology company at heart, using data to fuel our mission of connecting people with the food they love. Our Data Engineering team plays a critical role in this mission, building scalable database solutions for various use cases.About the Role:We are seeking a highly experienced Staff Software Engineer, Data to join our Data...
-
Data Engineering Lead
2 weeks ago
San Francisco, California, United States Eppo, Inc Full timeAbout Eppo, Inc.We are a pioneering company in the experimentation space, empowering businesses to make data-driven decisions. Our cutting-edge platform combines the modern data stack with high-velocity experimentation, enabling customers to unlock new insights and drive growth.Job OverviewThis role is perfect for a seasoned software engineer who is...
-
Data Engineering Lead
3 weeks ago
San Francisco, California, United States WEX Full timeAbout the Role">We are seeking a highly skilled Senior Data Engineer to join our dynamic team at WEX. As a key member of our organization, you will play a critical role in designing and implementing industry-leading data solutions that meet the needs of our business. The ideal candidate will have extensive experience working with AWS services, Snowflake, and...
-
Machine Learning Data Engineering Lead
2 weeks ago
San Francisco, California, United States Unity Technologies Full timeWe are seeking an experienced Machine Learning Data Engineering Lead to drive our data strategy and develop optimized data pipelines for machine learning models.Job OverviewUnity Technologies is the world's leading platform of tools for creators to build and grow real-time games, apps, and experiences across multiple platforms. As a Machine Learning Data...
-
Data Engineering Team Lead
2 weeks ago
San Francisco, California, United States Perplexity AI Full timePerplexity AI is seeking a seasoned technical director to oversee the growth and scalability of our data engineering team. The ideal candidate will lead the design, creation, and deployment of systems that power product experiences across a growing tech stack.The exponential increase in data at Perplexity AI necessitates the investment in a robust data...
-
Data Engineering Lead
3 weeks ago
San Francisco, California, United States OpenAI Full timeAbout the CompanyAt OpenAI, we're dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products.The roleWe're looking for a seasoned Data Engineer to help drive our product analytics and growth. The ideal...
-
Data Engineer Lead
3 weeks ago
San Francisco, California, United States Unity Technologies Full timeJob DescriptionThis is an exciting opportunity to work with our global and cross-functional teams to create meaningful data products and drive technical solutions. As a Senior Data Engineer, you will be responsible for designing and developing data pipelines and services to enable data-driven insights and power BI, ML, experimentation, and user-facing...
-
Data Movement Engineering Lead
3 weeks ago
San Francisco, California, United States Airbyte Full timeShape the Future of Data Movement with AirbyteAs a Data Movement Engineering Lead, you'll pioneer the creation of new patterns, tools, and frameworks for building database and data warehouse connectors. Your expertise will drive performance improvements in warehouse connectors, ensuring seamless data integration for our users.We're committed to transparency,...
-
Data Engineering Lead
2 weeks ago
San Francisco, California, United States YO HR CONSULTANCY Full timeWe are seeking a highly skilled Sr Data Engineer to join our team in Glendale, CA. The ideal candidate will have 7+ years of experience in data engineering and proficiency in at least one major programming language (e.g. Python, Java, Scala).The successful candidate will work with technologies such as Airflow, Spark, Databricks, and Snowflake, and contribute...
-
Cloud-Based Data Engineering Lead
3 weeks ago
San Francisco, California, United States WEX Full timeJob SummaryWe are seeking a Cloud-Based Data Engineering Lead to join our team at WEX. As a key member of our Data Engineering organization, you will be responsible for designing, developing, and implementing scalable data architectures and systems.Your primary focus will be on leading the technical architecture and development of our unified, scalable data...
-
Software Development Lead
3 weeks ago
San Francisco, California, United States HireIO Inc Full timeAbout the Role">We are seeking a highly motivated and experienced Software Development Lead to lead our Data Engineering team at HireIO Inc.Key Responsibilities">">Lead a team of Software Engineers to design and develop large-scale data systems">Collaborate with cross-functional teams to ensure successful project delivery">Mentor junior engineers and promote...
-
Data Engineering Lead
3 weeks ago
San Francisco, California, United States Pendulum Full timePioneering a Health RevolutionPendulum is at the forefront of a global movement to improve physical and mental health through advanced microbiome research and innovative probiotic solutions.The company's cutting-edge probiotic pipelines and discovery platform have disrupted the consumer probiotics market, offering therapeutic products that bridge the gap...
-
Data Engineer Lead
3 weeks ago
San Francisco, California, United States Amicus Full timeAmicus is working with a cutting-edge start-up in business intelligence, seeking an experienced Senior Data Engineer to bolster their growing engineering team.This role involves building and maintaining ETL pipelines using Python, Apache Airflow, and GCP. The ideal candidate will have 3-5 years of experience as a data engineer and be located in the San...