Data Engineering Lead

4 days ago


San Francisco, California, United States Federal Reserve Bank Full time
Job Overview

The Federal Reserve Bank of San Francisco seeks a highly skilled Data Engineering Lead to join our team. As a key member of our data engineering group, you will be responsible for designing and implementing cloud-based data and AI solutions that meet the needs of our business stakeholders. This is an excellent opportunity to work with cutting-edge technologies and make a significant impact on our organization.

About the Role

We are looking for a seasoned professional with expertise in Generative AI, data engineering, AWS AI, and AWS data services. You will be responsible for building next-generation AI & analytics frameworks developed on a group of core technologies. Additionally, you will lead multi-functional teams in designing and implementing cloud-based data and AI solutions. Your technical skills should include proficiency in programming languages such as Python, Java, or similar, experience with data engineering concepts and tools, and understanding of data governance and security principles.

Responsibilities

- Build next-generation AI & analytics framework developed on a group of core technologies.
- Utilize Generative AI techniques to create innovative solutions for business challenges.
- Leverage AWS AI services like Amazon Bedrock, SageMaker, Comprehend, Rekognition, Transcribe to accelerate AI development and deployment.
- Lead multi-functional teams in designing and implementing cloud-based data and AI solutions.
- Ensure data pipelines are scalable, secure, and repeatable.
- Collaborate with stakeholders to understand business requirements and turn data into insights.

Qualifications

- Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Machine Learning, or equivalent work experience.
- Proven experience in Generative AI, data engineering, AWS AI, and AWS data services.
- Proficiency in programming languages such as Python, Java, or similar.
- Experience with data engineering concepts and tools.
- Understanding of data governance and security principles.

Benefits

This position offers a competitive salary range of $138,900 - $221,900 per year, depending on experience. Additionally, we offer a comprehensive benefits package including medical, dental, vision, pre-tax flexible spending account, backup childcare program, pre-tax daycare flexible spending account, paid family care leave, vacation days, sick days, paid holidays, pet insurance, matching 401(k), and retirement/pension.

  • San Francisco, California, United States People Data Labs Full time

    Role OverviewWe are seeking an exceptional Software Engineering Lead to join our team at People Data Labs. This role is a fantastic opportunity to drive our self-serve product offerings, grow new revenue, and develop innovative data products.


  • San Francisco, California, United States WEX Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our dynamic team at WEX. The ideal candidate will have extensive experience in designing and implementing cloud-based data solutions, with a strong focus on scalability, performance, and data governance.The Data Engineering Lead will be responsible for leading the design and...


  • San Francisco, California, United States Advanced Engineering Group LLC Full time

    Company Overview: Advanced Engineering Group LLC is a leading technology firm that seeks highly motivated and enthusiastic engineers to join our product development team. Our technology stack primarily includes Java/Javascript, and while experience with these languages is beneficial, it's not essential.Job Description: We're looking for an exceptional Data...


  • San Francisco, California, United States Windfall Data, Inc. Full time

    Windfall Data, Inc. is seeking a seasoned data professional to play a pivotal role in developing and scaling our foundational predictive models.This is a highly impactful position where you will influence the core of our data product offerings and collaborate with cross-functional teams to maintain the highest standards of model performance.We're on a...

  • Data Engineer Lead

    4 days ago


    San Francisco, California, United States Tekfortune Inc Full time

    Job Summary: Tekfortune Inc is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations. We are looking for an experienced GCP Data Engineer to fill this 12+ month contract position. The successful candidate will provide technical leadership and contribute to the definition,...


  • San Francisco, California, United States DoorDash USA Full time

    **About DoorDash USA**We are a technology company at heart, using data to fuel our mission of connecting people with the food they love. Our Data Engineering team plays a critical role in this mission, building scalable database solutions for various use cases.About the Role:We are seeking a highly experienced Staff Software Engineer, Data to join our Data...


  • San Francisco, California, United States Perplexity AI Full time

    Perplexity AI OverviewAt Perplexity AI, we are revolutionizing the way people search and interact with the internet. Our conversational answer engine has amassed 10 million monthly active users as of early 2024, with our mobile apps installed over 1 million times across iOS and Android devices.We have raised significant funding from some of the most...


  • San Francisco, California, United States Peregrine Technologies Full time

    About Peregrine TechnologiesPeregrine Technologies is a leading provider of innovative software solutions for public safety agencies across the United States. With a strong foundation in technology and a passion for making a difference, we empower our customers to improve operations and make better decisions in the moments that matter.We are a team of public...


  • San Francisco, California, United States Amplitude Full time

    Amplitude is a leading digital analytics platform that helps companies drive business growth through data-driven decision making. Our platform empowers teams to capture reliable data, uncover valuable insights about customer behavior, and take swift action.We're seeking an experienced Data Engineering Lead to join our Query team. As a key member of this...


  • San Francisco, California, United States WEX, Inc. Full time

    About WEX, Inc.We are a leading provider of B2B payment processing and business solutions. Our data team is responsible for building big data technologies, platforms, systems, and tools that enable our customers and internal teams to unlock business value.Job DescriptionThe Senior Software Engineer position is available in our Data team at WEX, Inc. As a key...


  • San Francisco, California, United States Pendulum Full time

    Pioneering a Health RevolutionPendulum is at the forefront of a global movement to improve physical and mental health through advanced microbiome research and innovative probiotic solutions.The company's cutting-edge probiotic pipelines and discovery platform have disrupted the consumer probiotics market, offering therapeutic products that bridge the gap...

  • Data Engineer Lead

    2 days ago


    San Francisco, California, United States Amicus Full time

    Amicus is working with a cutting-edge start-up in business intelligence, seeking an experienced Senior Data Engineer to bolster their growing engineering team.This role involves building and maintaining ETL pipelines using Python, Apache Airflow, and GCP. The ideal candidate will have 3-5 years of experience as a data engineer and be located in the San...


  • San Francisco, California, United States Braintrust Data Full time

    About Braintrust DataWe are a cutting-edge developer platform for building world-class AI products. Our innovative approach combines code and datasets, incrementally refining both using frequent evaluations. We provide a rich set of tools to visualize changes and interrogate failures, empowering developers to integrate our platform into their continuous...


  • San Francisco, California, United States USM Business Systems Full time

    Job Title: Senior Data Engineer + Big Data/HadoopJob Summary:The Data Architect and Engineer will be an integral member of the team within Data Services. This is a highly technical and hands-on role with responsibility to lead design, implement and support data architecture deliverables for multiple data integration, data management, data warehousing,...


  • San Francisco, California, United States HireIO Inc Full time

    About the Role">We are seeking a highly motivated and experienced Software Development Lead to lead our Data Engineering team at HireIO Inc.Key Responsibilities">">Lead a team of Software Engineers to design and develop large-scale data systems">Collaborate with cross-functional teams to ensure successful project delivery">Mentor junior engineers and promote...


  • San Francisco, California, United States Hive Full time

    About HiveHive is a cutting-edge technology company seeking an experienced Data Science Engineering Lead to join our team. Our ideal candidate will have a strong background in building web applications and expertise in machine learning frameworks, scripting languages such as Python and/or shell scripts.


  • San Francisco, California, United States VAST Data Full time

    About VAST DataVAST Data is a pioneering company in the field of data management, revolutionizing the way enterprises capture, catalog, refine, enrich, and protect massive datasets. As a leader in enterprise software infrastructure, we empower real-time data analysis and AI training and inference.We are driven by innovation, customer-centricity, and a...


  • San Jose, California, United States TEPHRA Full time

    Data Engineering Lead: We are searching for an experienced Data Engineering Lead to oversee the development and implementation of our big data platform. The successful candidate will have a strong background in big data engineering and leadership.About the Role:- Lead a team of big data engineers and developers in designing, developing, and deploying...


  • San Francisco, California, United States salesforce, inc. Full time

    As a Lead Data Analytics Engineer at Salesforce, Inc., you will have the opportunity to work on cutting-edge AI-powered tools and solutions that enhance developer productivity.The ideal candidate will have a strong foundation in machine learning, deep learning, and software engineering. You will work on state-of-the-art AI models, optimize infrastructure for...


  • San Francisco, California, United States Refuel AI Full time

    Job DescriptionWe're looking for an experienced Enterprise Data Engineer Lead to join our team at Refuel AI. In this role, you will be responsible for leading the development of Refuel's platform and backend services, driving innovation and growth within the company.Key Responsibilities:Lead the technical execution of high-priority post-sales engagements and...