Sr Cloud Data engineer

5 days ago


Los Angeles, California, United States Federal Reserve System Full time

Company

Federal Reserve Bank of San FranciscoWe are the Federal Reserve Bank of San Francisco—public servants with a mission to advance the nation's monetary, financial, and payment systems to build a stronger economy for all Americans. We are a community-engaged bank, and are committed to understanding and serving the vibrant, expansive communities of the Twelfth District. We respect people for what they do and for who they are. We build opportunities to learn and grow. We empower our people to balance their life and work responsibilities. That's why we offer a flexible hybrid work model that allows you to collaborate with office colleagues on some days, and work from home on others.

The Federal Reserve Bank of San Francisco is looking for a Lead Cloud Data Engineer to join the Data and Analytics Service (DAS) Team. We are a team based out of San Francisco that partners with business lines across the Federal Reserve System to deliver the cloud + big data solutions and advanced analytics products.

The successful candidate will design, implement, and manage cloud-based data and AI solutions, ensuring scalable, secure, and repeatable data pipelines. The ideal candidate will have a strong background in data engineering, cloud infrastructure, scripting languages, and excellent analytical and communication skills.

Essential Responsibilities:

Builds next-generation AI & analytics framework developed on a group of core technologies.

Lead multi-functional teams in designing and implementing cloud-based data and AI solutions.

Ensure data pipelines are scalable, secure, and repeatable.

Collaborate with stakeholders to understand business requirements and turn data into insights.

Develop and maintain cloud infrastructure, including data lakes, warehouses, and analytics platforms.

Implement data governance and security best practices.

Acts as a role model, thought leader, and change management for new software and technology throughout the company.

Works on multiple projects as a technical team member driving business requirements end to end

Takes end to end accountability of all data products and solutions.

Leads training bootcamps, & cross training workshops for internal & stakeholders.

Participates in pilots, Proof of Concepts and research on future data technologies and industry trends.


Qualifications:

Bachelor's degree in computer science, Information Systems, or other related technical field or equivalent work

Must be a U.S. Citizen or a Green Card holder with the intent to become a U.S. Citizen

Individuals who need immigration sponsorship now or in the future are not eligible for this position.

Typically requires 7 or more years of experience in data engineering, data science, and software engineering.

Advanced knowledge of Amazon Web Services (AWS) and cloud infrastructure

Strong programming skills in Java or Python, or Scala

Design, build, and maintain machine learning data pipelines.

Experience in developing an end-to-end AWS native platform for building Data lakes (S3, Glue (Crawlers, ETL, Catalog), IAM, CodePipeline, CodeCommit, CloudFormation/Terraform, CloudTrail, CloudWatch, AWS Config, Guard Duty, Secrets Manager, KMS, EC2, Data Visualization Tool: Tableau run on an EC2 or AWS Quicksight), Athena, AWS AI (Bedrock, SageMaker, Q)

Experience in Ansible/Terraform/Cloud Formation scripts and Infrastructure as Code scripting is required.

Experience in Continuous Integration, Continuous Delivery, and Continuous Deployment software tools to support, enhance and grow our CI and CD capabilities.

Experience in Databricks, Alteryx, Collibra etc.,


Desired Skills:

Background in data security, governance and cybersecurity solutions.

Domain experience in HR, Information Security, Finance, Business as IT

Experience with and/or working knowledge the Financial Industry, Government Agencies, Federal Reserve Bank Lines of Business (LoBs) Applications

Experienced in implementing AI, Data and Advanced Analytics solutions, and SaaS or related experience in the Cloud.

Hands on experience in Generative AI implementation and optimization (HuggingFace, GPT, NLP, LLM)

Full Time / Part Time

Full time

Regular / Temporary

Regular

Job Exempt (Yes / No)

Yes

Job Category

Analytical

Work Shift

First (United States of America)

Always verify and apply to jobs on Federal Reserve System Careers () or through verified Federal Reserve Bank social media channels.


  • Cloud Data Architect

    17 hours ago


    Los Angeles, California, United States Entertainment Data Oracle (EDO) Full time

    About UsEDO is headquartered in Los Angeles and New York City. We also have an office space in San Francisco. We recognize the benefits of hybrid working and want to create the best balance to ensure we can continue working together effectively.The RoleThis role involves production experience building complex data pipelines, working knowledge of data...


  • Los Angeles, California, United States Entertainment Data Oracle (EDO) Full time

    About the Job\Our ideal candidate has production experience building complex data pipelines and is a self-driven individual who eagerly takes ownership of projects in a startup environment.\Good working knowledge of data warehousing platforms, cloud computing, and ETL/data pipeline technologies is required.\A minimum of 4 years of software engineering...


  • Los Angeles, California, United States Entertainment Data Oracle (EDO) Full time

    What We Are Looking ForTo be successful in this role, you will need production experience building complex data pipelines, self-driven individual who eagerly takes ownership of projects in a startup environment, good working knowledge of data warehousing platforms (such as Snowflake, Redshift, etc), cloud computing (such as AWS), and ETL/data pipeline...


  • Los Angeles, California, United States Motion Recruitment Partners, LLC Full time

    About the JobWe are looking for an experienced Cloud Data Engineer Lead to drive our company's data capabilities forward. In this role, you will lead the design and implementation of cloud data platforms and associated technologies.Key Responsibilities:Manage and optimize cloud-based data platforms and data warehouses.Take ownership of critical data...


  • Los Angeles, California, United States Heluna Health Full time

    About the Role:We are seeking an experienced Data Engineer to join our team and lead the development of our data engineering capabilities. As a key member of our team, you will be responsible for designing and implementing scalable data architectures, leading the integration of diverse data sources, and collaborating with cross-functional teams to deliver...


  • Los Angeles, California, United States Blue Shield of California Full time

    Your Role The Developer and Employee Experience team is responsible for creation of the standard and automation pipelines that enable our partnering IT teams to build, release, and manage their systems. We are setting the path for how we'll migrate to the Cloud and ensure that we are guiding the movement to a more modern DevOps operating model. The Sr....

  • Data Engineer

    2 days ago


    Los Angeles, California, United States Entertainment Data Oracle (EDO) Full time

    Who We AreEDO is the TV outcomes company - a leading platform measuring Convergent TV advertising. Combining real-time engagement signals with world-class decision science, EDO maximizes creative and media performance for modern marketers at leading brands, TV networks, entertainment studios, and ad agencies. EDO's investment-grade data align advertising...


  • Los Angeles, California, United States Entertainment Data Oracle (EDO) Full time

    About Us: Entertainment Data Oracle (EDO) is a leading platform measuring Convergent TV advertising. We combine real-time engagement signals with world-class decision science to maximize creative and media performance for modern marketers.The Role: As a Data Engineering Manager at EDO, you will join a team of talented Data Engineers working closely with Data...

  • Data Engineer

    2 weeks ago


    Los Angeles, California, United States Centerfield Corporation Full time

    Hi, We're Centerfield. Supercharged customer acquisition. Centerfield delivers outcome-based digital marketing solutions and personalized omnichannel experiences for the world's leading brands. Powered by our proprietary Dugout platform, Centerfield acquires customers at scale for leading residential service, insurance, e-commerce, and B2B brands....

  • Cloud Data Architect

    8 hours ago


    Los Angeles, California, United States Slalom Consulting Full time

    About UsSlalom is a purpose-led, global business and technology consulting company. We deeply understand our customers—and their customers—to deliver practical, end-to-end solutions that drive meaningful impact.We blend design, engineering, and analytics expertise to build the future. Our technologists are surrounded by interesting challenges, innovative...


  • Los Angeles, California, United States Motion Recruitment Partners, LLC Full time

    The Cloud Data Architect will play a critical role in developing and managing cloud-based data infrastructure on Azure Cloud. This individual will be responsible for designing and implementing scalable data architectures that drive business growth through actionable insights.About the Team:The data science team is a dynamic and collaborative group of...


  • Los Angeles, California, United States Entertainment Data Oracle (EDO) Full time

    Who We AreEDO is the TV outcomes company - a leading platform measuring Convergent TV advertising. Combining real-time engagement signals with world-class decision science, EDO maximizes creative and media performance for modern marketers at leading brands, TV networks, entertainment studios, and ad agencies. EDO's investment-grade data align advertising...


  • Los Angeles, California, United States AXS Group Full time

    Job DescriptionWe're looking for a skilled Sr. Data Engineer to join our global data engineering team. As a key member of our team, you'll be responsible for designing, implementing, and maintaining high-quality, scalable batch and real-time data pipelines integrated with our products. Your expertise will enable us to provide game-changing solutions for our...

  • Senior Cloud Engineer

    18 hours ago


    Los Angeles, California, United States Viant Full time

    **About the Role**We are seeking a highly skilled Sr. Cloud Engineer to join our Platform team at Viant Technology Inc.Job Description:Design, develop, maintain, and troubleshoot software features with an eye on cost, scalability, performance, and fault-tolerance.Collaborate with Product, Engineering, and Technical operations teams on the entire lifecycle...


  • Los Angeles, California, United States SysMind Tech Full time

    About SysMind TechSysMind Tech is a pioneering company that harnesses the power of data to drive business success. We are seeking an experienced Cloud Data Engineering Lead to join our team in Los Angeles, CA.Job Description:Design and implement scalable data systems and pipelinesEvaluate business needs and objectives to inform data-driven decisionsAnalyze...


  • Los Angeles, California, United States Tekfortune Inc Full time

    Sr. Network Data Engineer Location: Los Angeles, CA Onsite Job Description: Exp- 10+ Experience is must in Network Environment. Certified in Networking CCNA, CCNP (A MUST) Experience in Cisco, Aruba wireless, Palo Alto Primary skills in Networking, Routing & Switching. rista Experience- Experience with Multicas t, VRF, BGP-EVPN, VXLAN and Spine &...


  • Los Angeles, California, United States AXS Group Full time

    AXS connects fans with the artists and teams they love. Each year we sell millions of tickets to thousands of incredible events - from concerts and festivals to sports and theater - at some of the most iconic venues in the world. Since our founding in 2011, we've consistently pushed the industry forward and improved experiences for fans, making it easier...


  • Los Angeles, California, United States AXS Group Full time

    AXS connects fans with the artists and teams they love. Each year we sell millions of tickets to thousands of incredible events - from concerts and festivals to sports and theater - at some of the most iconic venues in the world. Since our founding in 2011, we've consistently pushed the industry forward and improved experiences for fans, making it easier...


  • Los Angeles, California, United States Entertainment Data Oracle (EDO) Full time

    Job RequirementsProduction experience building complex data pipelinesSelf-driven individual with project ownership in a startup environmentGood working knowledge of data warehousing platforms, cloud computing, and ETL/data pipeline technologiesMinimum of 4 years of software engineering experience, including at least 2 years of data engineering...

  • Data Engineer

    5 days ago


    Los Angeles, California, United States The Corporate Full time

    Job Description Job Description Overview The Data Engineer plays a critical role in the organization by responsible for designing, constructing, and maintaining scalable data processing systems. This position is essential for ensuring the integrity, availability, and proper functioning of data systems that support analytics, reporting, and various...