Senior Data Engineer

2 weeks ago

San Francisco, California, United States ideaHelix Full time

Senior Data Engineer

Local to the Bay Area

On-site 1day a week

Exp 12+

Job Overview

The Data Analytics and Insights team is seeking an experienced and talented Senior Data Engineer to join our growing team of analytics experts. As a key member of our team, you will play an essential role in the design, development, and maintenance of data pipelines, data products, and analytic products in enterprise snowflake. The ideal candidate will have a strong background in data engineering, with specific expertise in Informatica and Snowflake. This role will involve working closely with our business stakeholders, data analysts, and data scientists to ensure the efficient development and management of our data infrastructure.

You will have a unique opportunity to be at the forefront of the utility industry and gain a comprehensive view of the nation's most advanced smart grid. It is the perfect role for someone who would like to continue to build upon their professional experience and help advance PG&E's sustainability goals.

Key Responsibilities

  • Develop and optimize cloud-based data storage and processing solutions using
    Snowflake
    .
  • Design, implement, and maintain robust data pipelines and
    ETL processes
  • Collaborate with Federated teams and other data engineers to understand data requirements and deliver high-quality data solutions.
  • Ensure data integrity and security across all data workflows and storage solutions.
  • Monitor and troubleshoot data pipelines, addressing any issues promptly to ensure the smooth flow of data.
  • Develop reusable and modular
    stored procedures
    and scripts for data processing.
  • Contribute to the development and implementation of data governance and best practices.
  • Monitor and troubleshoot data pipelines to ensure reliability and accuracy.
  • Implement best practices for data governance, data quality, and metadata management.

Minimum Qualifications

  • Bachelor's or master's degree in computer science, Engineering, or a related field.
  • Minimum of 5 years of experience in data engineering or a related role.
  • Proven experience with
    Snowflake
    is required.
  • Knowledge of
    data warehousing concepts
    ,
    dimensional modeling
    , and
    performance tuning
    .
  • Hands-on experience with
    ETL tools
    (e.g., Informatica, Talend, dbt, or custom ETL frameworks).
  • Strong proficiency in SQL and database management.
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud.
  • Familiarity with version control
    (Git) and CI/CD
    for data pipelines.
  • Familiarity with Big Data technologies such as Hadoop, Spark, and Kafka is a plus.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration abilities.

Preferred Skills

  • Experience with Python or other scripting languages.
  • Experience with informatica but not necessary.
  • Knowledge of data visualization tools such as Tableau or Power BI.
  • Exposure to
    data orchestration tools

  • Senior Software Engineer, Data Platform

    2 weeks ago

    San Francisco, California, United States Salesforce Full time

    To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.Job CategorySoftware EngineeringJob DetailsAbout SalesforceSalesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn't...

  • Senior Data Scientist

    2 weeks ago

    San Francisco, California, United States Jack & JillExternal ATS Full time

    This is a job that we are recruiting for on behalf of one of our customers.To apply, speak to Jack. He's an AI agent that sends you unmissable jobs and then helps you ace the interview. He'll make sure you are considered for this role, and help you find others if you ask.Senior Data Scientist Company Description: VC-backed AI product intelligence platformJob...

  • Principal, Data Engineer

    2 weeks ago

    San Francisco, California, United States Gemini Full time $192,500 - $275,000

    About the CompanyGemini is a global crypto and Web3 platform founded by Cameron and Tyler Winklevoss in 2014, offering a wide range of simple, reliable, and secure crypto products and services to individuals and institutions in over 70 countries. Our mission is to unlock the next era of financial, creative, and personal freedom by providing trusted access to...

  • Senior Finance Data Engineer

    2 weeks ago

    San Mateo, California, United States Roblox Full time

    Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators.At Roblox, we're building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to...

  • Senior Data Scientist

    2 weeks ago

    San Francisco, California, United States Nexxen Full time

    Who is Nexxen?Flexible advertising, unified by data. Nexxen empowers advertisers, agencies, publishers and broadcasters around the world to utilize data and advanced TV in the ways that are most meaningful to them. Our flexible and unified technology stack comprises a demand-side platform ("DSP") and supply-side platform ("SSP"), with the Nexxen Data...

  • Senior Java Engineer

    7 days ago

    San Francisco, California, United States SRI Tech Solutions Inc. Full time

    Job Title: Senior Java Engineer (with Cloud Experience)Location: Bay Area, CARole Overview:We are seeking a highly experienced Senior Java Engineer with strong expertise in cloud technologies and modern development practices. The ideal candidate will design, develop, and maintain scalable applications leveraging AWS services, containerization,...

  • Senior Fraud Strategist, Data

    7 days ago

    San Francisco, California, United States Gemini Full time

    About The CompanyGemini is a global crypto and Web3 platform founded by Cameron and Tyler Winklevoss in 2014, offering a wide range of simple, reliable, and secure crypto products and services to individuals and institutions in over 70 countries. Our mission is to unlock the next era of financial, creative, and personal freedom by providing trusted access to...

  • Data Engineer

    1 week ago

    San Francisco, California, United States krea Full time

    About KreaAt Krea, we are building next-generation AI creative tools.We are dedicated to making AI intuitive and controllable for creatives. Our mission is to build tools that empower human creativity, not replace it.We believe AI is a new medium that allows us to express ourselves through various formats—text, images, video, sound, and even 3D. We're...

  • Data Engineer, Monetization

    2 weeks ago

    San Francisco, California, United States Twitch Full time

    About UsTwitch is the world's biggest live streaming service, with global communities built around gaming, entertainment, music, sports, cooking, and more. It is where thousands of communities come together for whatever, every day.We're about community, inside and out. You'll find coworkers who are eager to team up, collaborate, and smash (or elegantly...

  • Senior Machine Learning Engineer

    2 weeks ago

    San Francisco, California, United States ChatGPT Jobs Full time

    Job DescriptionSenior Machine Learning Engineer - AV LabsCompany:UberLocation:San Francisco, CAOn-site, RemoteAbout the Role:Uber is launching AV Labs to accelerate the autonomous technology ecosystem. We're building out a high-velocity team of multi-disciplinary experts to turn real-world operations into high-quality data for our autonomous partners. This...