Senior Data Engineer

1 month ago

San Francisco, United States Neon Redwood Full time
About Neon Redwood

Neon Redwood is a data services consulting company, working on cutting-edge AI and data-driven solutions. We are a team of passionate engineers and data experts, and we are currently looking for a Senior Data Engineer to join our team and help us develop and expand our data infrastructure and analytics capabilities.

The Role

We are seeking an experienced Senior Data Engineer with a strong background in data engineering and a passion for working with large-scale data sets. Help us develop and expand our data infrastructure and analytics capabilities.

The ideal candidate will have at least 5 years of professional experience and a solid understanding of Python, BigQuery, and Google Cloud Platform (GCP). This full-time role will involve working closely with our CTO and other team members to design, develop, and maintain data pipelines, ETL processes, and data warehousing solutions.

Responsibilities
  • Collaborate with the CTO and other team members to design, develop, and maintain data pipelines and ETL processes.
  • Write clean, efficient, and maintainable code in Python and other relevant technologies.
  • Implement and optimize data storage and processing solutions using BigQuery and Google Cloud Platform (GCP).
  • Ensure data quality and integrity through proper data validation and monitoring techniques.
  • Participate in code reviews and provide constructive feedback to improve overall code quality.
  • Stay up-to-date with the latest industry trends and technologies to ensure our data infrastructure remains competitive.
  • Assist in the development and launch of new data-driven tools and products.
  • Mentor and guide junior engineers, fostering a culture of continuous learning and improvement.
Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent work experience.
  • 5+ years of professional data engineering experience.
  • Strong proficiency in Python, BigQuery, and Google Cloud Platform (GCP).
  • Experience with data pipeline and ETL process design and development.
  • Excellent problem-solving skills and the ability to work independently or as part of a team.
  • Strong communication, collaboration, and leadership skills.
  • Passion for working with large-scale data sets and staying current with industry trends.
Additional Skills (Nice to Have)
  • Experience with other data processing technologies and platforms (e.g., Apache Beam, Dataflow, Hadoop, Spark).
  • Experience with data visualization tools and libraries (e.g., Tableau, Looker, D3.js).
  • Knowledge of machine learning and AI concepts.
  • Experience with real-time data processing and streaming technologies (e.g., Kafka, Pub/Sub).
Benefits

  • Flexible hours and frequent get togethers

  • Fully covered Health Insurance for employees and their eligible dependents

  • Fully covered Vision & Dental for employees and their eligible dependents

  • Unlimited Time Off

  • Company 401k plan with employer contributions

  • Supplemental monthly health and wellness stipend

  • Senior Data Engineer

    1 week ago

    San Francisco, United States Rockerbox, Inc Full time

    Senior Data Engineer (Senior Software Engineer II)Rockerbox empowers marketing executives to confidently make data-driven decisions, helping brands such as Tula, Figs, and Burton with the strategic decision-making that drives growth. To do so, Rockerbox offers a unique suite of product lines that centralize data and offer diversified measurement...

  • Senior Data Engineer

    2 weeks ago

    San Francisco, United States Rockerbox, Inc Full time

    Senior Data Engineer (Senior Software Engineer II)Rockerbox empowers marketing executives to confidently make data-driven decisions, helping brands such as Tula, Figs, and Burton with the strategic decision-making that drives growth. To do so, Rockerbox offers a unique suite of product lines that centralize data and offer diversified measurement...

  • Senior Data Engineer

    1 month ago

    san francisco, United States Webologix Ltd INC Full time

    Role: Senior Data EngineerLocation: Dallas, TX / San Francisco, CA / Seattle, WAType of hiring: FTEJob Description:Atleast 4 years of experience in Information TechnologyAtleast 4 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, GCP, Data Bricks etc. Azure experience is preferred over...

  • Senior Data Engineer

    2 months ago

    San Francisco, United States Webologix Ltd INC Full time

    Role: Senior Data EngineerLocation: Dallas, TX / San Francisco, CA / Seattle, WAType of hiring: FTEJob Description:Atleast 4 years of experience in Information TechnologyAtleast 4 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, GCP, Data Bricks etc. Azure experience is preferred over...

  • Senior Data Infrastructure Engineer

    4 weeks ago

    San Francisco, California, United States Acceler8 Talent Full time

    We are seeking an experienced software engineer to join our team at the forefront of data-centric AI. Our company is a leading innovator in enhancing data quality for AI models.About the Role:As a Senior Data Infrastructure Engineer, you will be responsible for designing, implementing, and optimizing scalable infrastructure to support our data processing...

  • Senior Data Engineer

    2 weeks ago

    san francisco, United States Jacobs Full time

    LocationSan Francisco, California, United StatesCapabilitiesDigital Design and Data AnalyticsOffice SetupHybrid, RemoteJob ID#19216 Market Digital and Data At Jacobs, we're challenging today to reinvent tomorrow by solving the world's most critical problems for thriving cities, resilient environments, mission-critical outcomes, operational advancement,...

  • Senior Software Engineer, Data Platform

    3 weeks ago

    San Francisco, United States Social Finance (SoFi) Full time

    Employee Applicant Privacy NoticeWho we are:Shape a brighter financial future with us. Together with our members, we're changing the way people think about and interact with personal finance. We're a next-generation financial services company and national bank using innovative, mobile-first technology to help our millions of members reach their goals. The...

  • Senior Data Systems Engineer

    4 weeks ago

    San Francisco, California, United States Harnahm Full time

    Harnahm is seeking a Senior Data Systems Engineer to lead the development of scalable and efficient data processing workflows. The ideal candidate will have 5+ years of experience with a degree in a related field and a strong understanding of Python and SQL.Responsibilities:Design and maintain effective ELT pipelines.Collaborate with Data Science and...

  • Senior Data Architect

    2 weeks ago

    San Francisco, California, United States Ellation, Inc. Full time

    About the RoleWe're seeking a highly skilled Senior Data Engineer to join our Data Engineering team. As a key member of this team, you will play a pivotal role in designing, implementing, and optimizing data services and pipelines, ensuring that our data services support the needs of the business.As a Senior Data Engineer, you will collaborate with...

  • Senior Software Engineer, Data Platform

    4 months ago

    San Francisco, United States Social Finance Ltd Full time

    Employee Applicant Privacy Notice Who we are: Shape a brighter financial future with us. Together with our members, we're changing the way people think about and interact with personal finance. We're a next-generation financial services company and national bank using innovative, mobile-first technology to help our millions of members reach their goals. The...

  • Senior Data Engineer

    3 weeks ago

    San Francisco, United States Ellation, Inc. Full time

    Who We Are We're a cast of characters working to shine a spotlight on anime. Crunchyroll is an international business focused on creating both online and offline experiences for fans through content (licensed, co-produced, originals, distribution), merchandise, events, gaming, news, and more. Visit our About Us pages for more information about our collection...

  • Senior Software Engineer

    4 weeks ago

    San Francisco, United States Discord Full time

    Discord is used by over 200 million people every month for many different reasons, but there's one thing that nearly everyone does on our platform: play video games. Over 90% of our users play games, spending a combined 1.5 billion hours playing thousands of unique titles on Discord each month. Discord plays a uniquely important role in the future of gaming....

  • Senior Software Engineer, Data Acquisition

    2 weeks ago

    San Francisco, United States OpenAI Full time

    Senior Software Engineer, Data AcquisitionOverview:The Data Acquisition team within the Foundations organization at OpenAI is responsible for all aspects of data collection to support our model training operations. Our team manages web crawling and GPTBot services and works closely with Data Processing, Architecture, and Scaling teams. We are looking for a...

  • Senior Software Engineer, Data Acquisition

    4 weeks ago

    San Francisco, United States OpenAI Full time

    Senior Software Engineer, Data Acquisition Overview: The Data Acquisition team within the Foundations organization at OpenAI is responsible for all aspects of data collection to support our model training operations. Our team manages web crawling and GPTBot services and works closely with Data Processing, Architecture, and Scaling teams. We are looking for a...

  • Senior Software Engineer

    3 weeks ago

    San Francisco, United States Discord Full time

    This position is US based only.Discord is about giving people the power to create space to find belonging in their lives. We want to make it easier for you to talk regularly with the people you care about. We want you to build genuine relationships with your friends and communities close to home or around the world. Original, reliable, playful, and...

  • Senior Software Engineer, Data Acquisition

    5 days ago

    San Francisco, United States OpenAI Full time

    Senior Software Engineer, Data AcquisitionOverview:The Data Acquisition team within the Foundations organization at OpenAI is responsible for all aspects of data collection to support our model training operations. Our team manages web crawling and GPTBot services and works closely with Data Processing, Architecture, and Scaling teams. We are looking for a...

  • Senior Software Engineer, Data Acquisition

    2 weeks ago

    San Francisco, United States OpenAI Full time

    Senior Software Engineer, Data Acquisition Overview: The Data Acquisition team within the Foundations organization at OpenAI is responsible for all aspects of data collection to support our model training operations. Our team manages web crawling and GPTBot services and works closely with Data Processing, Architecture, and Scaling teams. We are looking for a...

  • Senior Data and ML Infrastructure Engineer

    2 weeks ago

    San Francisco, California, United States Unity Technologies Full time

    About the RoleWe're seeking a skilled Senior Data and ML Infrastructure Engineer to join our team at Unity. As a key member of our Data & ML Platform team, you will design and optimize large-scale data platforms and machine learning infrastructure systems for efficiency, reliability, and cost-effectiveness.Key Responsibilities:Design and optimize large-scale...

  • Senior Software Engineer, Data Engineering

    3 weeks ago

    San Francisco, United States Ripple Full time

    At Ripple, we're building a world where value moves like information does today. It's big, it's bold, and we're already doing it. Through our crypto solutions for financial institutions, businesses, governments and developers, we are improving the global financial system and creating greater economic fairness and opportunity for more people, in more places...

  • Data Center Operations Specialist

    5 days ago

    San Francisco, California, United States Amazon Data Services, Inc. Full time

    About Amazon Data Services, Inc.At Amazon Data Services, Inc., we're passionate about delivering exceptional customer experiences. As the world's most comprehensive and broadly adopted cloud platform, we're committed to innovation and excellence in all that we do.We're seeking a highly skilled Data Center Operations Specialist to join our team. In this...