Current jobs related to Data Engineering Lead: Scalable Systems - San Francisco, California - BHO Tech


  • San Francisco, California, United States OpenAI Full time

    About the TeamYou'll be part of the team behind OpenAI's data infrastructure, which powers critical engineering and product teams.The systems we support include our data warehouse, batch compute infrastructure, streaming infrastructure, data orchestration system, data lake, vector databases, and more.About the RoleYou'll design, build, and operate the...

  • Data Engineer

    3 days ago


    San Francisco, California, United States Unreal Gigs Full time

    Job DescriptionAt Unreal Gigs, we're revolutionizing how businesses leverage data to drive insights and make informed decisions. Our mission is to develop scalable and robust data infrastructure that empowers organizations to unlock the full potential of their data.Key Responsibilities:Design, build, and maintain scalable and reliable data pipelines for...

  • Data Engineer

    1 week ago


    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Data EngineerAt Unreal Gigs, we're revolutionizing data-driven innovation. As a Data Engineer, you'll play a crucial role in designing, building, and maintaining scalable and reliable data infrastructure that powers our analytics and machine learning initiatives.Key Responsibilities:Design and implement scalable data pipelines for ingesting,...


  • San Francisco, California, United States Unreal Gigs Full time

    Job Title: Lead Data Systems EngineerAt Unreal Gigs, we're seeking a highly skilled Lead Data Systems Engineer to join our team. As a key member of our data engineering team, you will be responsible for leading the design, implementation, and optimization of our data systems infrastructure.Key Responsibilities:Technical Leadership: Provide strategic...


  • San Francisco, California, United States Unreal Gigs Full time

    Job Title: Lead Data Systems EngineerUnreal Gigs is seeking a highly skilled Lead Data Systems Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and optimizing our data systems infrastructure.Key Responsibilities:Provide technical leadership and guidance to a team of data engineers,...


  • San Francisco, California, United States Infinitus Systems Full time

    About UsInfinitus Systems is a conversational AI healthcare company that automates tedious and time-consuming administrative processes across the healthcare ecosystem, creating time for healthcare to improve access, adherence, and affordability.Job DescriptionWe are seeking a highly skilled Platform Software Engineer to join our team and contribute to the...


  • San Francisco, California, United States Pendulum Full time

    About PendulumPendulum is a pioneering company that is revolutionizing the field of microbiome research and development. Our mission is to improve physical and mental health by understanding, restoring, and enhancing the human microbiome.Our team is dedicated to developing innovative solutions that address the complex relationships between the microbiome and...


  • San Francisco, California, United States Orb Full time

    About the RoleWe are seeking an experienced Infrastructure Engineer to join our team at Orb. As an Infrastructure Engineer, you will be responsible for designing and maintaining product features that require a deep understanding of reliable and scalable systems.The infrastructure team at Orb works on every part of the stack and ships product quickly. This is...

  • Software Engineer

    2 weeks ago


    San Francisco, California, United States Figma Full time

    Join Figma's Server Platform TeamFigma is seeking a skilled Infrastructure Engineer to join our Server Platform team. As a key member of this team, you will design, build, and operate scalable infrastructure systems and services that power Figma's innovative tools for design and collaboration.Our team is responsible for constructing a self-service platform...


  • San Francisco, California, United States Unreal Gigs Full time

    Job Title: Lead Big Data EngineerAt Unreal Gigs, we're seeking a highly skilled Lead Big Data Engineer to join our team. As a key member of our data engineering team, you'll be responsible for designing, building, and maintaining our big data infrastructure and pipelines.Key Responsibilities:Technical Leadership: Provide technical guidance and leadership to...


  • San Francisco, California, United States Unreal Gigs Full time

    Lead Cloud Data EngineerUnreal Gigs is a trailblazer in leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that harness the scalability, flexibility, and power of cloud platforms.Position OverviewAs the Lead Cloud Data Engineer, you'll...

  • Data Engineer

    4 days ago


    San Francisco, California, United States Diverse Lynx Full time

    Data Engineering RoleWe are seeking a skilled Data Engineer to design, build, and maintain scalable and efficient data platforms using data engineering technologies such as Glue, EMR, Athena, Redshift, Lake Formation, Apache Spark, Hive, HDFS, and Trino.Key Responsibilities:Design and develop data pipelines and common data-related cross-cutting concerns like...


  • San Francisco, California, United States Unreal Gigs Full time

    Job DescriptionCompany Overview: At Unreal Gigs, we're at the forefront of data-driven innovation, harnessing the power of data to drive transformative change and solve complex problems across industries. Our company is dedicated to building scalable and efficient data warehousing solutions that enable advanced analytics, reporting, and business...


  • San Francisco, California, United States Infinitus LLC Full time

    We are seeking a highly skilled Platform Software Engineer to join our team at Infinitus LLC. As a key member of our engineering team, you will be responsible for designing and implementing scalable, robust backend systems that power our digital health assistant, Eva.With a strong background in backend development and a passion for machine learning, you will...


  • San Francisco, California, United States Eventual Full time

    About EventualEventual is a cutting-edge startup that's revolutionizing the way we approach data systems. We're a small but mighty team of innovators who are passionate about building scalable, efficient, and secure data solutions.Job Title: Distributed Data Systems EngineerWe're seeking a highly skilled Distributed Data Systems Engineer to join our team as...

  • Lead Data Architect

    1 month ago


    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Lead Data EngineerCompany Overview:Welcome to Unreal Gigs, a pioneering company at the forefront of data-driven innovation. Our mission is to harness the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics,...

  • Lead Data Scientist

    1 week ago


    San Francisco, California, United States Jerry Full time

    About the Opportunity:We are seeking a Lead Data Scientist to drive scalable user acquisition across our paid and organic channels. You will define, understand, and test levers to drive profitable and scalable user acquisition, design, run, and analyze A/B experiments, and build key reports, dashboards, and predictive models to monitor the performance of our...


  • San Jose, California, United States Adobe Systems Full time

    Join Adobe's Journey Optimizer TeamWe're seeking a talented Software Development Engineer to join our Digital Experience Business Unit. As a key member of our team, you'll be responsible for designing and building scalable services that enable our enterprise customers to reach and connect with end-users.Our ideal candidate has expertise in developing on top...


  • San Diego, California, United States Qualcomm Full time

    Job SummaryQualcomm is seeking an experienced Principal Enterprise Data Architect to play a pivotal role in defining and executing our data architecture strategy. This position is crucial for ensuring that our data infrastructure is scalable, secure, and optimally aligned with our business objectives.Key ResponsibilitiesLead the development and...


  • San Francisco, California, United States Unreal Gigs Full time

    Unreal Gigs Data Systems EngineerCompany Overview:Welcome to Unreal Gigs, a cutting-edge company that harnesses the potential of data to drive innovation and transformation. Our mission is to develop robust and scalable data systems that empower organizations to extract insights and make data-driven decisions.We're passionate about data engineering and...

Data Engineering Lead: Scalable Systems

2 months ago


San Francisco, California, United States BHO Tech Full time

About BHO Tech

We are a leading provider of data connectivity solutions, helping top brands leverage their data to enhance customer interactions across various channels and devices.

Job Summary

We are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and deploying large-scale, distributed systems to process massive graphs.

Key Responsibilities

  • Design and implement high-performance graph processing systems using Apache Giraph and other relevant technologies.
  • Develop and maintain scalable edge ingestion and partitioning frameworks to manage massive graph data.
  • Collaborate with cross-functional teams to design and implement caching and batching strategies to optimize path computation performance.
  • Work closely with junior engineers to mentor and guide them in developing best practices and deploying production code.
  • Participate in code reviews and ensure adherence to coding standards and best practices.

Requirements

  • 3+ years of experience in designing and developing large-scale, distributed systems.
  • Strong understanding of graph processing algorithms and data structures.
  • Experience with Apache Giraph, MapReduce, and Spark.
  • Excellent communication and presentation skills.
  • Passion for building high-performance systems and mentoring junior engineers.

What We Offer

  • A dynamic and collaborative work environment.
  • Opportunities for professional growth and development.
  • A comprehensive benefits package, including health insurance, 401(k) matching, and stock options.
  • A fun and inclusive company culture, with regular team-building events and activities.