Backend Engineer

1 month ago

San Francisco, California, United States Hex Full time

About the role

Our Supernova team looks after all of Hex's compute backend, and is responsible for scaling our architecture to support fast data analysis at any data scale.

This is a hugely challenging problem. Our users do everything from analyzing 100 line csv files through to querying TB / PB scale Snowflake tables, and in all cases expect to be able to do this without worrying how this is done under the hood.

Our job is to define and build the how.

A few of the things we work on:

  • Distributing compute to underlying warehouses where appropriate
  • How to support Hex's polyglot functionality (interoperation between Python and SQL) while also running things as quickly as possible
  • Operating on datasets that are too large to pull into memory
  • Expanding our features to work correctly across the enterprise, including scaling infrastructure (with help from our Infra team), and architecture to support things like permissions on datasets and metadata

What you will do:

The following are a few examples of the kind of work you can expect to do in this role:

  • Work on evolving our compute architecture, including entirely new compute components that support our goal of providing ultra-fast execution by using the appropriate executors for the relevant query or operation
  • Refine our caching strategies to minimize return trips to data warehouses
  • Propose designs for extensions, improvements, or entirely new parts of our backend, and implement said designs
  • Collaborate with other teams to support new features — for example, building and exposing an internal query language that compiles to the appropriate dialect for any given connected warehouse

About You

  • At least 6+ years of software engineering experience
  • Excited about making a product as fast as it can be. Hex's version of this is complex — our users can execute their own code against their own data
  • A strong eye for detail, and a desire to deeply understand what's going on under the hood. We've found examples of significant performance gains in the past by poring over execution logs and throughly understanding the internals of things like the Jupyter kernel and specific data warehouse connection drivers
  • Experience working in a remote team, and able to operate and communicate effectively in this context
  • An interest and desire to collaborate through technical RFCs, writing, and reviewing code
  • An instinct for strategic thinking and aligning with business and product goals while keeping a healthy balance of velocity and engineering excellence
  • Interest in the data space, and a love of shipping great products and building tools that empower end users to do more
  • An ability to lead initiatives while collaborating and mentoring fellow engineers
  • Have a key interest in the latest compute, caching, and technological advances relevant to our field. Some things we've been interested in lately are DuckDB, SQLGlot, Calcite, Polars, etc.

Our stack

Our product is a web-based notebook and app authoring platform. Our frontend is built with Typescript and React, using a combination of Apollo GraphQL and Redux for managing application state and data. On the backend, we also use Typescript to power an Express/Apollo GraphQL server that interacts with Postgres, Redis, and Kubernetes to manage our database and Python kernels. Our backend is tightly integrated with our infrastructure and CI/CD, where we use a combination of Terraform, Helm, and AWS to deploy and maintain our stack.

  • Senior Backend Software Engineer

    17 hours ago

    San Francisco, California, United States Lionheart Ventures Full time

    Senior Backend Software EngineerCalm is a leading mental wellness and self-care platform that empowers users to take control of their mental health. We're seeking a highly skilled Senior Backend Software Engineer to join our team and help us build innovative solutions that make a meaningful impact on people's lives.About the RoleThis is a critical position...

  • Lead Backend Engineer

    6 days ago

    San Francisco, California, United States Mercury Full time

    About Mercury: Mercury is on the lookout for an experienced Lead Backend Engineer to join our Developer Experience team. This position requires working closely with a talented group of engineers to foster a developer-centric environment that emphasizes efficiency, quality, and satisfaction among our team members. Our primary programming language is Haskell,...

  • Senior Backend Engineer

    5 days ago

    San Francisco, California, United States Arbitrum Full time

    Staff Backend EngineerWe are seeking a talented staff engineer to contribute to the advancement of blockchain scalability.This role is perfect for an engineer who is either deeply interested in addressing challenges in blockchain scalability or is eager to enter the blockchain engineering field. If you thrive in a dynamic, impactful environment and wish to...

  • Senior Backend Engineer

    5 days ago

    San Francisco, California, United States Arbitrum Full time

    Staff Backend EngineerWe are seeking a talented staff engineer to contribute to the advancement of blockchain scalability.This role is perfect for an engineer who is enthusiastic about addressing challenges in blockchain scalability or is eager to enter the blockchain engineering field. If you thrive in a dynamic, impactful environment and wish to influence...

  • Senior Backend Engineer

    5 days ago

    San Francisco, California, United States Arbitrum Full time

    Staff Backend EngineerWe are seeking a talented staff engineer to contribute to the advancement of blockchain scalability.This role is perfect for an engineer who is either already enthusiastic about addressing challenges in blockchain scalability or is eager to enter the blockchain engineering field. If you desire to be part of a dynamic, impactful team and...

  • Senior Backend Engineer

    5 days ago

    San Francisco, California, United States Arbitrum Full time

    Staff Backend EngineerWe are seeking a talented staff engineer to contribute to the advancement of blockchain scalability.This role is perfect for an engineer who is enthusiastic about addressing challenges in blockchain scalability or is eager to enter the blockchain engineering field. If you desire to be part of a dynamic, impactful team and influence the...

  • Senior Backend Engineer

    5 days ago

    San Francisco, California, United States Cambly Full time

    About Cambly:Cambly is committed to delivering exceptional English education to learners around the globe, easily accessible with just a click. It serves as a premier platform connecting English students with tutors, playing a vital role in the expansion of the largest English learning community and institution worldwide.We are currently in search of a...

  • Senior Backend Engineer

    3 hours ago

    San Francisco, California, United States Cambly Full time

    About Cambly:Cambly is committed to delivering exceptional English education to learners around the globe, easily accessible with just a click. It serves as a premier platform connecting English students with tutors, playing a vital role in the expansion of the largest English learning community and institution worldwide.We are currently in search of a...

  • Senior Backend Engineer

    20 minutes ago

    San Francisco, California, United States Cambly Full time

    About Cambly:Cambly is committed to delivering exceptional English education to learners across the globe, providing seamless access through a user-friendly platform. We are proud to be a leading hub for English learning, connecting students with skilled tutors.We are currently in search of a talented Staff Backend Engineer who possesses a passion for...

  • Artificial Intelligence Backend Engineer

    5 days ago

    San Francisco, California, United States Petadata Full time

    Job OverviewCompany: PETADATAPosition: AI (Artificial Intelligence) Backend EngineerLocation: RemoteEmployment Type: FulltimePETADATA is seeking a proficient AI (Artificial Intelligence) Backend Engineer to contribute to our innovative projects.Key Responsibilities:Work closely with front-end engineers and other team members to define goals and create...

  • Backend Engineer

    1 month ago

    San Francisco, California, United States SafeBeat Full time

    [Contract] Backend Engineer at SafeBeat (United States) | BEAMSTART Jobs Backend EngineerTake the next step in your career now, scroll down to read the full role description and make your application.SafeBeat United StatesDate Posted27 Jan, 2023Work LocationSan Francisco, United StatesSalary Offered$30 - $40 yearlyJob TypeContractExperience Required1+...

  • Lead Backend Software Engineer

    4 hours ago

    San Francisco, California, United States Mochi Health Full time

    Job OverviewAt Mochi Health, we are redefining the landscape of healthcare by focusing on the most neglected areas of medicine. Our innovative telehealth clinic is dedicated to making weight management accessible and affordable, supported by a team of exceptional medical professionals and a commitment to evidence-based practices.About The PositionAs a Lead...

  • Senior Backend Engineer

    5 days ago

    San Francisco, California, United States Cleanlab Full time

    About Cleanlab: Founded with innovation at its core, Cleanlab is recognized for its industry-leading Data-Centric AI software, utilized by numerous organizations globally.Role Overview: As a Senior Software Engineer, you will play a crucial role in the development of Cleanlab's data and machine learning platforms. Your expertise will contribute to the...

  • Lead Backend Software Engineer

    6 days ago

    San Francisco, California, United States Wherobots Full time

    We are seeking dedicated, talented, and seasoned software engineers to become part of Wherobots' innovative team in developing the next-generation geospatial cloud database, along with its cloud platform and control mechanisms. As a lead backend software engineer, you will be instrumental in architecting, creating, and sustaining the backend services and...

  • Lead Backend Software Engineer

    5 days ago

    San Francisco, California, United States Abnormal Security Full time

    Job OverviewAbnormal Security is seeking a Lead Backend Software Engineer to enhance our Detection Team. This division is dedicated to developing cutting-edge technology that identifies and mitigates email and cloud-based threats that were previously undetectable, contributing to a safer digital environment.Role ResponsibilitiesAs a Backend Software Engineer...

  • Backend Software Engineer

    3 hours ago

    San Francisco, California, United States YOPESO Vertriebsgesellschaft mbH Full time

    Position OverviewAs a Backend Software Engineer at YOPESO Vertriebsgesellschaft mbH, you will play a crucial role in the delivery of innovative projects, leveraging insights from user interactions to enhance our offerings.Key ResponsibilitiesDrive the successful execution of project objectives while contributing to team goals.Design and implement features...

  • Senior Backend Software Engineer

    6 days ago

    San Francisco, California, United States Tempo LLC Full time

    About UsAt Tempo LLC, we are dedicated to enabling individuals to harness their potential and maintain a vibrant, healthy lifestyle. As pioneers in personal training technology, we utilize advanced 3D sensors and artificial intelligence to deliver enhanced workout experiences through both live and on-demand classes. Our headquarters is in San Francisco, and...

  • Backend Software Engineer

    5 days ago

    San Francisco, California, United States YOPESO Vertriebsgesellschaft mbH Full time

    Position OverviewAs a Backend Software Engineer at YOPESO Vertriebsgesellschaft mbH, you will play a crucial role in the delivery of innovative projects. Your focus will be on understanding user behavior to enhance our offerings for customers.Key ResponsibilitiesParticipate in defining your team's goals and contribute actively to their achievement.Design and...

  • Backend Software Engineer

    2 months ago

    San Francisco, California, United States Clickjobs Full time

    Looking to join a pre-seed company that is ready to hit the ground running with a new round of funding in 2024? Actively pursuing experienced backend/fullstack engineering candidates in San Francisco, California.This is a hybrid role looking for experience working in either java or C# on the backend and experience with Typescript/React on the frontend is a...

  • Senior Backend Software Engineer

    5 days ago

    San Francisco, California, United States Cambly Full time

    About Cambly:Cambly is committed to delivering exceptional English education to learners around the globe, providing easy access through a user-friendly platform. We serve as a vital link between English students and tutors, playing a significant role in the development of the largest English learning community worldwide.We are currently in search of a...