Data Engineer

4 weeks ago

San Francisco, United States WPRO TALENTS Full time
Job DescriptionJob Description

This is a remote position.

Our client is at the forefront of web3 innovation. Our mission is to establish The Graph as the unbreakable foundation of open data. Our pioneering sub graphs set the industry standard and solidify The Graph as the premier solution for organizing and accessing blockchain data.

At our clients, we champion a decentralized future based on shared values. Dedicated to decentralizing power and resisting censorship, we aim for a robust, permission less information era free from central control, thus eliminating the traditional vulnerabilities associated with misplaced trust.

The Graph Network Engineering team is focused on building and maintaining core software components that make The Graph work. We are especially focused on graph-node, an Open Source Rust project that provides the core indexing capabilities of The Graph.

We are looking for a Data Engineer with deep understanding of relational databases and modern data stacks, and a desire to code in Rust. A Rust Data Engineer will not just use Rust data tools, but build our general purpose blockchain data systems and also contribute to our dependencies.

What You’ll Be Doing

Working within the Graph Node team to improve Graph Node’s capabilities as a data processing and querying engine

Familiarizing yourself with the large and complex Rust codebase that is Graph Node

Using sub graphs to understand both the specification implemented by Graph Node as well as the developer experience of the builders who are our users.

Develop an understanding of existing code and design choices, and then analyze how they can be experimented with and improved upon

Setting up performance tests, doing quantitative assessments of any proposals and changes you make, and monitoring how the changes ultimately behave when rolled out

Experimentally validating, and if necessary, falsifying your own ideas.

Reviewing pull requests of your colleagues and taking responsibility for the reviewed code as if it were your own

Documenting important aspects of the software while understanding that Graph Node has a large community of independent operators that need to understand how to run, configure, and monitor Graph Node

Hiring Criteria

Based in North or South America

Extensive experience with Rust (min two years professionally)

Prior experience building data tools in Rust

Web3 experience (or very interested in the space)


Requirements You’ve contributed more than 10,000 lines of code to a production software product

Thinking about data in SQL terms comes naturally for you

You have an understanding of some of the theory behind data systems, such as relational algebra, and an understanding of fundamental DB data structures and data formats, such as BTrees, LSM Trees, and compression formats

You have an interest in higher-level query languages such GraphQL

You have an interest in federated data and federated query frameworks

You understand how small design choices can have large effects in big data systems

You are comfortable working with an existing system and codebase and making fundamental improvements to it while being mindful of backwards compatibility

You understand tracing and debugging requirements of complex software

You have an understanding of the academia and theory that backs the software libraries you use but also understand the pragmatic necessity of shipping usable software quickly

Benefits Hiring Criteria

Based in North or South America

Extensive experience with Rust (min two years professionally)

Prior experience building data tools in Rust

Web3 experience (or very interested in the space)

  • Senior Data Engineer

    3 weeks ago

    San Francisco, United States People Data Labs Full time

    Job DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...

  • Senior Data Engineer

    1 week ago

    San Francisco, United States People Data Labs Full time

    Job DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...

  • Senior Data Engineer

    1 day ago

    San Francisco, United States People Data Labs Full time

    Job DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...

  • Data Analyst

    3 weeks ago

    San Francisco, United States People Data Labs Full time

    Job DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...

  • Data Analyst

    1 week ago

    San Francisco, United States People Data Labs Full time

    Job DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...

  • Data Engineer

    3 weeks ago

    San Francisco, United States Plaid Full time

    We believe that the way people interact with their finances will drastically improve in the next few years. We’re dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions of people rely on to live a healthier financial life. We work with...

  • Senior Data Scientist

    2 weeks ago

    San Francisco, CA, United States Data Masked Full time

    Neighbors around the world turn to Nextdoor daily to receive trusted information, give and get help, get things done, and build real-world connections with those nearby — neighbors, businesses, and public services. At Nextdoor, our Growth Marketing team is charged with driving member growth and revenues from businesses advertising on the platform. This...

  • Senior Software Engineer

    2 weeks ago

    San Francisco, United States StreetLight Data Full time

    StreetLight pioneered the use of Big Data analytics to shed light on how people, goods, and services move, empowering smarter, data-driven transportation decisions. The company applies proprietary machine-learning algorithms and data processing resources to measure travel patterns of vehicles, bicycles and pedestrians that enable complex transportation...

  • Senior Software Engineer

    1 week ago

    San Francisco, United States StreetLight Data Full time

    StreetLight pioneered the use of Big Data analytics to shed light on how people, goods, and services move, empowering smarter, data-driven transportation decisions. The company applies proprietary machine-learning algorithms and data processing resources to measure travel patterns of vehicles, bicycles and pedestrians that enable complex transportation...

  • Senior Systems Engineer

    1 month ago

    San Francisco, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of the fastest-growing infrastructure company in history. In just a few short years, we’ve shaken up the industry by challenging traditional architecture models and introduced a revolutionary set of storage possibilities through our...

  • Senior Systems Engineer

    1 week ago

    San Francisco, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of the fastest-growing infrastructure company in history. In just a few short years, we’ve shaken up the industry by challenging traditional architecture models and introduced a revolutionary set of storage possibilities through our...

  • Data Engineer, Engineering Data Management

    3 days ago

    San Francisco, United States Rose International Full time

    Date Posted: 06/07/2024 Hiring Organization: Rose International Position Number: 465521 Job Title: Data Engineer, Engineering Data Management Job Location: San Francisco, CA, USA, 94115 Work Model: Hybrid Employment Type: Temporary Estimated Duration (In months): 7 Min Hourly Rate ($): 90.00 Max Hourly Rate ($): 117.24 Must Have...

  • Data Engineer

    4 weeks ago

    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! At our company, we're revolutionizing how businesses leverage data to drive insights and make informed decisions. Our mission is to develop scalable and robust data infrastructure that empowers organizations to unlock the full potential of their data. Join...

  • Data Engineer

    6 days ago

    San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven innovation! At our company, we're revolutionizing how businesses leverage data to drive insights and make informed decisions. Our mission is to develop scalable and robust data infrastructure that empowers organizations to unlock the full potential of their data. Join us and be part of a dynamic team...

  • Data Engineer

    1 week ago

    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! At our company, we're revolutionizing how businesses leverage data to drive insights and make informed decisions. Our mission is to develop scalable and robust data infrastructure that empowers organizations to unlock the full potential of their data. Join...

  • Data Engineer

    3 weeks ago

    San Francisco, California, United States teamworkonline Full time

    Company OverviewSwish Analytics is a sports analytics, betting and fantasy startup building the next generation of predictive sports analytics data products. We believe that oddsmaking is a challenge rooted in engineering, mathematics, and sports betting expertise; not intuition. We're looking for team-oriented individuals with an authentic passion for...

  • Data Engineer

    1 week ago

    San Francisco, California, United States teamworkonline Full time

    Company OverviewSwish Analytics is a sports analytics, betting and fantasy startup building the next generation of predictive sports analytics data products. We believe that oddsmaking is a challenge rooted in engineering, mathematics, and sports betting expertise; not intuition. We're looking for team-oriented individuals with an authentic passion for...

  • Data Engineer

    2 months ago

    San Francisco, United States Legalist Full time

    Job DescriptionJob DescriptionIntro description:Legalist is an institutional alternative asset management firm. Founded in 2016 and incubated at Y Combinator, the firm uses data-driven technology to invest in credit assets at scale. We are always looking for talented people to join our team.As a highly collaborative organization, our data engineers work...

  • Data Engineer

    1 week ago

    San Francisco, United States Legalist Full time

    Job DescriptionJob DescriptionIntro description:Legalist is an institutional alternative asset management firm. Founded in 2016 and incubated at Y Combinator, the firm uses data-driven technology to invest in credit assets at scale. We are always looking for talented people to join our team.As a highly collaborative organization, our data engineers work...

  • Data Engineer

    2 days ago

    San Francisco, United States University of California Full time

    Data Engineer Neuro-Memory and Aging Full Time 77338BR Job Summary **This is an onsite position @ Mission Bay; Local SF The Brain Aging Network for Cognitive Health (BRANCH) study aims to understand the complex biological, genetic, and lifestyle factors that underlie differential aging trajectories. Our program enrolls hundreds of older adults, who...