Data Engineer

4 weeks ago

San Francisco, United States Legalist Full time
Job DescriptionJob DescriptionIntro description:

Legalist is an institutional alternative asset management firm. Founded in 2016 and incubated at Y Combinator, the firm uses data-driven technology to invest in credit assets at scale. We are always looking for talented people to join our team.

As a highly collaborative organization, our data engineers work cross-functionally with software engineering, data science, and product management to optimize growth and strategy of our data pipeline. In this position, you will be joining the data engineering team in an effort to take our data pipeline to the next level.

Where you come in:

  • Design and develop scalable data pipelines to collect, process, and analyze large volumes of data efficiently.
  • Collaborate with cross-functional teams including data scientists, software engineers, and product managers to understand data requirements and deliver solutions that meet business needs.
  • Develop ELT processes to transform raw data into actionable insights, leveraging tools and frameworks such as Airbyte, BigQuery, Dagster, DBT or similar technologies.
  • Participate in agile development processes, including sprint planning, daily stand-ups, and retrospective meetings, to deliver iterative improvements and drive continuous innovation.
  • Apply best practices in data modeling and schema design to ensure data integrity, consistency, and efficiency.
  • Continuously monitor and optimize data pipelines and systems for performance, availability, scalability, and cost-effectiveness.

What you'll be bringing to the team:

  • Bachelor's degree (BA or BS) or equivalent.
  • A minimum of 2 years of work experience in data engineering or similar role.
  • Advanced SQL knowledge and experience working with a variety of databases (SQL, NoSQL, Graph, Multi-model).
  • A minimum of 2 years professional experience with ETL//ELT, data modeling and Python.
  • Familiarity with cloud environments like GCP, AWS, as well as cloud solutions like Kubernetes, Docker, BigQuery, etc.
  • You have a pragmatic, data-driven mindset and are not dogmatic or overly idealistic about technology choices and trade-offs.
  • You have an aptitude for learning new things quickly and have the confidence and humility to ask clarifying questions.

Even better if you have, but not necessary:

  • Experience with one or more of the following: data processing automation, data quality, data warehousing, data governance, business intelligence, data visualization.
  • Experience working with TB scale data.

  • Senior Systems Engineer

    2 weeks ago

    San Francisco, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of the fastest-growing infrastructure company in history. In just a few short years, we’ve shaken up the industry by challenging traditional architecture models and introduced a revolutionary set of storage possibilities through our...

  • Data Engineer

    2 days ago

    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! At our company, we're revolutionizing how businesses leverage data to drive insights and make informed decisions. Our mission is to develop scalable and robust data infrastructure that empowers organizations to unlock the full potential of their data. Join...

  • Data Engineer

    4 weeks ago

    San Francisco, United States Legalist Full time

    Job DescriptionJob DescriptionIntro description:Legalist is an institutional alternative asset management firm. Founded in 2016 and incubated at Y Combinator, the firm uses data-driven technology to invest in credit assets at scale. We are always looking for talented people to join our team.As a highly collaborative organization, our data engineers work...

  • Lead Data Engineer

    2 days ago

    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning,...

  • Data Engineer

    1 month ago

    San Francisco, California, United States iTvorks Inc Full time

    Required Skills Data engineer main skills Good knowledge of Data warehousing with expertise in data modeling and ETL. Advanced skills in SQL and HQL Should be good at these core tech AWS/EMR/Spark Hadoop Hive Vertica Qlikview Tableau Should have exp in CI/CD

  • Senior Data Engineer

    2 days ago

    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning,...

  • Senior Data Engineer

    3 weeks ago

    San Francisco, United States UpRecruit Full time

    Job DescriptionJob DescriptionJob Details: Title: Sr. Data EngineerSalary: $180-$230K Requirements: 8+ years of software dev exp (Large Data Sets or Big Data)Location: 100% onsite (San Francisco Bay Area) Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a...

  • Data Systems Engineer

    2 days ago

    San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the cutting-edge of data systems engineering! At our company, we're passionate about harnessing the potential of data to drive innovation and transformation. Our mission is to develop robust and scalable data systems that empower organizations to extract insights and make data-driven decisions. Join us and be part of a dynamic...

  • Data Systems Engineer

    2 days ago

    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the cutting-edge of data systems engineering! At our company, we're passionate about harnessing the potential of data to drive innovation and transformation. Our mission is to develop robust and scalable data systems that empower organizations to extract insights and make data-driven decisions....

  • Data Engineer

    2 days ago

    San Francisco, United States Sia Partners Full time

    Job DescriptionJob DescriptionCompany DescriptionSia Partners is a next-generation management consulting firm. We offer a unique blend of AI and design capabilities, augmenting traditional consulting to deliver superior value to our clients. Counting 3,000 consultants in 19 countries, we expect to achieve USD 420 million in turnover for the current fiscal...

  • Data Warehouse Engineer

    2 days ago

    San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven decision-making! At our company, we're committed to harnessing the power of data to drive insights and innovation. Our mission is to develop scalable and efficient data warehouse solutions that empower organizations to make informed decisions based on high-quality data. Join us and be part of a...

  • Data Warehouse Engineer

    15 hours ago

    San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven decision-making! At our company, we're committed to harnessing the power of data to drive insights and innovation. Our mission is to develop scalable and efficient data warehouse solutions that empower organizations to make informed decisions based on high-quality data. Join us and be part of a...

  • Big Data Engineer

    2 days ago

    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of big data innovation! At our company, we're leading the charge in harnessing the power of big data to drive insights and innovation. Our mission is to develop scalable and robust big data solutions that empower organizations to extract value from their data at scale. Join us and...

  • Cloud Data Engineer

    2 days ago

    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of cloud data engineering! At our company, we're dedicated to leveraging the power of cloud technology to drive data-driven innovation. Our mission is to develop scalable and robust cloud data solutions that enable organizations to harness the full potential of their data. Join us...

  • Data Warehouse Engineer

    2 days ago

    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven decision-making! At our company, we're committed to harnessing the power of data to drive insights and innovation. Our mission is to develop scalable and efficient data warehouse solutions that empower organizations to make informed decisions based on high-quality...

  • Senior Data Engineer

    2 weeks ago

    San Francisco, United States SmithRx Full time

    Job DescriptionJob DescriptionWho We Are:SmithRx is a rapidly growing, venture-backed Health-Tech company. Our mission is to disrupt the expensive and inefficient Pharmacy Benefit Management (PBM) sector by building a next-generation drug acquisition platform driven by cutting edge technology, innovative cost saving tools, and best-in-class customer service....

  • Software Engineer

    2 days ago

    San Francisco, United States Equilibrium Energy Full time

    About our Company Equilibrium Energy is a well-funded, Series B clean energy startup backed by some of the most prominent institutional investors in climate. We are building a digital native power company operating at the intersection of grid variability, market volatility, economic optimization, commercial structuring, and risk management, across the...

  • Staff Data Engineer

    3 weeks ago

    San Francisco, California, United States Pachama Full time

    Who we are.Pachama is a mission-driven company looking to restore nature to help address climate change. Pachama brings the latest technology in remote sensing and AI to the world of forest carbon in order to enable forest conservation and restoration to scale. Pachama's core technology harnesses satellite imaging with artificial intelligence to measure...

  • Remote Data Engineer

    2 days ago

    San Francisco, California, United States Archipelo Full time

    CompanyArchipelo is building a code security platform that gives organizations the ability to verify the authenticity and provenance of code within their software development lifecycle. They are solving a painful problem that affects every software developer on the planet: ensuring software security, authenticity, integrity, and compliance - by providing the...

  • Sr. Data Engineer

    4 weeks ago

    San Francisco, United States iTvorks Inc Full time

    Role Sr. Data Engineer (8+ years) Location SFO CA Duration Long TermExperience & Skills Extensive experience with Hadoop (or similar) Ecosystem (Map Reduce HDFS Hive Spark Pig HBase) Proficient in at least one of the SQL languages (MySQL PostgreSQL SqlServer Oracle) Good understanding of SQL Engine and able to conduct advanced performance...