Data Engineer
13 hours ago
Legalist is an institutional alternative asset management firm. Founded in 2016 and incubated at Y Combinator, the firm uses data-driven technology to invest in credit assets at scale. We are always looking for talented people to join our team.
As a highly collaborative organization, our data engineers work cross-functionally with software engineering, data science, and product management to optimize growth and strategy of our data pipeline. In this position, you will be joining the data engineering team in an effort to take our data pipeline to the next level.
Where you come in:
- Design and develop scalable data pipelines to collect, process, and analyze large volumes of data efficiently.
- Collaborate with cross-functional teams including data scientists, software engineers, and product managers to understand data requirements and deliver solutions that meet business needs.
- Develop ELT processes to transform raw data into actionable insights, leveraging tools and frameworks such as Airbyte, BigQuery, Dagster, DBT or similar technologies.
- Participate in agile development processes, including sprint planning, daily stand-ups, and retrospective meetings, to deliver iterative improvements and drive continuous innovation.
- Apply best practices in data modeling and schema design to ensure data integrity, consistency, and efficiency.
- Continuously monitor and optimize data pipelines and systems for performance, availability, scalability, and cost-effectiveness.
What you'll be bringing to the team:
- Bachelor's degree (BA or BS) or equivalent.
- A minimum of 2 years of work experience in data engineering or similar role.
- Advanced SQL knowledge and experience working with a variety of databases (SQL, NoSQL, Graph, Multi-model).
- A minimum of 2 years professional experience with ETL//ELT, data modeling and Python.
- Familiarity with cloud environments like GCP, AWS, as well as cloud solutions like Kubernetes, Docker, BigQuery, etc.
- You have a pragmatic, data-driven mindset and are not dogmatic or overly idealistic about technology choices and trade-offs.
- You have an aptitude for learning new things quickly and have the confidence and humility to ask clarifying questions.
Even better if you have, but not necessary:
- Experience with one or more of the following: data processing automation, data quality, data warehousing, data governance, business intelligence, data visualization.
- Experience working with TB scale data.
-
San Francisco, California, United States Braintrust Data Full timeAbout Braintrust DataWe are a cutting-edge developer platform for building world-class AI products. Our innovative approach combines code and datasets, incrementally refining both using frequent evaluations. We provide a rich set of tools to visualize changes and interrogate failures, empowering developers to integrate our platform into their continuous...
-
Data Platform Systems Architect
4 weeks ago
San Francisco, California, United States VAST Data Full timeAbout VAST DataVAST Data is a pioneering company in the field of data management, revolutionizing the way enterprises capture, catalog, refine, enrich, and protect massive datasets. As a leader in enterprise software infrastructure, we empower real-time data analysis and AI training and inference.We are driven by innovation, customer-centricity, and a...
-
San Francisco, United States Amazon Data Services, Inc. Full timeThis unique vantage point allows the Design Managers to maintain a close connection with project details and drive project outcomes.You will have an impact on the design direction and ability to improve design delivery for an entire region, while establishing design procedures and protocols for the development of future systems.Responsibilities...
-
Data Engineer
2 months ago
San Francisco, United States Harnham Full timeData Engineer1 Year ContractHybrid (2 Days Onsite)$75-85/hrWe are partnered with a leading beauty retailer, delivering innovative and personalized beauty experiences to their customers. We are looking for a highly skilled Data Engineer to join the team and help enhance our data platforms and analytics capabilities. You will work with cutting-edge...
-
Data Engineer
2 months ago
san francisco, United States Harnham Full timeData Engineer1 Year ContractHybrid (2 Days Onsite)$75-85/hrWe are partnered with a leading beauty retailer, delivering innovative and personalized beauty experiences to their customers. We are looking for a highly skilled Data Engineer to join the team and help enhance our data platforms and analytics capabilities. You will work with cutting-edge...
-
Data Engineer
2 months ago
san francisco, United States Harnham Full timeData Engineer1 Year ContractHybrid (2 Days Onsite)$75-85/hrWe are partnered with a leading beauty retailer, delivering innovative and personalized beauty experiences to their customers. We are looking for a highly skilled Data Engineer to join the team and help enhance our data platforms and analytics capabilities. You will work with cutting-edge...
-
Data Engineer
7 hours ago
San Francisco, United States Saxon Global Full time• Conceptualize and own the design, implementation and operations of the next-generation data lake containing complex Genentech data from any Genentech business areas and operating within a global environment • Conceptualize and own the data architecture for multiple large-scale projects across analytics, automation, data science and artificial...
-
Data Engineer
2 months ago
San Francisco, United States Legalist Full timeJob DescriptionJob DescriptionIntro description:Legalist is an institutional alternative asset management firm. Founded in 2016 and incubated at Y Combinator, the firm uses data-driven technology to invest in credit assets at scale. We are always looking for talented people to join our team.As a highly collaborative organization, our data engineers work...
-
Data Engineer
1 week ago
San Francisco, California, United States Databricks Full timeAbout the RoleWe are seeking an experienced Data Engineer to join our team at Databricks. As a Data Engineer, you will play a critical role in designing and developing scalable data processing systems that meet the needs of our customers.The ideal candidate will have 3-5 years of experience in customer-facing roles, such as Technical Account Management or...
-
Data Engineer
3 weeks ago
San Francisco, California, United States Perplexity AI Full timePerplexity AI is rapidly scaling both in number of use cases and users. We're seeking an experienced Data Engineer to help build our end-to-end data stack and flywheel.The successful candidate will collaborate closely with Product, Backend, and Data Science teams to design, build, and maintain scalable data pipelines and infrastructure. Key responsibilities...
-
Data Engineer
7 days ago
San Francisco, United States Jacobs Full timeJacobs has acquired StreetLight Data, a mobility analytics solution provider - marking the company’s second strategic acquisition in recent months and building on its strong foundation of existing technology and #data capabilities. StreetLight pioneered the use of Big Data analytics to help transportation professionals and data analysts measure, analyze...
-
Data Engineer
1 week ago
San Francisco, California, United States Tbwa ChiatDay Inc Full timeWe are seeking a skilled Data Engineer to join our talented team of engineers who share a mission to make data easily accessible. As part of our growing engineering team, you will be responsible for building and delivering world-class technology.The ideal candidate will have strong Computer Science fundamentals and 5+ years of industry experience building...
-
Data Engineer
3 hours ago
San Francisco, United States Jacobs Full timeJacobs has acquired StreetLight Data, a mobility analytics solution provider - marking the company’s second strategic acquisition in recent months and building on its strong foundation of existing technology and #data capabilities. StreetLight pioneered the use of Big Data analytics to help transportation professionals and data analysts measure, analyze...
-
Data Architect
1 week ago
San Francisco, California, United States People Data Labs Full timeJob OverviewWe are a leading provider of high-quality B2B people and company data. Our innovative, fast-growing team is backed by world-class investors.Key Responsibilities:Develop self-serve product offerings to attract new customers and drive revenue growth.Design and implement core tools for our customer success team.Translate business requirements into...
-
Data Engineering Director
2 weeks ago
San Francisco, California, United States Unreal Gigs Full timeAbout the Role:We're seeking an experienced Data Engineering Director to join our team at Unreal Gigs. As a key member of our data engineering team, you'll be responsible for leading our data engineering efforts and driving the design, development, and maintenance of our data infrastructure and pipelines.Responsibilities:Lead Data Engineering Efforts:...
-
Lead Data Engineer
5 months ago
San Francisco, United States Unreal Gigs Full timeCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning, and business intelligence. Join us...
-
Data Engineer
4 weeks ago
San Francisco, United States Perplexity AI Full timeJob DescriptionJob DescriptionPerplexity is seeking an experienced Data Engineer to help revolutionize the way people search and interact online. In this role, you'll help build Perplexity's end-to-end data stack and flywheel.Perplexity is rapidly scaling both in number of use cases and number of users. Perplexity's data stack powers scalable,...
-
Data Engineer
13 hours ago
San Francisco, United States Perplexity AI Full timeJob DescriptionJob DescriptionPerplexity is seeking an experienced Data Engineer to help revolutionize the way people search and interact online. In this role, you'll help build Perplexity's end-to-end data stack and flywheel.Perplexity is rapidly scaling both in number of use cases and number of users. Perplexity's data stack powers scalable,...
-
Data engineer
5 hours ago
San Francisco, United States Writer Corporation Full timeAbout Writer Writer is the full-stack generative AI platform delivering transformative ROI for the world's leading enterprises. Named one of the top 50 companies in AI by Forbes and one of the best places to work by Inc. Magazine, Writer empowers hundreds of customers like Accenture, Intuit, L'Oreal, Mars, Salesforce, and Vanguard to transform the way they...
-
Data Engineer
1 week ago
San Francisco, California, United States EPAM Full timeAt EPAM, we are seeking a skilled Data Engineer to join our team. With a salary range of $160K - $170K, this role is an excellent opportunity for those looking to excel in the field of machine learning.We are a global leader in digital platform engineering and development services, committed to making a positive impact on our customers, employees, and...