Data Engineer
13 hours ago
• Conceptualize and own the design, implementation and operations of the next-generation data lake containing complex Genentech data from any Genentech business areas and operating within a global environment
• Conceptualize and own the data architecture for multiple large-scale projects across analytics, automation, data science and artificial intelligence, while evaluating design and operational cost-benefit tradeoffs within systems across different partnered business areas
• Solve challenging data integration problems for complicated and diverse data sets, utilizing and coding optimal ETL patterns, frameworks, query techniques, and sourcing / merging from structured and unstructured data sources
• Implement and optimize data pipelines, data quality metrics, and systems to facilitate easier development of data artifacts and support machine learning systems at scale
• Design and develop MLOps Infrastructure to build, train and deploy ML Models using cloud native services
• Design and develop secure, scalable, high-performance and reliable data and analytics solutions in a cloud platform (preferably AWS)
• Define and manage SLAs for all data sets in designated areas of ownership
• Collaborate with engineers, business managers, and data scientists from different business areas globally to understand complex data needs and provide key data insights in meaningful ways
• Identify and evaluate new technologies to improve performance, maintainability, and reliability of data systems.
Minimum Requirements
Bachelor's degree in Information Systems, Computer Science, Computer Engineering, or related field with additional experience
• 5-8 years of experience as a Data Engineer, or in a similar role
• Experience designing, evolving and running data lakes with complex data and multiple customer groups
• Experience developing data pipelines using data from heterogeneous data sources (eg. AWS, Oracle, SAP, Salesforce, etc.)
• Experience with data modeling, data warehousing, and building data pipelines
• Experience implementing and monitoring data quality metrics in a data governance environment
• Experience with MLOps
• Experience with AWS, AWS Data Engineering and MLOps tools and services (ie: S3, Redshift, Athena, Glue, Lambda, SageMaker etc)
• Experience with software development and version control systems
• Experience designing and building large-scale technology products
• Experience leading engineering discussions around technology decisions
• Ability to understand complex problems and collaboratively develop ad hoc solutions in rapidly changing environment
• Strong technical communication skills
-
San Francisco, California, United States Braintrust Data Full timeAbout Braintrust DataWe are a cutting-edge developer platform for building world-class AI products. Our innovative approach combines code and datasets, incrementally refining both using frequent evaluations. We provide a rich set of tools to visualize changes and interrogate failures, empowering developers to integrate our platform into their continuous...
-
Data Platform Systems Architect
4 weeks ago
San Francisco, California, United States VAST Data Full timeAbout VAST DataVAST Data is a pioneering company in the field of data management, revolutionizing the way enterprises capture, catalog, refine, enrich, and protect massive datasets. As a leader in enterprise software infrastructure, we empower real-time data analysis and AI training and inference.We are driven by innovation, customer-centricity, and a...
-
San Francisco, United States Amazon Data Services, Inc. Full timeThis unique vantage point allows the Design Managers to maintain a close connection with project details and drive project outcomes.You will have an impact on the design direction and ability to improve design delivery for an entire region, while establishing design procedures and protocols for the development of future systems.Responsibilities...
-
Data Engineer
2 months ago
San Francisco, United States Harnham Full timeData Engineer1 Year ContractHybrid (2 Days Onsite)$75-85/hrWe are partnered with a leading beauty retailer, delivering innovative and personalized beauty experiences to their customers. We are looking for a highly skilled Data Engineer to join the team and help enhance our data platforms and analytics capabilities. You will work with cutting-edge...
-
Data Engineer
2 months ago
san francisco, United States Harnham Full timeData Engineer1 Year ContractHybrid (2 Days Onsite)$75-85/hrWe are partnered with a leading beauty retailer, delivering innovative and personalized beauty experiences to their customers. We are looking for a highly skilled Data Engineer to join the team and help enhance our data platforms and analytics capabilities. You will work with cutting-edge...
-
Data Engineer
2 months ago
san francisco, United States Harnham Full timeData Engineer1 Year ContractHybrid (2 Days Onsite)$75-85/hrWe are partnered with a leading beauty retailer, delivering innovative and personalized beauty experiences to their customers. We are looking for a highly skilled Data Engineer to join the team and help enhance our data platforms and analytics capabilities. You will work with cutting-edge...
-
Data Engineer
18 hours ago
San Francisco, United States Legalist Full timeJob DescriptionJob DescriptionIntro description:Legalist is an institutional alternative asset management firm. Founded in 2016 and incubated at Y Combinator, the firm uses data-driven technology to invest in credit assets at scale. We are always looking for talented people to join our team.As a highly collaborative organization, our data engineers work...
-
Data Engineer
2 months ago
San Francisco, United States Legalist Full timeJob DescriptionJob DescriptionIntro description:Legalist is an institutional alternative asset management firm. Founded in 2016 and incubated at Y Combinator, the firm uses data-driven technology to invest in credit assets at scale. We are always looking for talented people to join our team.As a highly collaborative organization, our data engineers work...
-
Data Engineer
1 week ago
San Francisco, California, United States Databricks Full timeAbout the RoleWe are seeking an experienced Data Engineer to join our team at Databricks. As a Data Engineer, you will play a critical role in designing and developing scalable data processing systems that meet the needs of our customers.The ideal candidate will have 3-5 years of experience in customer-facing roles, such as Technical Account Management or...
-
Data Engineer
3 weeks ago
San Francisco, California, United States Perplexity AI Full timePerplexity AI is rapidly scaling both in number of use cases and users. We're seeking an experienced Data Engineer to help build our end-to-end data stack and flywheel.The successful candidate will collaborate closely with Product, Backend, and Data Science teams to design, build, and maintain scalable data pipelines and infrastructure. Key responsibilities...
-
Data Engineer
7 days ago
San Francisco, United States Jacobs Full timeJacobs has acquired StreetLight Data, a mobility analytics solution provider - marking the company’s second strategic acquisition in recent months and building on its strong foundation of existing technology and #data capabilities. StreetLight pioneered the use of Big Data analytics to help transportation professionals and data analysts measure, analyze...
-
Data Engineer
1 week ago
San Francisco, California, United States Tbwa ChiatDay Inc Full timeWe are seeking a skilled Data Engineer to join our talented team of engineers who share a mission to make data easily accessible. As part of our growing engineering team, you will be responsible for building and delivering world-class technology.The ideal candidate will have strong Computer Science fundamentals and 5+ years of industry experience building...
-
Data Engineer
8 hours ago
San Francisco, United States Jacobs Full timeJacobs has acquired StreetLight Data, a mobility analytics solution provider - marking the company’s second strategic acquisition in recent months and building on its strong foundation of existing technology and #data capabilities. StreetLight pioneered the use of Big Data analytics to help transportation professionals and data analysts measure, analyze...
-
Data Engineering Director
2 weeks ago
San Francisco, California, United States Unreal Gigs Full timeAbout the Role:We're seeking an experienced Data Engineering Director to join our team at Unreal Gigs. As a key member of our data engineering team, you'll be responsible for leading our data engineering efforts and driving the design, development, and maintenance of our data infrastructure and pipelines.Responsibilities:Lead Data Engineering Efforts:...
-
Data Architect
1 week ago
San Francisco, California, United States People Data Labs Full timeJob OverviewWe are a leading provider of high-quality B2B people and company data. Our innovative, fast-growing team is backed by world-class investors.Key Responsibilities:Develop self-serve product offerings to attract new customers and drive revenue growth.Design and implement core tools for our customer success team.Translate business requirements into...
-
Lead Data Engineer
5 months ago
San Francisco, United States Unreal Gigs Full timeCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning, and business intelligence. Join us...
-
Data Engineer
19 hours ago
San Francisco, United States Perplexity AI Full timeJob DescriptionJob DescriptionPerplexity is seeking an experienced Data Engineer to help revolutionize the way people search and interact online. In this role, you'll help build Perplexity's end-to-end data stack and flywheel.Perplexity is rapidly scaling both in number of use cases and number of users. Perplexity's data stack powers scalable,...
-
Data Engineer
4 weeks ago
San Francisco, United States Perplexity AI Full timeJob DescriptionJob DescriptionPerplexity is seeking an experienced Data Engineer to help revolutionize the way people search and interact online. In this role, you'll help build Perplexity's end-to-end data stack and flywheel.Perplexity is rapidly scaling both in number of use cases and number of users. Perplexity's data stack powers scalable,...
-
Data engineer
11 hours ago
San Francisco, United States Writer Corporation Full timeAbout Writer Writer is the full-stack generative AI platform delivering transformative ROI for the world's leading enterprises. Named one of the top 50 companies in AI by Forbes and one of the best places to work by Inc. Magazine, Writer empowers hundreds of customers like Accenture, Intuit, L'Oreal, Mars, Salesforce, and Vanguard to transform the way they...
-
Data Engineer
1 week ago
San Francisco, California, United States EPAM Full timeAt EPAM, we are seeking a skilled Data Engineer to join our team. With a salary range of $160K - $170K, this role is an excellent opportunity for those looking to excel in the field of machine learning.We are a global leader in digital platform engineering and development services, committed to making a positive impact on our customers, employees, and...