Software Engineer, ML Data/Analytics, Observability
2 weeks ago
About the TeamThe Research Platform Analytics team designs, builds, and operates the critical foundational data and analytics infrastructure that enables research at OpenAI.Our goal is one, and one only: accelerate the progress of research towards AGI. We do this by owning critical components of the research training stack, starting from key data processing pipelines and complex libraries that directly feed into our distributed training, followed by a variety of observability and analytics systems aimed at providing quality signals about our research, as well as an important series of components to handle data lifecycle at scale.About the RoleAs we scale up with more researchers and engineers joining OpenAI, we seek a pragmatic and passionate engineer with a strong focus on the experience for both engineers and scientists that work in our large data sets. Some examples of the work we do include making sure we have robust data processing pipelines that carry observability metrics and other important signals, highly effective observability systems for our researchers to reason about the quality of our research, and various data lifecycle management projects centered around efficiency, security and scale.You will find yourself at home if you are comfortable with work such as scaling Kubernetes services, debugging Kafka consumer lag, diagnosing various distributed systems failures, and developing a new end-to-end data processing pipeline, all the way from raw data capture to bespoke analytics leveraging a data warehouse or a stream processing framework. If you have previous experience with dealing with data processing and transformations during pre-training, this is also a role for you.This role is based in San Francisco, CA or open to being remote within the US. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees.In this role, you will:Participate in architecture and engineering decisions, bringing your strong experience and knowledge to bear.Ensure the security, integrity, and compliance of data according to industry and company standards.Ensure our analytics and data platforms can scale reliably to the next several orders of magnitudeAccelerate company productivity by empowering your fellow engineers, researchers, and teammates with excellent data tooling and systems, providing a best in case experienceBring new features and capabilities to the world by partnering with product engineers, trust & safety and other teams to build the technical foundationsLike all other teams, we are responsible for the reliability of the systems we build. This includes an on-call rotation to respond to critical incidents as neededYou might thrive in this role if you have:Experience in building stream and batch data processing pipelines, using technologies such as, or equivalent to, Kafka, Spark, Flink.Proficient with modern infrastructure management tools, such as Kubernetes and Terraform.Have a passion for observability systems (bonus if for ML training). You are excited by the idea of building bespoke analytics systems that provide answers to key ML research questions.Have worked in a ML training organization and have experience with the problem of data transformation during pre-training.Are a proficient software engineer, ideally in Python, and are used to working with large monorepo codebases.Have worked on data lifecycle management systems for large organizations, and dealt with the problems of access control, provenance, auditing, data movement at scale, metadata management, etc.Are a self-starter and are comfortable operating in a fast-paced environment.About OpenAIOpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or any other legally protected status. For US Based Candidates: Pursuant to the San Francisco Fair Chance Ordinance, we will consider qualified applicants with arrest and conviction records.We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.OpenAI Global Applicant Privacy PolicyAt OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.
-
Software Engineer, Analytics Platform
1 week ago
San Francisco, United States OpenAI Full timeAbout the Team The Research Platform Analytics team designs, builds, and operates the critical foundational data and analytics infrastructure that enables research at OpenAI. Our goal is one, and one only: accelerate the progress of research towards AGI. We do this by owning critical components of the research training stack, starting from key data...
-
Analytics Data Engineer
4 days ago
South San Francisco, United States Claritas Rx Full timeWho We AreClaritas Rx is a venture-backed digital health startup that brings clarity to the challenges of specialty biopharmaceutical products in the marketplace. In today’s highly complex specialty networks, our mission is to illuminate the patient experience beyond the clinical trial. Claritas Rx leverages a proprietary technology platform and deep...
-
Analytics Data Engineer
7 days ago
South San Francisco, United States Claritas Rx Full timeWho We AreClaritas Rx is a venture-backed digital health startup that brings clarity to the challenges of specialty biopharmaceutical products in the marketplace. In today’s highly complex specialty networks, our mission is to illuminate the patient experience beyond the clinical trial. Claritas Rx leverages a proprietary technology platform and deep...
-
Analytics Data Engineer
1 week ago
South San Francisco, United States Claritas Rx Full timeWho We AreClaritas Rx is a venture-backed digital health startup that brings clarity to the challenges of specialty biopharmaceutical products in the marketplace. In today’s highly complex specialty networks, our mission is to illuminate the patient experience beyond the clinical trial. Claritas Rx leverages a proprietary technology platform and deep...
-
Software Engineer, ML Infrastructure
4 days ago
San Francisco, United States Twelvelabs Full timeWho we are We’re a fast-moving, diverse team pushing the frontiers of artificial intelligence. At Twelve Labs, our mission is to help developers build programs that can see, listen, and understand the world as we do by bringing the world’s most powerful video understanding infrastructure to market. As a part of achieving this mission, we are building...
-
Sr. Backend Software Engineer
4 weeks ago
San Francisco, United States Abnormal Security Full timeJob DescriptionJob DescriptionAbout the RoleAbnormal Security is looking for a Senior ML Infra Engineer to join the Detection Team. The Detection Division is focused on building the world's most advanced technology for identifying and stopping email and cloud-based attacks that were previously undetectable and help make the world a safer place. As an ML...
-
San Francisco, CA, United States Discord Full timeDiscord is about giving people the power to create space to find belonging in their lives. We want to make it easier for you to talk regularly with the people you care about. We want you to build genuine relationships with your friends and communities close to home or around the world. Original, reliable, playful, and relatable. These are the values that...
-
Senior ML Engineer
2 weeks ago
San Antonio, United States JobRialto Full timePosition Summary We are seeking a highly skilled and experienced Sr. Machine Learning Engineer / Data Scientist to join our dynamic Data Science and AI team. In this role, you will be instrumental in transforming data into actionable insights and innovative solutions, driving forward our business strategy. You will leverage advanced machine learning,...
-
Senior ML Engineer
4 days ago
San Antonio, United States JobRialto Full timePosition Summary We are seeking a highly skilled and experienced Sr. Machine Learning Engineer / Data Scientist to join our dynamic Data Science and AI team. In this role, you will be instrumental in transforming data into actionable insights and innovative solutions, driving forward our business strategy. You will leverage advanced machine learning,...
-
AI/ML Engineering Manager
2 days ago
San Francisco, United States BayOne Solutions Full timeThis is an opportunity for a Machine Learning Engineering Manager to come in and drive Data Science and ML initiatives for the enterprise. Our Client continues to inspire our loyal customers in beauty space and AI/ML is redefining the way we inspire our customers.Some exciting initiatives in action:Generative AI use cases to help our customers discover...
-
AI/ML Engineering Manager
3 days ago
San Francisco, United States BayOne Solutions Full timeThis is an opportunity for a Machine Learning Engineering Manager to come in and drive Data Science and ML initiatives for the enterprise. Our Client continues to inspire our loyal customers in beauty space and AI/ML is redefining the way we inspire our customers.Some exciting initiatives in action:Generative AI use cases to help our customers discover...
-
AI/ML Engineering Manager
3 days ago
San Francisco, United States BayOne Solutions Full timeThis is an opportunity for a Machine Learning Engineering Manager to come in and drive Data Science and ML initiatives for the enterprise. Our Client continues to inspire our loyal customers in beauty space and AI/ML is redefining the way we inspire our customers.Some exciting initiatives in action:Generative AI use cases to help our customers discover...
-
San Francisco, CA, United States Discord Full timeDiscord is about giving people the power to create space to find belonging in their lives. We want to make it easier for you to talk regularly with the people you care about. We want you to build genuine relationships with your friends and communities close to home or around the world. Original, reliable, playful, and relatable. These are the values that...
-
Machine Learning Engineer
2 weeks ago
San Francisco, United States Triunity Software Full timeJD :- In this role you will build optimized, efficient and reliable products, services and interfaces to federate access to data stores, simplify, automate and manage the ML development and deployment ecosystem. Specifically, you will develop tooling and services to deploy, host and serve ML models at scale. Responsibilities: • Design and develop...
-
Senior Data Engineer
2 weeks ago
San Francisco, United States Nightfall AI Full timeNightfall makes safeguarding sensitive data for every application simple and seamless. Organizations, from startups to global brands, trust Nightfall's software platform and APIs to discover, classify, and protect sensitive data. We're looking for a Senior Data Engineer to enhance Nightfall's core data models and infrastructure supporting our real-time and...
-
Senior Data Engineer
4 weeks ago
San Francisco, California, United States Nightfall AI Full timeNightfall makes safeguarding sensitive data for every application simple and seamless. Organizations, from startups to global brands, trust Nightfall's software platform and APIs to discover, classify, and protect sensitive data.We're looking for a Senior Data Engineer to enhance Nightfall's core data models and infrastructure supporting our real-time and...
-
AI/ML Manager
3 days ago
San Francisco, United States BayOne Solutions Full timeAI/ML Engineering Manager (FT)Location: San Francisco, CA (2-3 days onsite in a week)Duration: Full timeAs Manager of Machine Learning engineering team, you will work on a broad set of domains that power a data-driven transformation of our standard business procedures across channels. You will build end to end ML systems and operationalize them to maximize...
-
AI/ML Manager
2 days ago
San Francisco, United States BayOne Solutions Full timeAI/ML Engineering Manager (FT)Location: San Francisco, CA (2-3 days onsite in a week)Duration: Full timeAs Manager of Machine Learning engineering team, you will work on a broad set of domains that power a data-driven transformation of our standard business procedures across channels. You will build end to end ML systems and operationalize them to maximize...
-
Product Analytics Data Scientist
3 weeks ago
San Francisco, United States Intelliswift Software Inc Full timeCustomer Job Product Analytics Data Scientist Job ID: 24-01904 Product Analytics Data Scientist San Francisco, CA or Seattle, WA Hybrid Duration • 12 Months Pay rate • $104.23 per hour on W2 Drive analysis on various projects to improve the experience of our users. Own data analysis, visualization and communicate the...
-
Software Engineer
2 weeks ago
San Francisco, United States eTeam Inc. Full timeRole: Software Engineer Location: 100% remote Duration: 6+ Months Job description: The engineer in this role will be responsible for Maintaining and improving several systems and pipelines that process large amounts of data through various types of ML models. Occasionally making changes to these systems either for business or for regulatory purposes,...
