Software Engineer, GPU Infrastructure
1 week ago
This role will support the fleet infrastructure team at OpenAI. The fleet team focuses on running the world's largest, most reliable, and frictionless GPU fleet to support OpenAI's general purpose model training and deployment. Work on this team ranges from
- Maximizing GPUs doing useful work by building user-friendly scheduling and quota systems
- Running a reliable and low maintenance platform by building push-button automation for kubernetes cluster provisioning and upgrades
- Supporting research workflows with service frameworks and deployment systems
- Ensuring fast model startup times though high performance snapshot delivery across blob storage down to hardware caching
- Much more
About The Role
As an engineer within Fleet infrastructure, you will design, write, deploy, and operate infrastructure systems for model deployment and training on one of the world's largest GPU fleet. The scale is immense, the timelines are tight, and the organization is moving fast; this is an opportunity to shape a critical system in support of OpenAI's mission to advance AI capabilities responsibly.
This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees.
In This Role, You Will
- Design, implement and operate components of our compute fleet including job scheduling, cluster management, snapshot delivery, and CI/CD systems.
- Interface with researchers and product teams to understand workload requirements
- Collaborate with hardware, infrastructure, and business teams to provide a high utilization and high reliability service
You Might Thrive In This Role If You
- Have experience with hyperscale compute systems
- Possess strong programming skills
- Have experience working in public clouds (especially Azure)
- Have experience working in Kubernetes
- Execution focused mentality paired with a rigorous focus on user requirements
- As a bonus, have an understanding of AI/ML workloads
About OpenAI
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.
We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.
For additional information, please see OpenAI's Affirmative Action and Equal Employment Opportunity Policy Statement.
Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.
To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.
We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.
OpenAI Global Applicant Privacy Policy
At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.
Compensation Range: $325K - $590K
-
Infrastructure Engineer, GPU
2 days ago
San Francisco, California, United States DigitalOcean Full timeDive in and do the best work of your career at DigitalOcean. Journey alongside a strong community of top talent who are relentless in their drive to build the simplest scalable cloud. If you have a growth mindset, naturally like to think big and bold, and are energized by the fast-paced environment of a true industry disruptor, you'll find your place here....
-
Staff Engineer GPU infrastructure
1 week ago
San Francisco, California, United States DigitalOcean Full time $204,000 - $250,000 per yearDive in and do the best work of your career at DigitalOcean. Journey alongside a strong community of top talent who are relentless in their drive to build the simplest scalable cloud. If you have a growth mindset, naturally like to think big and bold, and are energized by the fast-paced environment of a true industry disruptor, you'll find your place here....
-
Software Engineer, AI Infrastructure
2 days ago
San Francisco, California, United States Eventual Full timeAbout EventualEvery breakthrough AI application, from foundation models to autonomous vehicles, relies on processing massive volumes of images, video, and complex data. But today's data platforms (like Databricks and Snowflake) are built on top of tools made for spreadsheet-like analytics, not the petabytes of multimodal data that power AI. As a result,...
-
San Francisco, California, United States OpenAI Full time $150,000 - $250,000 per yearAbout The TeamOpenAI's Inference team ensures that our most advanced models run efficiently, reliably, and at scale. We build and optimize the systems that power our production APIs, internal research tools, and experimental model deployments. As model architectures and hardware evolve, we're expanding support for a broader set of compute platforms -...
-
San Francisco, California, United States OpenAI Full time $325,000 - $490,000 per yearAbout The TeamOur Inference team brings OpenAI's most capable research and technology to the world through our products. We empower consumers, enterprises and developers alike to use and access our state-of-the-art AI models, allowing them to do things that they've never been able to before. We focus on performant and efficient model inference, as well as...
-
Infrastructure Engineer
4 days ago
San Francisco, California, United States Aldea Inc Full time $120,000 - $200,000 per yearLocation: US Remote / Bay AreaJob Type: Full-timeLevel: Mid-Level / SeniorAbout AldeaAldea is a multi-modal foundational AI company reimagining the scaling laws of intelligence. We believe today's architectures create unnecessary bottlenecks for the evolution of software. Our mission is to build the next generation of foundational models that power a more...
-
Software Engineer, Data Infrastructure
1 week ago
San Francisco, California, United States OpenAI Full time $100,000 - $120,000 per yearAbout the TeamThe Workload team is responsible for designing and running OpenAI's LLM training and inference infrastructure that powers frontier models at massive scale. Our systems unify how researchers train and serve models, abstracting away the complexity of performance, parallelism, and execution across vast GPU/accelerator fleets. By providing this...
-
Senior Infrastructure Engineer
1 week ago
San Francisco, California, United States Vast Full time $160,000 - $280,000 per yearStaff Infrastructure EngineerAbout Us's cloud powers AI projects and businesses all over the world. We are democratizing and decentralizing AI computing—reshaping our future for the benefit of humanity.We are a growing and highly motivated team dedicated to an ambitious technical plan. Our structure is flat, our ambitions are bold, and leadership is earned...
-
AI Infrastructure Engineer
4 days ago
San Francisco, California, United States PlayerZero Full time $150,000 - $250,000 per yearAbout PlayerZeroPlayerZero is building a self‑healing system for software—automating defect detection, diagnosis, and remediation so developers ship with confidence. Teams use PlayerZero to spot issues before customers do, pinpoint root causes fast, and close the loop from incident to fix.Our platform includes capabilities like Agentic Debugging and Code...
-
Software Engineer
3 days ago
San Francisco, California, United States Databricks Full timeP-1284About This RoleAs a software engineer for GenAI inference, you will help design, develop, and optimize the inference engine that powers Databricks' Foundation Model API. You'll work at the intersection of research and production, ensuring our large language model (LLM) serving systems are fast, scalable, and efficient. Your work will touch the full...