Senior Director of Engineering, AI Workload Orchestration

6 months ago

Santa Clara, United States Oracle Full time

Here at OCI we’re building the world’s largest AI clusters and we’re the fastest at bringing them to market. The AI Infrastructure organization at OCI is leading this effort.

As part of this focus on AI workloads and customers we’re building platforms for AI job management services and AI workload management, from reinforcement learning to deep learning to tuning and model serving. These platforms will give AI researchers simple, easy to use tools that take care of managing the GPU clusters they have across the full model lifecycle. These platforms will eliminate devops efforts and costs in cluster management, scheduling and observability and significantly lower the bar for infrastructure management expertise for our AI customers. It will make our AI capabilities easily accessible to more customers and will enable our largest customers to focus on improving and monetizing their AI models rather than managing the AI infrastructure.

In this role you would lead the software development organization building out and operating these platforms and work with some of the largest players in the AI space building systems that operate at unprecedented speed, scale and reliability. You should be a distributed systems generalist, able to architect broad systems interactions, while being very hands-on, able to dive deep into any part of the stack and lower-level system interactions. You should value simplicity and scale, work comfortably in a collaborative, agile environment, and be excited to learn.

Career Level - M5

The candidate will be responsible for providing leadership, direction and strategy, establishing and development of the organization to meet and execute on strategy. The candidate will also be working with geographically distributed teams and contribute to the success of theirs and of other related teams in delivering large scale projects on-time with the high quality

Required Qualifications 

MS or BS in Computer Science, or equivalent experience 5+ years of experience managing Software Engineering teams. 12+ years of software engineering experience Strong communication skills, analytical skills, and project management skills

Preferred Qualifications:

7 - 10+ years’ experience delivering and operating large scale, highly available distributed systems. Strong knowledge of data structures, algorithms, operating systems, and distributed systems fundamentals. Working familiarity with networking protocols (TCP/IP, HTTP) and standard network architectures. Strong experience and detailed technical knowledge in distributed systems, high performance computing and GPU systems. Experience in AI model training infrastructure. Disclaimer:

Certain US customer or client-facing roles may be required to comply with applicable requirements, such as immunization and occupational health mandates.

Range and benefit information provided in this posting are specific to the stated locations only

US: Hiring Range: from $142,900 to $338,600 per annum. May be eligible for bonus, equity, and compensation deferral.

Oracle maintains broad salary ranges for its roles in order to account for variations in knowledge, skills, experience, market conditions and locations, as well as reflect Oracle’s differing products, industries and lines of business.
Candidates are typically placed into the range based on the preceding factors as well as internal peer equity.

Oracle US offers a comprehensive benefits package which includes the following:
1. Medical, dental, and vision insurance, including expert medical opinion
2. Short term disability and long term disability
3. Life insurance and AD&D
4. Supplemental life insurance (Employee/Spouse/Child)
5. Health care and dependent care Flexible Spending Accounts
6. Pre-tax commuter and parking benefits
7. 401(k) Savings and Investment Plan with company match
8. Paid time off: Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week, the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment. Vacation accrual is prorated for employees working between 20 and 34 hours per week. Employees working fewer than 20 hours per week are not eligible for vacation.
9. 11 paid holidays
10. Paid sick leave: 72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours.
11. Paid parental leave
12. Adoption assistance
13. Employee Stock Purchase Plan
14. Financial planning and group legal
15. Voluntary benefits including auto, homeowner and pet insurance

The role will generally accept applications for at least three calendar days from the posting date or as long as the job remains posted.

  • Senior Director of Engineering, AI Workload Orchestration

    1 month ago

    Santa Clara, California, United States Oracle Full time

    Lead the Future of AI Workload OrchestrationOracle is seeking a highly experienced Senior Director of Engineering to lead the development and operation of our AI workload orchestration platforms. As a key member of our AI Infrastructure organization, you will be responsible for building and managing a team of software engineers to design, develop, and deploy...

  • Senior Solution Architect, HPC and AI

    2 weeks ago

    Santa Clara, United States NVIDIA Full time

    Do you want to be part of the team that brings Artificial Intelligence (AI) emerging technology to the field? We are looking for a hardworking Solution Architect (SA) to join the NVIDIA AI Enterprise (NVAIE) SA Segment Team. The mission of the NVAIE Segment team is to guide and enable the successful adoption at scale of NVIDIA AI Enterprise Software in...

  • Senior Developer Technology Engineer

    4 weeks ago

    Santa Clara, United States NVIDIA Full time

    We’re currently seeking a Senior Developer Technology Engineer, Artificial IntelligenceWould you enjoy researching parallel algorithms to accelerate AI workloads on advanced computer architectures? Is it rewarding to investigate, find, and eliminate system bottlenecks to achieve the best possible performance of computer hardware? Could you be thrilled...

  • Senior Software Engineer, AI Platform

    4 weeks ago

    Santa Clara, United States NVIDIA Full time

    We are now looking for a senior software engineer for our Robotics Team! For two decades, we have pioneered visual computing, the art and science of computer graphics. With our invention of the GPU - the engine of modern visual computing - the field has expanded to encompass video games, movie production, research, and autonomous machines. The team is...

  • Senior Product Manager

    1 month ago

    Santa Clara, California, United States NVIDIA Full time

    Job SummaryNVIDIA's Datacenter Ethernet Business is seeking a strong Senior Product Manager to lead and grow our portfolio in Network Analytics & Orchestration. As a Product Manager, you will mold NVIDIA's next generation of innovative Orchestration and telemetry systems.Key ResponsibilitiesManage a network orchestration system through the complete life...

  • AI Software Engineer

    4 weeks ago

    Santa Clara, United States Rivos Full time

    Open position for AI Software development at a fast-moving startup. Potential Responsibilities Build-up components of an AI Software Stack Port AI Software to run on a new H/W platform Profiling and tuning of AI applications Implement math operators used in AI Build up infrastructure to validate AI models running on a new H/W platform Requirements ...

  • AI Software Engineer

    27 minutes ago

    Santa Clara, United States Rivos Full time

    Open position for AI Software development at a fast-moving startup. Potential Responsibilities Build-up components of an AI Software Stack Port AI Software to run on a new H/W platform Profiling and tuning of AI applications Implement math operators used in AI Build up infrastructure to validate AI models running on a new H/W platform Requirements ...

  • Senior Software Engineer, AI

    2 weeks ago

    Santa Clara, California, United States Couchbase Full time

    Empower Modern ApplicationsEvery day, we tackle new and exciting challenges to empower developers to build modern cloud, mobile, and edge applications that deliver a premium user experience. Couchbase's fast, flexible, and affordable cloud database platform, Capella, enables organizations to quickly build applications that deliver premium experiences to...

  • AI Software Development Engineer

    4 weeks ago

    Santa Clara, California, United States Rivos Full time

    Job Title: AI Software Development EngineerAbout the Role:We are looking for a highly skilled AI Software Development Engineer to join our team at Rivos. As a key member of our silicon, software, and platform design team, you will be responsible for building and maintaining our AI software stack. Key Responsibilities:* Build-up components of an AI Software...

  • Senior LLM Research Engineer

    4 weeks ago

    Santa Clara, California, United States NVIDIA Full time

    Job SummaryWe are seeking a skilled engineer to join our team and help shape the future of agentic inference systems. As a Senior LLM Research Engineer, you will play a critical role in improving the algorithmic performance and efficiency of large language models.Responsibilities:Research and development of contemporary research on generative AI, agents, and...

  • Senior Software Engineer

    3 weeks ago

    Santa Clara, United States NVIDIA Full time

    NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were...

  • Principal AI Architect

    2 months ago

    Santa Clara, United States E-Solutions Full time

    Title: Principal AI ArchitectSeniority: Director/HeadLocation: Santa, Clara, CA, and New Jersey-Onsitecandidates need to work onsite in the Client's AI Lab AWS or GCP or Azure background(Preferred)Employment:- Full-Time(Long Term) Position SummaryThe Principal AI Architect is responsible for leading the design and implementation of advanced AI solutions and...

  • Principal AI Architect

    1 month ago

    santa clara, United States E-Solutions Full time

    Title: Principal AI ArchitectSeniority: Director/HeadLocation: Santa, Clara, CA, and New Jersey-Onsitecandidates need to work onsite in the Client's AI Lab AWS or GCP or Azure background(Preferred)Employment:- Full-Time(Long Term) Position SummaryThe Principal AI Architect is responsible for leading the design and implementation of advanced AI solutions and...

  • Principal AI Architect

    1 month ago

    santa clara, United States E-Solutions Full time

    Title: Principal AI ArchitectSeniority: Director/HeadLocation: Santa, Clara, CA, and New Jersey-Onsitecandidates need to work onsite in the Client's AI Lab AWS or GCP or Azure background(Preferred)Employment:- Full-Time(Long Term) Position SummaryThe Principal AI Architect is responsible for leading the design and implementation of advanced AI solutions and...

  • Senior Software Engineer, AI Platform

    2 months ago

    US, CA, Santa Clara NVIDIA Full time

    We are now looking for a senior software engineer for our Robotics Team! For two decades, we have pioneered visual computing, the art and science of computer graphics. With our invention of the GPU - the engine of modern visual computing - the field has expanded to encompass video games, movie production, research, and autonomous machines. The team is...

  • Senior Software Engineer

    4 weeks ago

    Santa Clara, United States NVIDIA Full time

    We are now looking for a senior software engineer for our Robotics Team! For two decades, we have pioneered visual computing, the art and science of computer graphics. With our invention of the GPU - the engine of modern visual computing - the field has expanded to encompass video games, movie production, research, and autonomous machines. The team is...

  • Senior Performance Engineer

    4 weeks ago

    Santa Clara, United States NVIDIA Full time

    NVIDIA is hiring senior software engineers to build and optimize the tools Deep Learning engineers use across the world to design, develop, and deploy AI applications. We are an ambitious, forward-thinking and diverse team that influences all areas of NVIDIA's AI platform and directly contributes to premiere Deep Learning frameworks - PyTorch, JAX and...

  • Senior Performance Engineer

    3 weeks ago

    Santa Clara, United States NVIDIA Full time

    NVIDIA is hiring senior software engineers to build and optimize the tools Deep Learning engineers use across the world to design, develop, and deploy AI applications. We are an ambitious, forward-thinking and diverse team that influences all areas of NVIDIA's AI platform and directly contributes to premiere Deep Learning frameworks - PyTorch, JAX and...

  • Senior Software Engineer, AI Platform

    3 weeks ago

    Santa Clara, CA, United States NVIDIA Full time

    We are now looking for a senior software engineer for our Robotics Team! For two decades, we have pioneered visual computing, the art and science of computer graphics. With our invention of the GPU - the engine of modern visual computing - the field has expanded to encompass video games, movie production, research, and autonomous machines. The team is...

  • Technical Marketing Director

    1 month ago

    Santa Clara, California, United States Advanced Micro Devices , Inc. Full time

    Transforming Lives with AMD TechnologyWe are dedicated to enriching our industry, communities, and the world through innovative AMD technology. Our mission is to create exceptional products that accelerate next-generation computing experiences, including the data center, artificial intelligence, PCs, gaming, and embedded solutions.The Role:We seek a highly...