LLMOps Engineer

We are seeking a highly skilled LLMOps Engineer to join our team at Vertiv. As a key member of our organization, you will play a crucial role in building and maintaining the infrastructure and pipelines for cutting-edge Large Language Models (LLMs), working closely with Generative AI Architects.

• Conceptualize, Develop, and Execute: Design, develop, and execute Machine Learning (ML)/LLM pipelines specifically for Large Language Models, including data acquisition, pre-processing, model training/tuning, deployment, and monitoring.
• Automation and Streamlining: Utilize automation tools such as GitOps, CI/CD pipelines, and containerization technologies (Docker, Kubernetes) to streamline ML/LLM tasks across the Large Language Model lifecycle.
• Monitoring and Alerting: Establish robust monitoring and alerting systems to track Large Language Model performance, data drift, and other key metrics, proactively identifying and resolving issues.
• Truth Analysis: Perform truth analysis to assess the accuracy and effectiveness of Large Language Model outputs, comparing them to known, accurate data.
• Collaboration and Communication: Collaborate closely with infrastructure, DevOps teams, and Generative AI Architects to optimize model performance and resource utilization, and communicate effectively with both technical and non-technical stakeholders.
• Cloud Infrastructure Management: Oversee and maintain cloud infrastructure (AWS, Azure) specifically for Large Language Model workloads, ensuring cost-efficiency and scalability.
• Staying Current: Stay current with the latest advancements in ML/LLM Ops, integrating these developments into generative AI platforms and processes.

• Education and Experience: Bachelor's or Master's degree in Computer Science, Engineering or similar, and at least 5 years of experience as an ML engineer within public cloud platforms.
• Technical Skills: Strong programming skills in Python and/or other languages, expertise in cloud platforms (AWS, Azure) for ML workloads, MLOps, DevOps, or Data Engineering, and proven experience in MLOps, LLMOps, or related roles.
• Generative AI Knowledge: Familiarity with generative AI applications and domains such as content creation, data augmentation, style transfer, and strong knowledge of Generative AI architectures and methods.

Vertiv is a global critical infrastructure and data center technology company that ensures customers' vital applications run continuously by bringing together hardware, software, analytics, and ongoing services. Our portfolio includes power, cooling, and IT infrastructure solutions and services that extend from the cloud to the edge of the network.