Senior ML Ops Engineer

Office Location: Lower Manhattan, NY

Accrete is a dynamic and innovative company focused on transforming the future of artificial intelligence. We specialize in creating advanced AI solutions that turn complex data into actionable insights, driving real-world impact for businesses and government organizations. Our team thrives on creativity and collaboration, working together to push the boundaries of AI technology.

At the core of our offerings are our AI agents, designed to autonomously analyze data, generate insights, and make intelligent recommendations. These agents help businesses streamline operations, improve decision-making, and also empower government entities to enhance security, intelligence, and operational efficiency

We're seeking a Senior ML Ops Engineer to join our growing AI infrastructure team. You'll design and maintain the pipelines, automation, and tooling that enable our machine learning teams to move from research to production quickly, securely, and reliably.

What You'll Do

• Architect, implement, and maintain end-to-end ML pipelines (data ingestion, training, deployment, monitoring).
• Automate model training and deployment workflows using CI/CD tools and infrastructure-as-code.
• Partner with ML Engineers and Data Scientists to operationalize models in production environments.
• Build systems for model versioning, drift detection, and continuous retraining.
• Manage cloud and on-prem environments for scalable and secure ML workloads.
• Implement observability for ML systems (logging, metrics, alerts).
• Contribute to internal tools that improve reliability, reproducibility, and compliance across our AI stack.
• Support initiatives around FedRAMP and IL4/IL5 security environments, ensuring compliance in ML pipelines.

What You'll Bring

• 5–8+ years of experience in software, DevOps, or ML Ops engineering (or equivalent).
• Deep familiarity with ML Ops platforms (e.g., MLflow, Kubeflow, Airflow, SageMaker, Vertex AI).
• Expertise with CI/CD (GitLab CI, Jenkins, etc.) and IaC tools (Terraform, CloudFormation).
• Strong experience with containerization and orchestration (Docker, Kubernetes).
• Proficiency in Python and scripting for automation.
• Experience with cloud environments (AWS preferred) and secure, multi-tenant architectures.
• Familiarity with model monitoring, data validation, and observability frameworks.
• Strong collaboration skills and a mindset for reliability, scalability, and security.
• Bonus: Experience with IL4/IL5 systems, SBOM/VEX compliance, and FedRAMP pipelines.

Salary Range: 200k-230k

The salary range provided reflects the estimated compensation for this role based on the expected qualifications and experience level. The final offer may vary depending on factors such as skills, experience, and alignment with role requirements.

Core Values & Expectations:

Impact

You take full ownership and accountability for your work, consistently seeing projects through from inception to completion with a strong bias for action. Proactively identifying challenges, you drive solutions rather than waiting for direction, and hold yourself and others to the highest standards for delivering results. With strategic thinking and a problem-solving mindset, you make informed decisions leveraging data and expertise, always looking for ways to improve processes, optimize workflows, and enhance outcomes beyond your immediate responsibilities.

Collaboration

You work seamlessly across teams, prioritizing shared goals and team success over individual credit. Engaged listening and open, candid communication are at the heart of your approach, ensuring alignment and synergy throughout the organization. You value diverse perspectives, seeking input from others to drive better results. By treating colleagues with respect and professionalism, you help build a culture of trust, supporting each other through challenges, celebrating successes, and constructively addressing conflicts to strengthen relationships and improve outcomes.

Passion for AI & Innovation

You are deeply excited about the transformative potential of AI and committed to contributing to a company shaping the future of work. With curiosity and a growth mindset, you continuously seek to learn, adapt, and stay at the forefront of new developments. Your enthusiasm for innovation drives you to explore new ideas, challenge the status quo, and find creative solutions that deliver meaningful impact. You approach your work with energy and a desire to advance both technology and the way we work.

Company Benefits

• Competitive Salary: Aligned with experience and market standards.
• Comprehensive Insurance: Health, dental, and vision coverage to keep you and your family secure.
• 401(k) Plan: Build your financial future with our retirement savings plan.
• Flexible PTO & Hybrid Work: Take time off when you need it and enjoy remote flexibility per company guidelines.
• Growth & Development: Access professional development, learning opportunities, and career advancement support.
• Onsite Perks: Enjoy catered lunches, snacks, and a stocked kitchen.
• Team Bonding: Company-sponsored happy hours and social events to connect and unwind.