ML Engineer: vLLM Inference
2 weeks ago
A leading software company seeks a Machine Learning Engineer focused on vLLM Inference in Boston, MA. This role involves designing high-performance machine learning tools and collaborating on deep learning challenges. Ideal candidates are experienced in Python and Pydantic, understand LLM Inference Core Concepts, and possess strong communication skills. Enjoy comprehensive benefits and a competitive salary range of $133,650 to $220,680, tailored to qualifications.
#J-18808-Ljbffr
-
Forward Deployed Engineer, AI Inference
6 days ago
Boston, MA, United States Red Hat Full timeThe vLLM and LLM-D Engineering team at Red Hat is looking for a customer obsessed developer to join our team as a Forward Deployed Engineer . In this role, you will not just build software; you will be the bridge between our cutting-edge inference platform (LLM-D (https://llm-d.ai/) , and vLLM (https://github.com/vllm-project/vllm) ) and our customers' most...
-
Forward Deployed Engineer, AI Inference
7 days ago
Boston, MA, United States Red Hat Full timeThe vLLM and LLM-D Engineering team at Red Hat is looking for a customer obsessed developer to join our team as a Forward Deployed Engineer . In this role, you will not just build software; you will be the bridge between our cutting-edge inference platform (LLM-D (https://llm-d.ai/) , and vLLM (https://github.com/vllm-project/vllm) ) and our customers' most...
-
Forward Deployed Engineer, AI Inference
7 days ago
Boston, MA, United States Red Hat Full timeThe vLLM and LLM-D Engineering team at Red Hat is looking for a customer obsessed developer to join our team as a Forward Deployed Engineer . In this role, you will not just build software; you will be the bridge between our cutting-edge inference platform (LLM-D (https://llm-d.ai/) , and vLLM (https://github.com/vllm-project/vllm) ) and our customers' most...
-
Boston, MA, United States Red Hat Full timeJob Summary At Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. Red Hat Inference team accelerates AI for the enterprise and brings operational simplicity to GenAI deployments. As leading developers, maintainers of the vLLM and LLM-D projects, and inventors of...
-
Boston, MA, United States Red Hat Full timeJob Summary At Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. Red Hat Inference team accelerates AI for the enterprise and brings operational simplicity to GenAI deployments. As leading developers, maintainers of the vLLM and LLM-D projects, and inventors of...
-
Senior Software Engineer
2 weeks ago
Boston, MA, United States Red Hat Full timeAt Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. Red Hat Inference team accelerates AI for the enterprise and brings operational simplicity to GenAI deployments. As leading developers, maintainers of the vLLM project, and inventors of state-of-the-art techniques for...
-
Senior Software Engineer
1 week ago
Boston, MA, United States Red Hat Full timeAt Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. Red Hat Inference team accelerates AI for the enterprise and brings operational simplicity to GenAI deployments. As leading developers, maintainers of the vLLM project, and inventors of state-of-the-art techniques for...
-
Boston, MA, United States Red Hat Full timeJob Summary At Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. Red Hat Inference team accelerates AI for the enterprise and brings operational simplicity to GenAI deployments. As leading developers, maintainers of the vLLM project, and inventors of state-of-the-art...
-
Boston, MA, United States Red Hat Full timeJob Summary At Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. Red Hat Inference team accelerates AI for the enterprise and brings operational simplicity to GenAI deployments. As leading developers, maintainers of the vLLM project, and inventors of state-of-the-art...
-
Machine Learning Engineer, vLLM Inference
2 weeks ago
Boston, MA, United States Red Hat Full timeAbout the Job At Red Hat, we believe the future of AI is open, and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. The Red Hat Inference team accelerates AI for the enterprise and brings operational simplicity to GenAI deployments. As leading contributors and maintainers of the vLLM and LLM-D projects and inventors of...
