Principal Software Engineer

1 day ago


Boston, United States Experis Full time

Our client, a leader in the technology sector, is seeking a Principal Software Engineer to join their team. As a Principal Software Engineer, you will be part of the Software Engineering department supporting the OpenShift AI team. The ideal candidate will have strong communication skills, a collaborative mindset, and a passion for innovation which will align successfully in the organization.

Job Title: Principal Software Engineer - Model Inference

Location: Boston, Massachusetts

Pay Range: competitve?

What's the Job?

  • Develop and maintain a high-quality, high-performing ML inference runtime platform for multi-modal and distributed model serving.
  • Contribute directly to upstream inference runtime communities such as vLLM, TGI, PyTorch, OpenVINO, and others.
  • Maintain CI/CD build pipelines for container images that allow faster, more secure, reliable, and frequent releases.
  • Coordinate and communicate with various stakeholders to ensure project alignment.
  • Apply a growth mindset by staying up to date with AI and ML advancements.
What's Needed?
  • Highly experienced with programming in Python and PyTorch.
  • Familiarity with model parallelization, quantization, and memory optimization using vLLM, TGI, and other inference libraries.
  • Experience with Python packaging such as PyPI libraries.
  • Development experience with C++, especially with the CUDA APIs is a big plus.
  • Solid understanding of the fundamentals of model inferencing architectures.
What's in it for me?
  • Opportunity to work on cutting-edge AI and ML technologies.
  • Collaborative and inclusive work environment.
  • Chance to contribute to open-source development communities.
  • Engage with a diverse team of talented engineers.
  • Professional growth and development opportunities.

If this is a role that interests you and you'd like to learn more, click apply now and a recruiter will be in touch with you to discuss this great opportunity. We look forward to speaking with you

About ManpowerGroup, Parent Company of: ?Manpower, Experis, Talent Solutions, and Jefferson Wells

ManpowerGroup? (NYSE: MAN), the leading global workforce solutions company, helps organizations transform in a fast-changing world of work by sourcing, assessing, developing, and managing the talent that enables them to win. We develop innovative solutions for hundreds of thousands of organizations every year, providing them with skilled talent while finding meaningful, sustainable employment for millions of people across a wide range of industries and skills. Our expert family of brands - Manpower, Experis, Talent Solutions, and Jefferson Wells - ?creates substantial value for candidates and clients across more than 75 countries and territories and has done so for over 70 years. We are recognized consistently for our diversity - as a best place to work for Women, Inclusion, Equality and Disability and in 2023 ManpowerGroup was named one of the World's Most Ethical Companies for the 14th year - all confirming our position as the brand of choice for in-demand talent.

  • Boston, United States BigTime Software Full time

    BigTime Software is looking to add a dynamic Principal Software Engineer to our development team in support of our Projector PSA product line. The individual in this role will collaborate extensively to design, build, and test functionality in our award-winning, cloud based system. The ideal candidate will be passionate about development and able to solve...


  • Boston, United States Snyk Ltd. Full time

    Our Opportunity The Principal Engineer role at Snyk plays a fundamental role in advancing the company's technical capabilities. They are expected to collaborate across divisions to establish fundamental technical frameworks that unify Snyk’s technical stack. These Snykers possess crucial knowledge encompassing a significant portion of the company's...


  • Boston, United States DAG Consulting Full time

    Job Number : 4436 Job Title: Principal Software Engineer Duration: 3-6 months Location: North of Boston, MA Description: The successful candidate will lead the OSMINE network management development. They will architect, design, implement, and document the TL1 agent and interface to meet the marketing requirement and fit into existing...


  • Boston, United States Wasabi Full time

    Role Description: Principal Software Engineer - Storage Role Purpose: Wasabi Technologies Inc. is seeking for a Principal Engineer - Storage to join our Software Development team. In this role, you will use your knowledge of storage devices, the Linux kernel/OS, filesystem and software development to help a team dedicated to a highly reliable, secure,...


  • Boston, United States Techpros Full time

    Our client is a successful digital media virtual events software company for the higher education industry. They are doing extremely well and need to hire due to growth and success. They are seeking a Principal Software Engineer with team leadership experience, who has experience developing real-time WebRTC based web video applications, AWS, familiar with...


  • Boston, United States ZipRecruiter Full time

    Job Description Every day, the world gets more digital thanks to tens of millions of developers building the future faster than ever. But with exponential growth comes exponential risk, as outnumbered security teams struggle to secure mountains of code. This is where Snyk (pronounced "sneak") comes in. Snyk is a developer security platform that makes it easy...


  • Boston, United States Snyk Full time

    Every day, the world gets more digital thanks to tens of millions of developers building the future faster than ever. But with exponential growth comes exponential risk, as outnumbered security teams struggle to secure mountains of code. This is where Snyk (pronounced "sneak") comes in. Snyk is a developer security platform that makes it easy for development...


  • Boston, United States Snyk Full time

    Job DescriptionJob DescriptionEvery day, the world gets more digital thanks to tens of millions of developers building the future faster than ever. But with exponential growth comes exponential risk, as outnumbered security teams struggle to secure mountains of code. This is where Snyk (pronounced "sneak") comes in. Snyk is a developer security platform that...


  • Boston, United States Wasabi Full time

    At Wasabi, we’re a proven collection of pioneers, visionaries and disruptive doers. We see things differently than our competitors, and we make our mark in the industry by challenging the norm and delivering the unexpected and improbable. We’re a fast-growing company taking the Cloud Storage industry by storm and recognized as one of the best places to...


  • Boston, United States Testing Solutions Inc Full time

    DataRobot is the leader in Value-Driven AI, a unique and collaborative approach to generative and predictive AI that combines an open platform, deep expertise and broad use-case experience to improve how organizations run, grow and optimize their business. The DataRobot AI Platform is the only complete AI lifecycle platform that interoperates with an...


  • Boston, United States Wood Mackenzie Full time

    In the middle of the energy transition, businesses and governments are faced with significant challenges. But the pace and scale of change mean every decision is made under mounting pressure. Now, more than ever, companies need reliable data, analytics and actionable insight. Wood Mackenzie is the leading global provider of data and analytics solutions for...


  • Boston, United States Wood Mackenzie Full time

    In the middle of the energy transition, businesses and governments are faced with significant challenges. But the pace and scale of change mean every decision is made under mounting pressure. Now, more than ever, companies need reliable data, analytics and actionable insight. Wood Mackenzie is the leading global provider of data and analytics solutions for...


  • Boston, MA, United States Snyk Ltd. Full time

    Our Opportunity The Principal Engineer role at Snyk plays a fundamental role in advancing the company's technical capabilities. They are expected to collaborate across divisions to establish fundamental technical frameworks that unify Snyk’s technical stack. These Snykers possess crucial knowledge encompassing a significant portion of the company's...


  • Boston, United States SimpliSafe Wireless Home Security Full time

    About SimpliSafe We're a high-tech home security company that's passionate about protecting the life you've built and our mission of keeping Every Home Secure. And we've created a culture here that cares just as deeply about the career you're building. Ours is a no ego culture of collaboration and innovation where those seeking their next challenge can find...


  • Boston, United States SimpliSafe Wireless Home Security Full time

    About SimpliSafe We're a high-tech home security company that's passionate about protecting the life you've built and our mission of keeping Every Home Secure. And we've created a culture here that cares just as deeply about the career you're building. Ours is a no ego culture of collaboration and innovation where those seeking their next challenge can find...


  • Boston, United States SimpliSafe Wireless Home Security Full time

    Principal Software Engineer - Video Team We’re a high-tech home security company that’s passionate about protecting the life you’ve built and our mission of keeping Every Home Secure. And we’ve created a culture here that cares just as deeply about the career you’re building. Ours is a no ego culture of collaboration and innovation where those...


  • Boston, United States SimpliSafe Full time

    Job DescriptionJob DescriptionAbout SimpliSafeWe're a high-tech home security company that's passionate about protecting the life you've built and our mission of keeping Every Home Secure. And we've created a culture here that cares just as deeply about the career you're building. Ours is a no ego culture of collaboration and innovation...


  • Boston, United States Veson Nautical Full time

    Description Principal Frontend Software Engineer Who we are: Veson Nautical is a well-established and rapidly growing software company working to provide end-to-end logistical, operational, and analytical solutions to propel the efficiency and effectiveness of Maritime Commerce. The Opportunity: You will be joining a highly collaborative Agile team...


  • boston, United States Techpros Full time

    Our client is a successful digital media virtual events software company for the higher education industry. They are doing extremely well and need to hire due to growth and success. They are seeking a Principal Software Engineer with team leadership experience, who has experience developing real-time WebRTC based web video applications, AWS, familiar with...


  • Boston, United States Motion Recruitment Full time

    Boston, MassachusettsHybridFull Time$160k - $180kOur client is an innovative leader in robotics, specializing in revolutionizing the automotive space. They are seeking a Principal Mechanical Engineer with a strong focus on mechatronics to join their team.As a Principal Mechanical Engineer, you will lead the design, analysis, and development of complex...