Staff Software Engineer, ML Acceleration IC

4 weeks ago

Pittsburgh, Pennsylvania, United States Stack AV Full time
About Stack AV

Stack AV is revolutionizing the AI and autonomous systems landscape with its cutting-edge technology designed to enhance safety, reliability, and efficiency of modern operations. Our autonomous technology incorporates advancements in artificial intelligence, robotics, machine learning, and cloud technologies, empowering us to create innovative solutions that address the needs and challenges of the dynamic trucking transportation industry. With decades of experience creating and deploying real-world systems for demanding environments, our team is dedicated to developing an autonomous solution ecosystem tailored to the trucking industry's unique demands.

About the Team

The training and deployment team, part of the ML Platform org at Stack AV, is responsible for the platform that helps the AI team to build models, optimize, test, and deploy them on the autonomous vehicles. We are seeking an experienced and hands-on engineer for our ML acceleration team. The ideal candidate will have a deep understanding of GPUs and optimization, excellent collaboration skills, and the ability to drive technical excellence.

Responsibilities
  • Analyze and profile ML models to identify performance bottlenecks.
  • Use OSS tooling to enhance our platform to enable ML engineers to profile models and optimize them (e.g., through quantization).
  • Automate the process of exporting the model to optimized format (e.g., TensorRT) and deploying them. This including transformer-based models such as VLM models.
  • Implement optimizations using CUDA, Triton, and custom kernels.
  • Collaborate with ML researchers to balance model accuracy and speed.
  • Develop and implement efficient model export, optimization, and profiling solutions to enhance performance and streamline deployment of machine learning models across various hardware platforms.
  • Collaboration: Collaborate with cross-functional teams to understand data requirements and design appropriate solutions.
  • Technology Stack: Stay updated with the latest technologies and trends in ML inference and ML accelerators.
  • Performance Optimization: Identify and resolve performance bottlenecks in models.
  • Promote Engineering Excellence: Maintain a high bar for engineering excellence in their own work but also set a culture of engineering excellence within the team.

Qualifications

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 5+ years of experience (including experience with GPU programming and optimization).
  • Strong programming skills in C++ and Python.
  • Proven experience in GPU programming and optimization.
  • Familiarity with deep learning frameworks, especially PyTorch.
  • CUDA programming.
  • Triton language for GPU kernels.
  • PyTorch optimization techniques.
  • TensorRT implementation.
  • ONNX model conversion and deployment.
  • Custom GPU kernel development.
  • Strong analytical and problem-solving skills.
  • Excellent verbal and written communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.

We are an Equal Opportunity Employer

We believe that diverse teams produce the best ideas and outcomes. We are committed to building a culture of inclusion, entrepreneurship, and innovation across gender, race, age, sexual orientation, religion, disability, and identity.

  • Senior Staff Software Engineer, ML Acceleration Lead

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Stack AV Full time

    About Stack AVStack AV is a pioneering company in the development of revolutionary AI and advanced autonomous systems designed to enhance safety, reliability, and efficiency of modern operations. Our autonomous technology incorporates cutting-edge advancements in artificial intelligence, robotics, machine learning, and cloud technologies, empowering us to...

  • Senior Software Engineer, Machine Learning Accelerators

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Aurora Innovation Full time

    About the RoleAurora Innovation is seeking a talented Software Engineer to join our team and focus on ML Accelerators. In this role, you will work closely with our autonomy and hardware teams to understand our on-vehicle ML technology and develop perspectives on where opportunities and gaps might be in our machine learning software and hardware strategy.Key...

  • ML Ops Test Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Siri InfoSolutions Inc Full time

    Job Title: ML Ops Test EngineerJob Summary:We are seeking a highly skilled ML Ops Test Engineer to join our team at Siri InfoSolutions Inc. As an ML Ops Test Engineer, you will be responsible for ensuring the reliability, scalability, and performance of machine learning models in production.Key Responsibilities:Develop and Execute Tests: Design and implement...

  • Video Software Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States CoSM Full time

    Job Summary:Cosm is a global technology company that brings experiences to life in immersive environments. We help our partners create spaces and content that blur the lines of real and virtual across three primary markets: Sports and Entertainment, Science and Education, and Parks and Attractions. Cosm was born from the fusion of some of the greatest...

  • Machine Learning Software Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Allegheny County Full time

    We are seeking a skilled Machine Learning Software Engineer to join our team at Allegheny County Department of Human Services. As a member of our data science team, you will play a key role in building and extending our model deployment infrastructure.The ideal candidate will have a strong background in Python, software architecture, and abstract design....

  • Embedded Software Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Software Engineering Institute Full time

    About the RoleWe're seeking a talented engineer to join our team at the Software Engineering Institute. As an Embedded Software Engineer, you'll play a critical role in designing and developing software prototypes and research methods for software resilience.You'll work closely with our team to develop tools, techniques, and processes to solve some of the...

  • Senior Research Scientist Full-time Position

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Software Engineering Institute Full time

    At the Software Engineering Institute, we conduct research in applied artificial intelligence and the engineering questions related to the practical design and implementation of AI technologies and systems.We currently lead a community-wide movement to mature the discipline of AI Engineering for Defense and National Security.As our government customers adopt...

  • Staff Software Engineer, Developer Experience

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Stack AV Full time

    About StackStack AV is revolutionizing the transportation industry with cutting-edge AI and autonomous systems that enhance safety, reliability, and efficiency. Our technology combines advancements in artificial intelligence, robotics, machine learning, and cloud technologies to create innovative solutions tailored to the trucking industry's unique...

  • Staff Software Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Net Health Full time

    About Net HealthWe are a high-growth and profitable company that helps caregivers harness data for human health. Our welcoming and collaborative culture paired with progressive benefits makes Net Health the ultimate career home.As a leading-edge SaaS company in healthcare, we deliver solutions that help patients get better, faster, and live more fulfilling...

  • Senior Machine Learning Research Scientist

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Software Engineering Institute Full time

    At the Software Engineering Institute, we conduct research in applied artificial intelligence and the engineering questions related to the practical design and implementation of AI technologies and systems. We currently lead a community-wide movement to mature the discipline of AI Engineering for Defense and National Security.As our government customers...

  • Software Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Software Engineering Institute Full time

    Job SummaryWe are seeking a highly skilled Software Engineer to join our Advanced Computing Lab team at the Software Engineering Institute. As a key member of our team, you will apply the latest software and advanced computing research and leading-edge technologies to important and challenging government problems and needs.Key ResponsibilitiesDesign and...

  • Senior Staff Software Engineer, AI Data Infra Lead

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Stack AV Full time

    About Stack:Stack AV is a pioneering company in the development of revolutionary AI and advanced autonomous systems designed to enhance safety, reliability, and efficiency of modern operations. Our autonomous technology incorporates cutting-edge advancements in artificial intelligence, robotics, machine learning, and cloud technologies, empowering us to...

  • Staff Software Architect

    3 weeks ago

    Pittsburgh, Pennsylvania, United States Aurora Innovation Full time

    About the RoleAurora is seeking a highly skilled Staff Software Engineer to join our SSA - System Software Architecture Team. As a Staff Software Engineer, you will play a key role in designing, developing, and testing onboard software that spans application, middleware, and OS layers.Key Responsibilities:Design and develop onboard software using C++Develop...

  • Software Development Technical Leader

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Software Engineering Institute Full time

    Job Summary:We are seeking a highly skilled Software Development Technical Leader to lead our development team in crafting high-performance software solutions. The ideal candidate will have significant experience in full software lifecycle development, the ability to analyze source code, and mentor others on the construction process.Key Responsibilities:Lead...

  • Senior Software Development Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Envision Full time

    Job Summary:We are seeking a highly skilled Senior Software Development Engineer (Embedded Systems) to join our team at Envision. This position will be responsible for performing software development of medical devices to deliver high-quality products that meet or exceed customer expectations and meet FDA design controls.Key Responsibilities:Develop software...

  • Staff Software Engineer, Motion Planning AI Specialist

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Stack AV Full time

    About Stack AV: Stack AV is a leading developer of revolutionary AI and advanced autonomous systems designed to enhance safety, reliability, and efficiency of modern operations.Our autonomous technology incorporates cutting-edge advancements in artificial intelligence, robotics, machine learning, and cloud technologies, empowering us to create innovative...

  • Senior Software Developer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Software Engineering Institute Full time

    About the Role:The Software Engineering Institute (SEI) is seeking a highly skilled Sr. Software Developer to join our team. As a key member of our software development team, you will be responsible for designing and developing software prototypes, researching methodologies for software resilience, and developing methodologies to advance the practice of...

  • Senior Embedded Software Developer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Software Engineering Institute Full time

    About the RoleWe are seeking a skilled software engineer to join our team at the Software Engineering Institute. As an embedded software systems engineer, you will be responsible for designing and developing software prototypes and research methods for software resilience.Key ResponsibilitiesDesign embedded software tools and capabilities, including software...

  • Senior Embedded Software Developer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Software Engineering Institute Full time

    About the RoleWe are seeking a skilled Senior Embedded Software Developer to join our team at the Software Engineering Institute. As a key member of our team, you will design and develop software prototypes and research methods for software resilience.Key Responsibilities:Design and develop embedded software tools and capabilities, including software...

  • Staff Software Engineer

    3 weeks ago

    Pittsburgh, Pennsylvania, United States Omnicell Full time

    Transform Pharmacy Care with OmnicellOmnicell is a leader in pharmacy automation, and we're seeking a highly skilled Staff Software Engineer - Computer Vision Expert to join our team. As a key member of our engineering team, you will play a crucial role in developing advanced workflow capabilities with integrated vision recognition, perception, and...