Senior Staff Software Engineer, ML Acceleration Lead

4 weeks ago

Pittsburgh, Pennsylvania, United States Stack AV Full time
About Stack AV

Stack AV is a pioneering company in the development of revolutionary AI and advanced autonomous systems designed to enhance safety, reliability, and efficiency of modern operations. Our autonomous technology incorporates cutting-edge advancements in artificial intelligence, robotics, machine learning, and cloud technologies, empowering us to create innovative solutions that address the needs and challenges of the dynamic trucking transportation industry. With decades of experience creating and deploying real-world systems for demanding environments, our team is dedicated to developing an autonomous solution ecosystem tailored to the trucking industry's unique demands.

About the Team

The training and deployment team, part of the ML Platform org at Stack AV, is responsible for the platform that helps the AI team to build models, optimize, test, and deploy them on the autonomous vehicles. We are seeking an experienced, visionary, and hands-on technical lead for our ML acceleration team. This role will be responsible for designing the architecture and leading a team to automate the optimization and deployment on complex ML models (including transformer-based models such as VLM models) for all the next-gen AI Autonomous Vehicle applications in the company. The ideal candidate will have a deep understanding of GPUs and optimization, excellent leadership skills, and the ability to drive technical excellence.

Responsibilities
  • Analyze and profile ML models to identify performance bottlenecks.
  • Use OSS tooling to enhance our platform to enable ML engineers to profile models and optimize them (e.g., through quantization).
  • Automate the process of exporting the model to optimized format (e.g., TensorRT) and deploying them.
  • Implement optimizations using CUDA, Triton, and custom kernels.
  • Collaborate with ML researchers to balance model accuracy and speed.
  • Lead efforts within the team as well as cross-team projects related to model optimization and deployment.
  • Collaborate with cross-functional teams to understand data requirements and design appropriate solutions.
  • Stay updated with the latest technologies and trends in ML inference and ML accelerators.
  • Identify and resolve performance bottlenecks in models.
  • Set a culture of engineering excellence within the team and work closely with the management and customer teams to balance between speed of delivery and quality of engineering artifacts.

Qualifications

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 5+ years of experience in GPU programming and optimization.
  • Strong programming skills in C++ and Python.
  • Proven experience in GPU programming and optimization.
  • Familiarity with deep learning frameworks, especially PyTorch.
  • CUDA programming.
  • Triton language for GPU kernels.
  • PyTorch optimization techniques.
  • TensorRT implementation.
  • ONNX model conversion and deployment.
  • Custom GPU kernel development.
  • Deep understanding of GPU architectures and performance optimization.
  • Proven ability to lead and mentor a team, manage projects, and drive technical initiatives.
  • Strong analytical and problem-solving skills.
  • Excellent verbal and written communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.

Equal Opportunity Employer

We are proud to be an equal opportunity workplace. We believe that diverse teams produce the best ideas and outcomes. We are committed to building a culture of inclusion, entrepreneurship, and innovation across gender, race, age, sexual orientation, religion, disability, and identity.

  • Staff Software Engineer, ML Acceleration IC

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Stack AV Full time

    About Stack AVStack AV is revolutionizing the AI and autonomous systems landscape with its cutting-edge technology designed to enhance safety, reliability, and efficiency of modern operations. Our autonomous technology incorporates advancements in artificial intelligence, robotics, machine learning, and cloud technologies, empowering us to create innovative...

  • Senior Software Engineer, Machine Learning Accelerators

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Aurora Innovation Full time

    About the RoleAurora Innovation is seeking a talented Software Engineer to join our team and focus on ML Accelerators. In this role, you will work closely with our autonomy and hardware teams to understand our on-vehicle ML technology and develop perspectives on where opportunities and gaps might be in our machine learning software and hardware strategy.Key...

  • Senior Research Scientist Full-time Position

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Software Engineering Institute Full time

    At the Software Engineering Institute, we conduct research in applied artificial intelligence and the engineering questions related to the practical design and implementation of AI technologies and systems.We currently lead a community-wide movement to mature the discipline of AI Engineering for Defense and National Security.As our government customers adopt...

  • Senior Machine Learning Research Scientist

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Software Engineering Institute Full time

    At the Software Engineering Institute, we conduct research in applied artificial intelligence and the engineering questions related to the practical design and implementation of AI technologies and systems. We currently lead a community-wide movement to mature the discipline of AI Engineering for Defense and National Security.As our government customers...

  • Senior Staff Software Engineer, AI Data Infra Lead

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Stack AV Full time

    About Stack:Stack AV is a pioneering company in the development of revolutionary AI and advanced autonomous systems designed to enhance safety, reliability, and efficiency of modern operations. Our autonomous technology incorporates cutting-edge advancements in artificial intelligence, robotics, machine learning, and cloud technologies, empowering us to...

  • Machine Learning Software Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Allegheny County Full time

    We are seeking a skilled Machine Learning Software Engineer to join our team at Allegheny County Department of Human Services. As a member of our data science team, you will play a key role in building and extending our model deployment infrastructure.The ideal candidate will have a strong background in Python, software architecture, and abstract design....

  • ML Ops Test Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Siri InfoSolutions Inc Full time

    Job Title: ML Ops Test EngineerJob Summary:We are seeking a highly skilled ML Ops Test Engineer to join our team at Siri InfoSolutions Inc. As an ML Ops Test Engineer, you will be responsible for ensuring the reliability, scalability, and performance of machine learning models in production.Key Responsibilities:Develop and Execute Tests: Design and implement...

  • Senior Software Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States TTI of USA, Inc. Full time

    Job Description:At TTI of USA, Inc., we are seeking a highly skilled Senior Software Engineer to lead our application software development efforts. This role involves providing technical support in situations of moderate complexity, as well as being responsible for requirements gathering and BRD/SRD preparation.The ideal candidate will have a thorough...

  • Senior Software Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States TTI of USA, Inc. Full time

    Job Summary:TTI of USA, Inc. is seeking a highly skilled Senior Software Engineer to lead the development of complex application software. The ideal candidate will have a strong background in software development, excellent problem-solving skills, and the ability to work effectively in a team environment.Key Responsibilities:Design, code, test, and implement...

  • Video Software Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States CoSM Full time

    Job Summary:Cosm is a global technology company that brings experiences to life in immersive environments. We help our partners create spaces and content that blur the lines of real and virtual across three primary markets: Sports and Entertainment, Science and Education, and Parks and Attractions. Cosm was born from the fusion of some of the greatest...

  • Senior Embedded Software Developer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Software Engineering Institute Full time

    About the RoleWe are seeking a skilled Senior Embedded Software Developer to join our team at the Software Engineering Institute. As a key member of our team, you will design and develop software prototypes and research methods for software resilience.Key Responsibilities:Design and develop embedded software tools and capabilities, including software...

  • Senior Software Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Eliassen Group Full time

    W2 Contract RoleW2 ONLY NO SPONSORSHIP NO C2CHybrid in Pittsburgh, PAJob SummaryEliassen Group is seeking a skilled Senior Software Engineer to lead our software development team in Pittsburgh, PA. As a key member of our team, you will be responsible for designing, developing, and implementing application software solutions using Python and Microservice...

  • Senior Software Engineer

    3 weeks ago

    Pittsburgh, Pennsylvania, United States AMN Healthcare Allied Full time

    Job Description: We are seeking a highly skilled Senior Software Engineer to join our team at {company}.Key Responsibilities:1. Lead the development of software applications using {base job title}.2. Collaborate with cross-functional teams to ensure timely and high-quality delivery of software projects.Requirements:1. Bachelor's degree in Computer Science or...

  • Senior Software Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Eliassen Group Full time

    Job SummaryEliassen Group is seeking a skilled Senior Software Engineer to join our team. As a key member of our software development team, you will be responsible for designing, developing, and implementing high-quality software applications.Key ResponsibilitiesDesign and develop software applications using Python and SparkCollaborate with architects to...

  • Senior Software Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States PNC Full time

    Job SummaryPNC is seeking a highly skilled Senior Software Engineer to join our Technology organization. As a key member of our team, you will be responsible for designing and developing software solutions using existing and emerging technology platforms.Key ResponsibilitiesProvides detailed technical design and development of software solutions.Proposes and...

  • Senior Software Engineer

    1 month ago

    Pittsburgh, Pennsylvania, United States Carnegie Mellon University Full time

    Job SummaryCarnegie Mellon University is seeking a highly skilled Senior Software Engineer to join our team. As a key member of our Applied Systems Group, you will be responsible for conceiving, developing, testing, and deploying software systems to improve the capabilities of our customers.Key Responsibilities:Participate in all phases of the software...

  • Embedded Software Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Software Engineering Institute Full time

    About the RoleWe're seeking a talented engineer to join our team at the Software Engineering Institute. As an Embedded Software Engineer, you'll play a critical role in designing and developing software prototypes and research methods for software resilience.You'll work closely with our team to develop tools, techniques, and processes to solve some of the...

  • Staff Software Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Net Health Full time

    About Net HealthWe are a high-growth and profitable company that helps caregivers harness data for human health. Our welcoming and collaborative culture paired with progressive benefits makes Net Health the ultimate career home.As a leading-edge SaaS company in healthcare, we deliver solutions that help patients get better, faster, and live more fulfilling...

  • Senior Java Software Engineer Lead

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Saxon Global Full time

    Job Title: Technical LeadJob Description:We are seeking a highly skilled Technical Lead to join our team at Saxon Global. As a Technical Lead, you will be responsible for leading a team of engineers and working on complex software projects. The ideal candidate will have a strong background in Java and Angular, with experience in leading teams and managing...

  • Senior Software Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Eliassen Group Full time

    Job SummaryEliassen Group is seeking a skilled Senior Software Engineer to join our team. As a key member of our software development team, you will be responsible for designing, developing, and implementing application software solutions.Key ResponsibilitiesDesign and develop application software solutions using Python and Spark.Collaborate with architects...