ML Ops Test Engineer

3 weeks ago


Pittsburgh, Pennsylvania, United States Siri InfoSolutions Inc Full time

Job Title: ML Ops Test Engineer

Job Summary:

We are seeking a highly skilled ML Ops Test Engineer to join our team at Siri InfoSolutions Inc. As an ML Ops Test Engineer, you will be responsible for ensuring the reliability, scalability, and performance of machine learning models in production.

Key Responsibilities:

  • Develop and Execute Tests: Design and implement test cases to evaluate the performance, robustness, and reliability of ML models.
  • Statistical Analysis: Perform statistical analysis and fine-tuning using test results to improve model accuracy and efficiency.
  • Model Monitoring: Continuously monitor the health and performance of deployed models, identifying and addressing issues proactively.
  • Collaboration: Work closely with data scientists, software engineers, and DevOps teams to integrate testing processes into the ML lifecycle.
  • Automation: Develop and maintain automated testing frameworks and CI/CD pipelines for ML models.
  • Documentation: Document test plans, procedures, and results to ensure transparency and reproducibility.
  • Stay Updated: Keep abreast of the latest developments in ML, MLOps, and testing methodologies.

Requirements:

  • Programming Languages: Proficiency in Python, Java, or Scala.
  • Machine Learning Frameworks: Experience with TensorFlow, PyTorch, scikit-learn, or Keras.
  • Data Engineering: Knowledge of data pipelines, data processing, and storage solutions like Hadoop, Spark, and Kafka.
  • Cloud Computing: Familiarity with cloud platforms such as Azure.
  • Containerization and Orchestration: Expertise in Docker and Kubernetes.
  • Version Control: Proficiency with Git and CI/CD tools.
  • Analytical Skills: Strong analytical and problem-solving skills to interpret test results and improve model performance.

Preferred Qualifications:

  • Experience: Previous experience in MLOps, software testing, or a related field.
  • Certifications: Relevant certifications such as Azure AI Engineer Associate.

Soft Skills:

  • Communication: Excellent verbal and written communication skills to collaborate effectively with cross-functional teams.
  • Attention to Detail: Meticulous attention to detail to ensure the accuracy and reliability of test results.
  • Adaptability: Ability to adapt to rapidly changing technologies and methodologies in the ML and MLOps landscape.


  • Pittsburgh, Pennsylvania, United States Stack AV Full time

    About Stack AVStack AV is revolutionizing the AI and autonomous systems landscape with its cutting-edge technology designed to enhance safety, reliability, and efficiency of modern operations. Our autonomous technology incorporates advancements in artificial intelligence, robotics, machine learning, and cloud technologies, empowering us to create innovative...


  • Pittsburgh, Pennsylvania, United States ZOLL Medical Full time

    Job SummaryZOLL Medical is seeking a highly motivated and detail-oriented Software Engineer Co-op to join our Test Automation team. As a Co-op, you will have the opportunity to work on a wide range of technologies, including Python, C/C++, and .NET, and contribute to the development of automation software and frameworks.Key Responsibilities:Develop and...


  • Pittsburgh, Pennsylvania, United States ZOLL Medical Full time

    Job Summary: ZOLL Medical is seeking a highly motivated and detail-oriented Software Engineer Co-op to join our Test Automation team. As a Co-op, you will have the opportunity to work on a wide range of technologies, including Python, C/C++, and .NET framework. Your primary responsibility will be to develop and maintain automation software, infrastructures,...


  • Pittsburgh, Pennsylvania, United States Stack AV Full time

    About Stack AVStack AV is a leading innovator in the development of revolutionary AI and advanced autonomous systems designed to enhance safety, reliability, and efficiency of modern operations.The company's autonomous technology incorporates cutting-edge advancements in artificial intelligence, robotics, machine learning, and cloud technologies, empowering...


  • Pittsburgh, Pennsylvania, United States Stack AV Full time

    About Stack AVStack AV is a pioneering company in the development of revolutionary AI and advanced autonomous systems designed to enhance safety, reliability, and efficiency of modern operations. Our autonomous technology incorporates cutting-edge advancements in artificial intelligence, robotics, machine learning, and cloud technologies, empowering us to...


  • Pittsburgh, Pennsylvania, United States Aerotech, Inc. Full time

    Job DescriptionAerotech's Electrical R&D Department is seeking a highly motivated and detail-oriented Electrical/Computer Engineering Intern or Co-op to join our team. As an intern or co-op, you will have the opportunity to work on a variety of projects, including design, analysis, implementation, and testing of our industry-leading motion control...


  • Pittsburgh, Pennsylvania, United States ZOLL Services LLC (on SAM site) Full time

    ZOLL Services LLC is seeking a highly motivated and detail-oriented Engineering Co-op to join our Test Automation team. As a key member of our team, you will play a critical role in ensuring the quality and reliability of our medical devices.The ideal candidate will have a strong foundation in software development and a passion for automation. You will be...


  • Pittsburgh, Pennsylvania, United States Lovelace AI Full time

    About Us:Lovelace AI is a pioneering company that applies cutting-edge AI and systems engineering to enhance human safety in high-risk situations. Our mission is to harness the power of AI to mitigate threats and protect civilians worldwide.We believe that by leveraging advanced machine learning models and algorithms, we can significantly improve the safety...


  • Pittsburgh, Pennsylvania, United States Estat Actuation Full time

    Electroadhesive Component Design Co-opWe are seeking a highly motivated and detail-oriented Co-op student to join our team at Estat Actuation as a Mechanical Engineer. As a key member of our design team, you will be responsible for designing and developing custom robotics components using electroadhesive technology.Key Responsibilities:Design and develop...


  • Pittsburgh, Pennsylvania, United States Aerotech, Inc. Full time

    Job DescriptionAerotech, Inc. is seeking a highly motivated and talented individual to join our Software Engineering Department as an Internship or Co-op. This is an excellent opportunity to gain hands-on experience in software development, testing, and support.As a member of our team, you will be responsible for designing, implementing, testing, and...


  • Pittsburgh, Pennsylvania, United States Seegrid Full time

    Seegrid is a leading provider of self-driving industrial vehicles, and we're seeking a talented Senior Software Engineer to join our Platform and Systems team.As a key member of our team, you will be responsible for building software abstractions on top of hardware, developing our core infrastructure software, and ensuring its scalability over time.You will...


  • Pittsburgh, Pennsylvania, United States AeroTech Full time

    Software Engineering Internship or Co-opAt Aerotech, we're committed to providing exceptional opportunities for students to gain hands-on experience in software engineering. As a member of our team, you'll work alongside experienced engineers to design, implement, and test cutting-edge motion control and business process software.Key Responsibilities:Develop...


  • Pittsburgh, Pennsylvania, United States Estat Actuation Full time

    Job DescriptionAs a Materials Engineer Co-op at Estat Actuation, you will play a crucial role in improving the longevity of our products. Your primary responsibility will be to assist in literature reviews, identify and source new candidate materials for use in our electroadhesive products, and perform testing to determine the durability of these materials...


  • Pittsburgh, Pennsylvania, United States Aerotech, Inc. Full time

    Job DescriptionAerotech, Inc. is seeking a highly motivated and detail-oriented Mechanical Engineering Intern or Co-op to join our Precision Automation and Robotics team. As a member of our team, you will have the opportunity to gain hands-on experience in the design, assembly, testing, and analysis of precision positioning systems.Key...


  • Pittsburgh, Pennsylvania, United States Estat Actuation Full time

    Job SummaryThis co-op opportunity is for a Materials Engineer to work on the development of electroadhesive materials. The ideal candidate will have a strong understanding of materials science and be able to apply this knowledge to the design and testing of electroadhesive materials.Key Responsibilities* Assist in the development of new electroadhesive...


  • Pittsburgh, Pennsylvania, United States Allegheny County Full time

    We are seeking a skilled Machine Learning Software Engineer to join our team at Allegheny County Department of Human Services. As a member of our data science team, you will play a key role in building and extending our model deployment infrastructure.The ideal candidate will have a strong background in Python, software architecture, and abstract design....


  • Pittsburgh, Pennsylvania, United States Oshkosh Corporation Full time

    Autonomy Intern - ML/AIOshkosh Corporation is seeking an Autonomy Intern to join our team.About the RoleThis internship will provide students with hands-on experience in the field of autonomy engineering, focusing on the design, development, and testing of vehicle control software. The successful candidate will work closely with our Autonomy Engineering team...


  • Pittsburgh, Pennsylvania, United States GPD Group Full time

    We are seeking a highly motivated Civil Engineer Co-op to join our Roadway/Transportation team. As a billable member of the team, you will be responsible for design work for our clients and learning how to use different design technology and software systems, mentoring under a professional engineer.Akron, Columbus, Independence, OH or Pittsburgh, PA office...


  • Pittsburgh, Pennsylvania, United States Diverse Lynx Full time

    Key Responsibilities:Develop and maintain automated testing frameworks to ensure the quality of software applications.Analyze bug reports, prioritize necessary tests, and streamline application functions through automated testing processes.Collaborate with the engineering team to create testing plans and written reports showing...


  • Pittsburgh, Pennsylvania, United States Stantec Full time

    Electrical Co-Op/Intern Job DescriptionWe are seeking a highly motivated and dependable student to assist our team of engineers in various tasks and projects. As an Electrical Co-Op/Intern, you will work closely with senior engineers and designers to evaluate, select, specify, and engineer electrical power and lighting systems or products for projects.Key...