QA Automation

3 weeks ago

New York, United States OmegaHires Full time
Job DescriptionJob DescriptionJob Title: QA Automation (GEN AI or LLM)
Duration: Long-term Contract Position
Location: New York City, NY (Hybrid)

Responsibilities
  • Work as part of a DBA fleet, on QE processes with heavy focus on execution of automation with various automation tools and techniques.
  • Develops test strategies and plans for Generative AI implementations.
  • Design and execute test cases to validate the functionality, performance, and reliability of Generative AI solutions.
  • Collaborate with stakeholders to identify testing requirements and priorities.
  • Identify and document defects, issues, and risks related to Generative AI implementations.
  • Work closely with developers and program managers to prioritize and resolve issues in a timely manner.
  • Develop and maintain automated test scripts and frameworks for efficient and effective testing.
  • Drive continuous improvement and best practices in testing methodologies and processes for Generative AI implementations.
  • Stay up to date with new testing approaches, tools, and test strategies

Required Skills:
  • 8+ years of proven work experience in Quality Engineering.
  • Integrate LLM automation tests into the continuous integration and continuous deployment pipelines. Hands-on experience in prompt engineering concepts.
  • Proven experience in developing and implementing automation frameworks for Large Language Models. Strong programming skills in languages such as Python, Java, or similar. Experience with popular testing tools and frameworks (e.g., Selenium, JUnit, TestNG).
  • Knowledge of NLP (Natural Language Processing) concepts and techniques.
  • Familiarity with CI/CD pipelines and version control systems (e.g., Jenkins, Git).
  • Strong problem-solving and analytical skills.
  • Experience in automation technologies including Selenium, Junit, Gherkin, JMeter etc. and scripting languages including java.
  • Proficiency in usage of PostgreSQL and Vector databases (ReDis) or large datasets.
  • Team player with good communication skills to work effectively in a global team.

Desired Skills:
  • Working knowledge of cloud-based application architecture and principles.
  • Prior experience working in the Financial Services Industry
  • Familiarity with building large-scale AI products or platforms for NLP, or recommendation systems serving millions of users.
  • Familiarity with Graph or Network Theory and Graph ML, including relevant frameworks and libraries such as Deep Graph Learning (DGL) or NER, Levenshtein Distance Educational

Qualification:
  • Minimum BS degree in Computer Science, Engineering or a related field

 

Powered by JazzHR

6WLcKLPN0B

  • Qa Automation Engineer

    3 months ago

    New York, United States Nationstaff Full time

    About This Role - QA Automation Engineer - Trading We are seeking a talented QA Automation Engineer with experience in low-latency trading platforms, preferably in the digital currency or foreign exchange markets. The QA Automation Engineer will report directly to the VP of Quality Assurance and focus on developing automated testing frameworks for the firm's...

  • QA automation engineer

    2 weeks ago

    New York, United States Writer Corporation Full time

    About Writer Writer is the full-stack generative AI platform delivering transformative ROI for the world's leading enterprises. Named one of the top 50 companies in AI by Forbes, Writer empowers hundreds of customers like Accenture, Intuit, L'Oreal, and Vanguard to transform the way they work. Our all-in-one solution makes it easy to deploy customized AI...

  • QA automation engineer

    1 month ago

    New York, United States Writer Corporation Full time

    About Writer Writer is the full-stack generative AI platform delivering transformative ROI for the world's leading enterprises. Named one of the top 50 companies in AI by Forbes, Writer empowers hundreds of customers like Accenture, Intuit, L'Oreal, and Vanguard to transform the way they work. Our all-in-one solution makes it easy to deploy customized AI...

  • Senior Automation QA Engineer

    1 week ago

    New York, New York, United States C&L Group Full time

    Senior Automation QA EngineerC&L Group is seeking a highly skilled Senior Automation QA Engineer to join our team. As a key member of our quality assurance team, you will play a crucial role in designing and implementing test automation frameworks to ensure the highest level of quality and reliability of our software products.We are looking for an...

  • Senior Director, QA Automation

    2 weeks ago

    New York, United States Code and Theory Full time

    As part of our quality assurance team, you will ensure the excellence of our web experiences and custom products. Collaborating with engineering, design, and product teams, you will be responsible for testing software solutions that address real-world challenges. Your role will involve leading our automation initiatives, analyzing application functionality,...

  • QA automation engineer

    3 months ago

    New York, United States Writer Corporation Full time

    ✍🏽 About Writer Writer is the full-stack generative AI platform delivering transformative ROI for the world’s leading enterprises. Named one of the top 50 companies in AI by Forbes, Writer empowers hundreds of customers like Accenture, Intuit, L’Oreal, and Vanguard to transform the way they work.  Our all-in-one solution makes it easy to deploy...

  • Senior Automation QA Engineer

    2 days ago

    New York, New York, United States SRI Tech Solutions Inc. Full time

    About the RoleSRI Tech Solutions Inc. is seeking a highly skilled Senior Automation QA Engineer to join our team. As a key member of our QA team, you will be responsible for designing and developing automation solutions that meet our organization's standards.Key ResponsibilitiesAutomation Solution Development: Design and develop automation solutions that...

  • Automation QA

    2 weeks ago

    New York, United States NTT DATA Full time

    Job Description: Automation QA - Payments Summary of Role We are seeking a highly skilled Automation QA who has worked on Payments domain. The ideal candidate will have extensive knowledge of banking systems and a proven track record in writing and executing test cases, using an automation framework. What you will do: Work with the team in the design,...

  • QA Automation Engineer

    3 months ago

    New York, United States Patronus AI Full time

    About Patronus AIPatronus AI is the leading automated AI evaluation and security company. We are on a mission to boost enterprise confidence in generative AI. Our world-class platform enables enterprise development teams to score LLM performance, generate adversarial test cases, benchmark LLMs, and more. Customers use Patronus AI to detect LLM mistakes at...

  • Lead QA Automation Engineer

    2 weeks ago

    New York County, New York, United States IDB Full time

    Job OverviewThe Lead QA Automation Engineer plays a crucial role in the formulation and execution of quality assurance testing methodologies to uphold software excellence and adherence to financial regulations.This position involves leading, mentoring, and supervising a team of QA professionals, promoting a culture of ongoing enhancement and teamwork. The...

  • Senior QA Automation Specialist

    2 weeks ago

    New York, New York, United States Ness Digital Engineering Full time

    Why Choose Ness Digital EngineeringAt Ness, we recognize that our employees are our most valuable resource. The professionalism, creativity, collaboration, and commitment to excellence demonstrated by our team have propelled us to the forefront of the technology sector. These attributes are essential for our ongoing success.As part of the Ness team, you will...

  • Senior QA Automation Engineer

    1 week ago

    New York, New York, United States Ness Digital Engineering Full time

    About Ness Digital EngineeringAt Ness, we recognize that our employees are our most valuable resource. The professionalism, creativity, collaboration, and commitment to excellence exhibited by our team have propelled us to the forefront of the technology sector. These attributes are essential for our ongoing success.As part of our organization, you will...

  • Senior QA Automation Engineer

    2 weeks ago

    New York, New York, United States Ness Digital Engineering Full time

    About Ness Digital EngineeringAt Ness, we recognize that our people are our most valuable resource. The professionalism, creativity, collaboration, and commitment to excellence exhibited by our team have propelled us to the forefront of the technology sector. These attributes are essential for our ongoing success.As part of our organization, you will engage...

  • Senior QA Automation Engineer

    1 week ago

    New York, New York, United States Ness Digital Engineering Full time

    Why Choose Ness Digital EngineeringAt Ness Digital Engineering, we recognize that our people are our most valuable resource. The professionalism, creativity, collaboration, and commitment to excellence exhibited by our team have propelled us to the forefront of the technology sector. These attributes are essential for our ongoing success.As part of our...

  • Senior QA Automation Engineer

    2 weeks ago

    New York, New York, United States Ness Digital Engineering Full time

    Why Choose Ness Digital EngineeringAt Ness Digital Engineering, we recognize that our employees are our most valuable resource. The professionalism, creativity, collaboration, and commitment to excellence exhibited by our team have positioned us as a frontrunner in the technology sector. These attributes are essential for our ongoing success.As part of our...

  • QA Automation Lead

    2 weeks ago

    New York, United States The Ladders Full time

    Company Description For more than 70 years, IDB Bank has made it our mission to be the best bank for our clients by putting their needs first, and the success we've enjoyed fundamentally comes down to our people. Here at IDB, you'll work side by side with some of the most talented professionals in the industry who share a strong sense of teamwork and a...

  • QA Automation Lead

    1 month ago

    New York, United States IDB Full time

    Job DescriptionJob DescriptionCompany DescriptionFor more than 70 years, IDB Bank has made it our mission to be the best bank for our clients by putting their needs first, and the success we’ve enjoyed fundamentally comes down to our people. Here at IDB, you’ll work side by side with some of the most talented professionals in the industry who share a...

  • Automation QA Payments

    7 days ago

    New York, United States Compunnel Full time

    Summary: We are seeking a highly skilled Automation QA who has worked on Payments domain. The ideal candidate will have extensive knowledge of banking systems and a proven track record in writing and executing test cases, using an automation framework. What you will do: Work with the team in the design, development, and maintenance of test automation...

  • Sr. QA Automation Tester

    1 month ago

    New York, New York, United States SIRI Software Solutions, LLC Full time

    Title Sr. QA Automation TesterLocation Initial Remote - Princeton NJDuration 12+ monthsJob Requirements Test Web Based application to make sure it meets various requirements set in Business / Functional Requirements Use automated testing tools to setup automated scripts for regression / progression testing Learn and follow DevOps process Participate...

  • Senior QA Automation Engineer

    1 week ago

    New York, New York, United States Ness Digital Engineering Full time

    About Ness Digital EngineeringAt Ness, we recognize that our employees are our most valuable resource. The professionalism, creativity, collaboration, and commitment to excellence demonstrated by our team have propelled us to the forefront of the technology sector. These attributes are essential for our ongoing success.As part of Ness, you will engage with...