QA Automation Engineer with Gen AI

3 weeks ago

New York, United States Synechron Full time

Job Title: QA Automation Engineer with Gen AI

Location: New York City, NY.


We are

At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more. Over the last 20+ years, our company has been honoured with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of 14,000+, and has 55 offices in 20 countries within key global markets.


Our challenge

We are seeking a highly skilled and motivated Quality Engineer for Generative AI will be responsible for ensuring the quality and reliability of the AI systems. This role will involve working closely with the development team and key groups to understand the project requirements and develop comprehensive test plans.


Additional Information*

The base salary for this position will vary based on geography and other factors. In accordance with law, the base salary for this role if filled within New York, NYC is $110K - $120K/year & benefits (see below).


The Role

Responsibilities:

Work as part of a DBA fleet, on QE processes with heavy focus on execution of automation with various automation tools and techniques.

Develops test strategies and plans for Generative AI implementations.

Design and execute test cases to validate the functionality, performance, and reliability of Generative AI solutions.

Collaborate with stakeholders to identify testing requirements and priorities.

Identify and document defects, issues, and risks related to Generative AI implementations.

Work closely with developers and program managers to prioritize and resolve issues in a timely manner.

Develop and maintain automated test scripts and frameworks for efficient and effective testing.

Drive continuous improvement and best practices in testing methodologies and processes for Generative AI implementations.

Stay up to date with new testing approaches, tools, and test strategies.


Requirements:

You are:

8+ years of proven work experience in Quality Engineering.

Integrate LLM automation tests into the continuous integration and continuous deployment pipelines. Hands-on experience in prompt engineering concepts.

Proven experience in developing and implementing automation frameworks for Large Language Models. Strong programming skills in languages such as Python, Java, or similar. Experience with popular testing tools and frameworks (e.g., Selenium, JUnit, TestNG).

Knowledge of NLP (Natural Language Processing) concepts and techniques.

Familiarity with CI/CD pipelines and version control systems (e.g., Jenkins, Git).

Strong problem-solving and analytical skills.

Experience in automation technologies including Selenium, Junit, Gherkin, JMeter etc. and scripting languages including java.

Proficiency in usage of PostgreSQL and Vector databases (ReDis) or large datasets.

Team player with good communication skills to work effectively in a global team. Desired Skills Working knowledge of cloud-based application architecture and principles.

Prior experience working in the Financial Services Industry

Familiarity with building large-scale AI products or platforms for NLP, or recommendation systems serving millions of users.

Knowledge in Graph or Network Theory and Graph Machine Learning (Graph ML). They are familiar with relevant frameworks and libraries, including Deep Graph Learning (DGL) and Natural Language Processing (NER). Additionally, understand algorithms such as Levenshtein Distance, which is used for measuring the similarity between two strings.

It would be great if you also had:

Experience in the financial services industry.

Familiarity with Agile methodologies


We can offer you:

  • A highly competitive compensation and benefits package
  • A multinational organization with 55 offices in 20 countries and the possibility to work abroad
  • Laptop and a mobile phone
  • 10 days of paid annual leave (plus sick leave and national holidays)
  • Maternity & Paternity leave plans
  • A comprehensive insurance plan including: medical, dental, vision, life insurance, and long-/short-term disability (plans vary by region)
  • Retirement savings plans
  • A higher education certification policy
  • Commuter benefits (varies by region)
  • Extensive training opportunities, focused on skills, substantive knowledge, and personal development.
  • On-demand Udemy for Business for all Synechron employees with free access to more than 5000 curated courses
  • Coaching opportunities with experienced colleagues from our Financial Innovation Labs (FinLabs) and Center of Excellences (CoE) groups
  • Cutting edge projects at the world’s leading tier-one banks, financial institutions and insurance firms
  • A flat and approachable organization
  • A truly diverse, fun-loving and global work culture


S​YNECHRON’S DIVERSITY & INCLUSION STATEMENT

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.

All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

Candidate Application Notice

  • QA Automation

    2 weeks ago

    New York, United States Omega Hires Full time

    Job Title: QA Automation (GEN AI or LLM)Duration: Long-term Contract PositionLocation: New York City, NY (Hybrid)ResponsibilitiesWork as part of a DBA fleet, on QE processes with heavy focus on execution of automation with various automation tools and techniques. Develops test strategies and plans for Generative AI implementations. Design and execute test...

  • QA Automation

    3 weeks ago

    New York, United States OmegaHires Full time

    Job DescriptionJob DescriptionJob Title: QA Automation (GEN AI or LLM)Duration: Long-term Contract PositionLocation: New York City, NY (Hybrid)ResponsibilitiesWork as part of a DBA fleet, on QE processes with heavy focus on execution of automation with various automation tools and techniques. Develops test strategies and plans for Generative AI...

  • QA Automation Engineer with Gen AI

    2 weeks ago

    New York, United States Synechron Full time

    Job Title: QA Automation Engineer with Gen AILocation: New York City, NY. We areAt Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span...

  • QA Automation Engineer with Gen AI

    3 weeks ago

    New York, United States Synechron Full time

    Job Title: QA Automation Engineer with Gen AILocation: New York City, NY. We areAt Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span...

  • QA Automation Engineer

    3 months ago

    New York, United States Patronus AI Full time

    About Patronus AIPatronus AI is the leading automated AI evaluation and security company. We are on a mission to boost enterprise confidence in generative AI. Our world-class platform enables enterprise development teams to score LLM performance, generate adversarial test cases, benchmark LLMs, and more. Customers use Patronus AI to detect LLM mistakes at...

  • Gen AI Platform Lead Software Engineer

    2 months ago

    New York, United States Vets Hired Full time

    Job DescriptionJob Description*Role* Design, configure, and implement a Gen. AI platform, including MLOps/LLMOps for Gen. AI LLMs, both commercial and open source Ensure alignment to appropriate patterns and standards for cloud integration and automation Identify opportunities for reuse and Improved efficiency Engage with IT and Business partners, product...

  • QA automation engineer

    2 weeks ago

    New York, United States Writer Corporation Full time

    About Writer Writer is the full-stack generative AI platform delivering transformative ROI for the world's leading enterprises. Named one of the top 50 companies in AI by Forbes, Writer empowers hundreds of customers like Accenture, Intuit, L'Oreal, and Vanguard to transform the way they work. Our all-in-one solution makes it easy to deploy customized AI...

  • QA automation engineer

    1 month ago

    New York, United States Writer Corporation Full time

    About Writer Writer is the full-stack generative AI platform delivering transformative ROI for the world's leading enterprises. Named one of the top 50 companies in AI by Forbes, Writer empowers hundreds of customers like Accenture, Intuit, L'Oreal, and Vanguard to transform the way they work. Our all-in-one solution makes it easy to deploy customized AI...

  • Gen AI Engineer

    2 months ago

    New York, United States Impetus Technologies Full time

    We are seeking a highly skilled Gen AI Engineer to join our team and drive innovation in the rapidly evolving field of artificial intelligence. In this role, you will leverage your expertise in Generative AI, Lang Chain, and NLP to build and deploy cutting-edge AI/ML models. Your strong programming skills and knowledge of data pipelines will be instrumental...

  • QA automation engineer

    3 months ago

    New York, United States Writer Corporation Full time

    ✍🏽 About Writer Writer is the full-stack generative AI platform delivering transformative ROI for the world’s leading enterprises. Named one of the top 50 companies in AI by Forbes, Writer empowers hundreds of customers like Accenture, Intuit, L’Oreal, and Vanguard to transform the way they work.  Our all-in-one solution makes it easy to deploy...

  • Gen AI Machine Learning Engineer

    3 weeks ago

    New York, United States Argyllinfotech Full time

    Job DescriptionJob DescriptionJob Summary: - Role: Gen AI Machine Learning Engineer - Location: New York (3 days Hybrid) - Hiring: Only candidates from New York - Max Rate: $73/Hr - - Interview Process: 2 Rounds of Interview - Employment Type: Contract and Full-Time Employment (FTE) - Main Task: Develop machine learning solutions and projects involving ML &...

  • Gen AI Architect

    2 days ago

    New York, New York, United States mavinsys Full time

    About MavinsysMavinsys is a leading IT services and staffing company specializing in lateral hiring and contract services. We are committed to delivering top-notch talent to our clients and fostering a culture of innovation and excellence.Job Title: Gen AI ArchitectLocation: New YorkDuration: 12 monthsJob SummaryWe are seeking an experienced Gen AI Architect...

  • Gen AI Machine Learning Engineer

    3 days ago

    New York, United States mavinsys Full time

    Hello We are from Mavinsys Talent Acquisition team based on One World Trade Centre New York. We are specializing in IT services and staffing majorly in lateral hiring/contract. Below is one of our requirement to fill immediately if youre interested please share your candidature to Job Title: Gen AI Machine Learning Engineer Location: New York NY Duration:...

  • Gen AI Machine Learning Engineer

    1 month ago

    New York, United States Tekshapers Inc Full time

    Job DescriptionJob DescriptionEmployment type ContractJob Title Gen AI Machine Learning Engineer 01 PositionsJob Location New York (3 days Hybrid and Candidates from NY only)Duration 6+ monthsExperience level -12+ yearsMandatory Skills Machine Learning, Generative AI solutions, Python, Hadoop & Spark etcJob Description We are seeking a talented Machine...

  • Gen AI Architect

    3 days ago

    New York, United States mavinsys Full time

    Hello We are from Mavinsys Talent Acquisition team based on One World Trade Centre New York. We are specializing in IT services and staffing majorly in lateral hiring/contract. Below is one of our requirement to fill immediately if youre interested please share your candidature to Job Title: Gen AI Architect Location: New York NY Duration: 12months Job...

  • Qa Automation Engineer

    3 months ago

    New York, United States Nationstaff Full time

    About This Role - QA Automation Engineer - Trading We are seeking a talented QA Automation Engineer with experience in low-latency trading platforms, preferably in the digital currency or foreign exchange markets. The QA Automation Engineer will report directly to the VP of Quality Assurance and focus on developing automated testing frameworks for the firm's...

  • AI Engineer

    2 days ago

    New York, New York, United States mavinsys Full time

    About MavinsysMavinsys is a leading IT services and staffing company specializing in lateral hiring and contract services. We are committed to delivering top-notch talent to our clients and fostering a culture of innovation and excellence.Job Title: Gen AI Machine Learning EngineerLocation: New YorkDuration: 12 monthsJob SummaryWe are seeking a highly...

  • QA Automation Engineer II

    1 month ago

    New York, New York, United States tapwage Full time

    Join Aya Healthcare, winner of multiple Top Workplace awardsThe QA Engineer II will bring expertise from a strong background in QA engineering to a growing and innovative organization, designing scenario testing, creating test plans, and reviewing quality specifications and technical design for both existing and new products. The QA Engineer will be an...

  • Senior Automation QA Engineer

    1 week ago

    New York, New York, United States C&L Group Full time

    Senior Automation QA EngineerC&L Group is seeking a highly skilled Senior Automation QA Engineer to join our team. As a key member of our quality assurance team, you will play a crucial role in designing and implementing test automation frameworks to ensure the highest level of quality and reliability of our software products.We are looking for an...

  • Java Fullstack with Gen AI

    3 days ago

    New York, United States mavinsys Full time

    Hello We are from Mavinsys Talent Acquisition team based on One World Trade Centre New York. We are specializing in IT services and staffing majorly in lateral hiring/contract. Below is one of our requirement to fill immediately if youre interested please share your candidature to Job Title: Java FullStack with Gen AI Location: New York NY Duration:...