Test Automation Engineer

We are seeking a highly motivated and experienced Test Automation Engineer to design, develop, and maintain automated end-to-end and accessibility test suites for our critical eCourts and Case Management applications. This role is central to improving our software quality, accelerating our release cycles, and ensuring compliance. The ideal candidate will have deep expertise in Playwright, extensive experience with GitLab CI/CD, and a strong background in developing robust, scalable test automation frameworks.

Key Responsibilities:

Test Automation Framework Development and Execution:

• Design and Build:
  Design, develop, and maintain scalable and reliable end-to-end (E2E) automated test suites using
  Playwright
  for web applications, including those requiring
  eCourts-authenticated
  (e.g., CC eFiling) and
  OVL-authenticated
  (e.g., Case Management) access.
• Develop & Maintain
  : Develop & maintain robust test frameworks using Playwright tailored for end-to-end testing across multiple web browsers and environments.
• Collaborate with development and QA teams for automated test execution strategies.
• Accessibility Testing:
  Create and deploy an automated accessibility test suite for public sites (e.g., ) utilizing a standard tool like
  Axe
  .
• Regression Management:
  Translate existing manual regression test suites (currently in
  
  ) into automated regression test suites within the new framework.
• Test Design & Execution:
  Create detailed test plans and automated scripts based on project requirements. Execute functional, regression, performance, and UI tests leveraging Playwright.
• Quality Assurance Metrics:
  Monitor automation test results and generate insights. Implement actionable improvements for consistent pipeline and testing enhancements.
• Troubleshooting & Debugging:
  Diagnose issues, debug test failures, and work closely with product teams to resolve bugs efficiently.
• Maintenance:
  Continuously improve and update existing test cases and automation scripts to align with new software features and changes, ensuring test stability and relevance.
• Collaboration:
  Partner with DevOps, Development, and QA teams to ensure testing is an integral part of the software lifecycle. Advocate for test automation best practices.

CI/CD Integration and Tooling

• GitLab Integration:
  Integrate test suite execution directly into the
  GitLab deploy pipeline
  , ensuring automated regression testing runs against every development environment.
• Visibility & Reporting:
  Implement solutions (e.g., custom dashboards or integration with existing overviews) to ensure clear, immediate visibility of automated test results, highlighting test failures and environment status.
• Process Compliance:
  Collaborate with software development supervisors to establish a formal process that includes the
  verification of automated test results
  as a mandatory step in the pre-release process.

Mentorship and Documentation

• Tooling Setup:
  Assist analysts (Sam and Lexie) with setting up their local development environments, including
  Visual Studio
  and
  Playwright
  , enabling them to generate and contribute tests to the central repository.
• Documentation:
  Create and maintain comprehensive documentation detailing the processes for creating new automated tests, executing them, and viewing/interpreting the test results.
• Innovation:
  Explore and implement advanced test generation techniques, including
  Playwright's test generation tools
  and
  AI-based test generation
  , to enhance test coverage and efficiency.

MANDATORY REQUIREMENTS:

• Expert proficiency with using Playwright for UI automation tests (3+ years)
• Experience implementing accessibility testing using tools such as Axe (5+ years)
• Strong practical experience with GitLab CI/CD for integrating and running automated tests in a pipeline (5+ years)
• Solid programming skills in a language compatible with Playwright (e.g., TypeScript or JavaScript) and related programming languages. (3+ years)
• Familiarity with authentication complexities and strategies for testing secure, login-protected applications.

NICE TO HAVE SKILLS:

• Knowledge of performance, load, or security testing practices
• Experience with advanced reporting and visualization tools for test results
• Experience creating KPI's on Grafana, to visualize test suite's health