Programmer Analyst
2 weeks ago
Location: Madison, WI
Duration: 12 Months
Job Description:
We are seeking a highly motivated and experienced Test Automation Engineer to design, develop, and maintain automated end-to-end and accessibility test suites for our critical eCourts and Case Management applications. This role is central to improving our software quality, accelerating our release cycles, and ensuring compliance. The ideal candidate will have deep expertise in Playwright, extensive experience with GitLab CI/CD, and a strong background in developing robust, scalable test automation frameworks.
This role is specifically for a GitLab-Integrated Playwright Test Automation Engineer. Attached, you will find a detailed job description that outlines the goals for the role - short-term, mid-term, and long-term - as well as important context regarding the testing of eCourts/OVL applications. The position will involve using tools such as Playwright and Axe, along with integration into GitLab and Digital.ai.
Key Responsibilities:
Test Automation Framework Development and Execution
- Design and Build: Design, develop, and maintain scalable and reliable end-to-end (E2E) automated test suites using Playwright for web applications, including those requiring eCourts- authenticated (e.g., CC eFiling) and OVL-authenticated (e.g., Case Management) access.
- Develop & Maintain: Develop & maintain robust test frameworks using Playwright tailored for end-to-end testing across multiple web browsers and environments.
- Collaborate with development and QA teams for automated test execution strategies.
- Accessibility Testing: Create and deploy an automated accessibility test suite for public sites (e.g., WICourts.gov) utilizing a standard tool like Axe.
- Regression Management: Translate existing manual regression test suites (currently in Digital.ai) into automated regression test suites within the new framework.
- Test Design & Execution: Create detailed test plans and automated scripts based on project requirements. Execute functional, regression, performance, and UI tests leveraging Playwright.
- Quality Assurance Metrics: Monitor automation test results and generate insights. Implement actionable improvements for consistent pipeline and testing enhancements.
- Troubleshooting & Debugging: Diagnose issues, debug test failures, and work closely with product teams to resolve bugs efficiently.
- Maintenance: Continuously improve and update existing test cases and automation scripts to align with new software features and changes, ensuring test stability and relevance.
- Collaboration: Partner with DevOps, Development, and QA teams to ensure testing is an integral part of the software lifecycle. Advocate for test automation best practices.
CI/CD Integration and Tooling
- GitLab Integration: Integrate test suite execution directly into the GitLab deploy pipeline, ensuring automated regression testing runs against every development environment.
- Visibility & Reporting: Implement solutions (e.g., custom dashboards or integration with existing overviews) to ensure clear, immediate visibility of automated test results, highlighting test failures and environment status.
- Process Compliance: Collaborate with software development supervisors to establish a formal process that includes the verification of automated test results as a mandatory step in the pre- release process.
Mentorship and Documentation
- Tooling Setup: Assist analysts (Sam and Lexie) with setting up their local development environments, including Visual Studio and Playwright, enabling them to generate and contribute tests to the central repository.
- Documentation: Create and maintain comprehensive documentation detailing the processes for creating new automated tests, executing them, and viewing/interpreting the test results.
- Innovation: Explore and implement advanced test generation techniques, including Playwright's test generation tools and AI-based test generation, to enhance test coverage and efficiency.
Required Skills and Experience:
- 3+ years of professional experience in Software Test Automation or Quality Assurance.
- Expert proficiency in modern web automation frameworks, specifically Playwright automation tools, scripting, and frameworks.
- Strong practical experience with GitLab CI/CD for integrating and running automated tests in a pipeline.
- Solid programming skills in a language compatible with Playwright (e.g., TypeScript or JavaScript) and related programming languages.
- Experience in implementing accessibility testing using tools such as Axe. Familiarity with testing tools like Postman for API Testing.
- Familiarity with authentication complexities and strategies for testing secure, login-protected applications.
Desirable Skills:
- Prior experience with legacy or existing QA tools like Digital.ai for migrating test cases.
- Experience working on applications within the legal, government, or eCourts domain.
- Knowledge of performance, load, or security testing practices.
- Experience with advanced reporting and visualization tools for test results.
- Key Performance Indicators (KPIs)
- Successful deployment of the initial test suites for CC eFiling and Case Management within the first 3 months.
- Integration of automated regression tests into the GitLab pipeline for 100% target development environments.
- Establishment of a test results dashboard/reporting mechanism that provides real-time status of all tested environments.
- Successful training and enablement of analysts (Sam and Lexie) to contribute to the test repository.
- Alignment with Immediate, Mid-term, and Long-Term Goals
This role is directly responsible for delivering all specified goals:
- Goal Type: Specific Goal Alignment
- Immediate: Creating the initial eCourts and OVL-authenticated test suites, deploying the Axe-based accessibility suite and enabling analysts with local test generation tools.
- Mid-term: Automating Digital.ai-based regression tests, integrating test execution into the GitLab deploy pipeline, ensuring test visibility/dashboarding, and formalizing test verification in the pre-release process.
- Long-Term: Maintaining and improving existing test cases, exploring AI-based test generation for expansion,
- and integrating automated tests for pre-deploy CI pipeline verifications.
Top Required Skills & Years of Experience:
- Expert proficiency with using Playwright for UI automation tests (3+ years)
- Experience implementing accessibility testing using tools such as Axe (5+ years)
- Strong practical experience with GitLab CI/CD for integrating and running automated tests in a pipeline (5+ years)
Top Nice to Have Skills:
- Knowledge of performance, load, or security testing practices
- Experience with advanced reporting and visualization tools for test results
- Experience creating KPI’s on Grafana, to visualize test suite’s health
-
Programmer Analyst
2 weeks ago
Madison, WI, United States Serigor Inc Full timeJob Description Job Description Job Title: Programmer Analyst -II (Onsite) Location: Madison, WI Duration: 12 Months Job Description: We are seeking a highly motivated and experienced Test Automation Engineer to design, develop, and maintain automated end-to-end and accessibility test suites for our critical eCourts and Case Management applications. This...
-
Programmer Analyst
2 weeks ago
Madison, WI, United States Serigor Inc Full timeJob Description Job Description Job Title: Programmer Analyst -II (Onsite) Location: Madison, WI Duration: 12 Months Job Description: We are seeking a highly motivated and experienced Test Automation Engineer to design, develop, and maintain automated end-to-end and accessibility test suites for our critical eCourts and Case Management applications. This...
-
Programmer Analyst
1 week ago
Madison, WI, United States Serigor Inc Full timeJob Description Job Description Job Title: Programmer Analyst -II (Onsite) Location: Madison, WI Duration: 12 Months Job Description: We are seeking a highly motivated and experienced Test Automation Engineer to design, develop, and maintain automated end-to-end and accessibility test suites for our critical eCourts and Case Management applications. This...
-
Programmer Analyts
2 weeks ago
Madison, WI, United States Symphony Corporation Full timeOverview PROGRAMMER ANALYSTS, in Madison, WI. Plan, test and dev comp programs & specialized apps for client. Code software. Devise & design comp sys reqs. Assist in the formulation of procedures for project system solutions. Travel/relocation to various unanticipated US locations. Some job duties can be performed from home. Responsibilities Plan, test and...
-
Analyst, Claims Extract
2 weeks ago
Madison, WI, United States Navitus Health Solutions Full timeAnalyst, Claims ExtractLocation US-ID 2025-5263Category AdministrationPosition Type Full-TimeRemote YesCompanyNavitusAbout UsNavitus - Putting People First in Pharmacy - Navitus was founded as an alternative to traditional pharmacy benefit manager (PBM) models. We are committed to removing cost from the drug supply chain to make medications more...
-
Analyst, Claims Extract
2 weeks ago
Madison, WI, United States Navitus Health Solutions Full timeAnalyst, Claims ExtractLocation US-ID 2025-5263Category AdministrationPosition Type Full-TimeRemote YesCompanyNavitusAbout UsNavitus - Putting People First in Pharmacy - Navitus was founded as an alternative to traditional pharmacy benefit manager (PBM) models. We are committed to removing cost from the drug supply chain to make medications more...
-
Analyst, Claims Extract
1 week ago
Madison, WI, United States Navitus Health Solutions Full timeAnalyst, Claims ExtractLocation US-ID 2025-5263Category AdministrationPosition Type Full-TimeRemote YesCompanyNavitusAbout UsNavitus - Putting People First in Pharmacy - Navitus was founded as an alternative to traditional pharmacy benefit manager (PBM) models. We are committed to removing cost from the drug supply chain to make medications more...
-
Madison, WI, United States SynergisticIT Full timeSince 2010, SynergisticIT has helped more than 10,000 jobseekers get hired at hundreds of tech clients by providing the required tech stack, real-world project experience, and U.S.-based exposure. Currently, We are looking for entry-level software programmers, Java Full stack developers, Python/Java developers, Data analysts/Data Engineers/ Data Scientists,...
-
Certified Microsoft .NET web Developer III
7 days ago
Madison, WI, United States E-Solutions Full timeJob Description: The Wisconsin Department of Public Instruction is seeking a Certified Microsoft .NET web Developer III who will serve as a member of the Application Development Team under the Division of Libraries and Technology. As a member of the Application Development Team, this position is responsible for development, analysis, and maintenance of...
-
Certified Microsoft .NET web Developer III
2 weeks ago
Madison, WI, United States E-Solutions Full timeJob Description: The Wisconsin Department of Public Instruction is seeking a Certified Microsoft .NET web Developer III who will serve as a member of the Application Development Team under the Division of Libraries and Technology. As a member of the Application Development Team, this position is responsible for development, analysis, and maintenance of...