Manager, Psychometric Analytics

2 weeks ago


Helena, Montana, United States PSI Services Full time
PSI Services

Manager, Psychometric Analytics ($120-$130K)

Helena ,

Montana

Apply Now

We are PSI Services. We power world leading tests. Delivered with trusted science and the very best test taker experience. PSI supports test-takers on their journey to pursuing dreams and gaining certifications that are important to them. They believe that their dreams are worth working for; that their dreams are worth the effort. And we believe that too. This is our core purpose, to empower people to achieve their dreams.

We do this by being the best provider of workforce solutions, which foster both technology and science to deliver the best solutions for our test takers.

We are searching for top talent to join our PSI team and help grow our products and services.

We have a creative, supportive and inclusive culture where we empower people in their careers to be their authentic self and make the most of their great talent.

At PSI, we are committed to helping people meet their potential and we believe that promoting diversity, equity and inclusion is critical to our success.

That's why you'll find these ideals are intrinsic to our company culture and applied throughout the employee lifecycle.
Learn more about what we do at:

About the Role

The manager, Psychometric Analytics is responsible for the detection of fraudulent test taking behaviours using advanced statistical methods and web crawling procedures.

The person in this role is expected to have advanced training and expertise in measurement, research methodology, and data analytics.

This person will manage a portfolio of clients and manage a team of Data Forensics Psychometricians providing guidance, training, and oversight of their assigned duties.

The Data Forensics Manager will also engage opportunities to present PSI's data forensics offering to existing and prospective clients and assist with special initiatives.

This is a full-time permanent role, with flexible hours around core office availability Monday to Friday. The role can be performed remotely, with occasional travel required for meetings, events, and workshops.
Role Responsibilities
Provide training, guidance, and oversight of Data Forensics Psychometricians and Senior Data Forensics Psychometrics assigned duties.
Facilitate goal setting and participate in performance evaluation for assigned team members.
Coordinate team member activities and tasks and provide support to meet deliverables.
Participate in load forecasting and client program assignment process.
Participate in internal process development and improvement initiatives.

Maintain awareness of industry standards and research in the area of data forensics and web crawling procedures for the purpose of test security.

Design and conduct data analytics to support the security and integrity of high stakes examination programs.

Design and conduct R&D studies to evaluate, validate, and optimize the use of secure test delivery modes and technologies (including AI), while preserving validity and fairness of assessments.

Develop and implement frameworks for data forensic analyses to detect test fraud (cheating, IP harvesting/theft, exposure, breach, drift, and other testing anomalies).

Support investigations of potential test fraud at the candidate, test site, school, and other aggregate levels.
Design and generate exam program surveillance reports, summarize and interpret findings and make recommendations.
Evaluate test items and exams to identify potential test integrity issues.
Assess the potential impact of test security breaches, cheating, and related issues.
Develop test scoring (rescoring) solutions to address security-related anomalies.
Conduct ad hoc analyses to investigate test security-related issues and special inquiries.
Comply with industry best practices, standards and guidelines for test security analytics and forensics monitoring (e.g., ATP).
Write technical reports.
Present findings to key stakeholders.
Represent PSI in the professional testing community (e.g., ATP, COTS, NCME, ICE).
Knowledge, Skills and Experience Requirements
Master's degree or D. in Educational Measurement & Statistics, Quantitative Research Methods, Industrial/Organizational Psychology, Psychometrics, or highly related discipline.
Minimum of - 7 years of experience in psychometrics, test equating, measurement-based methodologies and analyses, and advanced statistics.
Two years of experience managing the work of others.
Experience in Data Forensics including operational implementation and usage of analysis results to guide investigations preferred.
Graduate training and experience in psychometrics, measurement theory, test development, validation, item bias, standard setting.
Skill in using statistical and data science software (R, SAS, SPSS, Python), Excel, and Word required.
Experience in using of IRT software programs (i.e. Winsteps, Parscale, BILOG) and CTT applications strongly preferred.
Experience with large-scale testing programs, including Certification and/or Licensure applications preferred.
Experience with NCCA and ISO 17024 accreditation standards strongly preferred.
Benefits & Culture
At PSI, our culture is to be transparent and fair.

That's why all of our roles have been benchmarked at a competitive rate against the local market they are based in.

To be transparent all of our adverts now include the salary so you can see if we align with your expectations when looking for your next role.

In addition to a competitive salary, we offer a comprehensive benefits package and supportive culture when you join us. This includes;
401k/Pension/Retirement Plan – with country specific employer %
Enhanced PTO/Annual Leave
Medical insurance – country specific
Dental, Vision, Life and Short Term Disability for US
Flexible Spending Accounts – for the US
Medical Cashback plan covering vision, dental and income protection for UK
Employee Assistance Programme
Commitment and understanding of work/life balance
Dedicated DE&I group that drive core people initiatives
A culture of embracing wellness, including regular global initiatives
Access to supportive and professional mechanisms to help you plan for your future
Volunteer Day and a culture of giving back to our community and industry through volunteering opportunities
Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities

The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant.

However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor's legal duty to furnish information.

41 CFR c)

#J-18808-Ljbffr

  • Helena, Montana, United States META Full time

    Meta Product Manager, Leader Helena , Montana Apply Now At Meta, we're shaping innovative experiences in service of giving people the power to build community and bring the world closer together. Our multidisciplinary product teams are creating new ways to help people connect, find communities and grow businesses. Together, we are committed to building...


  • Helena, Montana, United States Xylem Full time

    We're Hiring for a Client Solutions ManagerIf you are excited and passionate about helping #LetsSolveWater, consider joining our team today Xylem, Inc. is a leading global water technology company servicing more than 150 countries and is dedicated to solving the world's most challenging water issues. We are looking for individuals to join our mission by...


  • Helena, Montana, United States Ford Motor Company Full time

    Location field must contain 'city, state' or a zip code to perform a radius search (e.g., Denver, CO or City and state must be separated by a comma followed by a space (e.g., Houston, TX )Ford Motor Company Manager, Product Strategy in Helena , Montana We are the movers of the world and the makers of the future. We get up every day, roll up our sleeves and...


  • Helena, Montana, United States Atechstar Full time

    job DescriptionResponsiblities Responsible for defining and homogenous solution architecture for and Nokia based on service-based/oriented software principles with a strong focus on APIs and API management capabilities. Responsible for the e2e solution architecture technology and framework selection to produce a cohesive architecture across portfolio and...


  • Helena, Montana, United States Atechstar Full time

    job DescriptionResponsiblities Responsible for defining and homogenous solution architecture for and Nokia based on service-based/oriented software principles with a strong focus on APIs and API management capabilities. Responsible for the e2e solution architecture technology and framework selection to produce a cohesive architecture across portfolio and...


  • Helena, Montana, United States Oracle Full time

    Oracle Principal Technical Program Manager-ProdDev Helena , Montana Apply Now OCI (Oracle Cloud Infrastructure) Region Build Organization is currently in need of a Technical Program Manager (TPM) to join our fast-growing team. Technical Program Managers (TPM) rely on their mastery of data and business to understand and anticipate business requirements,...


  • Helena, Montana, United States Oracle Full time

    Job DescriptionJob DescriptionThe Oracle Cloud Infrastructure (OCI) Dedicated Cloud Product Solutions Product Support Engineering team is looking for an experienced and motivated Senior Technical Program Manager (TPM) to spearhead engagement, technical advisement, and relationship management with OCI's Dedicated Region Cloud @Customer ) (DRCC) and Oracle...


  • Helena, Montana, United States Oracle Full time

    Job DescriptionJob DescriptionThe Oracle Cloud Infrastructure (OCI) Dedicated Cloud Product Solutions Product Support Engineering team is looking for an experienced and motivated Senior Technical Program Manager (TPM) to spearhead engagement, technical advisement, and relationship management with OCI's Dedicated Region Cloud @Customer ) (DRCC) and Oracle...


  • Helena, Montana, United States State of Montana Full time

    : Our services impact EVERY Montanan MISSION STATEMENT To be the nation's most citizen oriented, efficiently administered, state tax agency. The Montana Department of Revenue administers over 40 state taxes, property appraisals, liquor and marijuana laws, and unclaimed property for the state of Montana. The Cannabis Control Division is responsible for the...

  • Project Specialist

    2 weeks ago


    Helena, Montana, United States State of Montana Full time

    Job Title: Project Specialist at Montana Department of Public Health and Human Services Company: DPHHS Director's Office This career opportunity involves in-depth research, development, and proposal of Health and Human Service reform initiatives under the guidance of the Chief Innovation Officer. The main responsibilities include analyzing initiatives,...


  • Helena, Montana, United States ProgressNow Full time

    Position Summary:Middle Fork Strategies is hiring for the position of Digital Organizing Director to manage a team of communications and digital organizers in Montana.The Digital Organizing Director will be responsible for building and continually updating a plan, in collaboration with the Executive Director, to achieve Middle Fork's metric and...

  • Project Specialist

    2 weeks ago


    Helena, Montana, United States State of Montana Full time

    Exciting Career Opportunity at the Director's Office of the Montana Department of Public Health and Human Services (DPHHS) This challenging position involves conducting research, developing strategies, and proposing initiatives for reforming Health and Human Services. The selected candidate will directly report to the Chief Innovation Officer and focus on...


  • Helena, Montana, United States Iron Mountain Full time

    At Iron Mountain we know that work, when done well, makes a positive impact for our customers, our employees, and our planet. That's why we need smart, committed people to join us. Whether you're looking to start your career or make a change, talk to us and see how you can elevate the power of your work at Iron Mountain.We provide expert, sustainable...


  • Helena, Montana, United States Iron Mountain Full time

    At Iron Mountain we know that work, when done well, makes a positive impact for our customers, our employees, and our planet. That's why we need smart, committed people to join us. Whether you're looking to start your career or make a change, talk to us and see how you can elevate the power of your work at Iron Mountain.We provide expert, sustainable...


  • Helena, Montana, United States Intermountain Health Full time

    Intermountain Health Strategic Sourcing Specialist Helena , Montana Apply Now The Strategic Sourcing Specialist is responsible for collaborating with internal stakeholders such as Category Management, Legal, Compliance, and others as necessary to gather information and requirements, using that information to inform negotiation strategy, take to market...


  • Helena, Montana, United States Renesas Full time

    Intern OED Product OperationsJob DescriptionAbout Operations Engineering Division (OED): OED is the central team that supports all Business Unit Design and Development teams, and other organizations including Sales, Marketing, Business Operations, Foundry Operations, and Test. OED provides a platform for managing all process technology and PDK development...


  • Helena, Montana, United States Renesas Full time

    Intern OED Product OperationsJob DescriptionAbout Operations Engineering Division (OED): OED is the central team that supports all Business Unit Design and Development teams, and other organizations including Sales, Marketing, Business Operations, Foundry Operations, and Test. OED provides a platform for managing all process technology and PDK development...


  • Helena, Montana, United States CLevelCrossing Full time

    Executive Director of Operations Helena College LocationHelena, MT, United StatesPosted onJan 19, 2023Apply for this jobyour email:upload resume:ProfileApplication instructions are located at the bottom of the page. Please apply directly through MEMBERS ONLYSIGN UP NOW***. 's career portal UM Jobs at**** for positions at MEMBERS ONLYSIGN UP NOW***. –...


  • Helena, Montana, United States Trinchero Family Estates Full time

    Req ID: 3222 Department: Direct to Consumer - Tasting Room Status: Full Time, Non-Exempt Location: Saint Helena, California (US-CA) Workplace Location: On-SiteJob Summary:Trinchero Napa Valley is the pinnacle of the Trinchero Family of brands, representing the excellence and experience of more than 65 years making wine in the Napa Valley. Renowned for small...


  • Helena, Montana, United States Trinchero Family Estates Full time

    Req ID: 3222 Department: Direct to Consumer - Tasting Room Status: Full Time, Non-Exempt Location: Saint Helena, California (US-CA) Workplace Location: On-SiteJob Summary:Trinchero Napa Valley is the pinnacle of the Trinchero Family of brands, representing the excellence and experience of more than 65 years making wine in the Napa Valley. Renowned for small...