Director of Test Development

4 weeks ago

Chapel Hill, United States American Board of Pediatrics Full time

Director of Test Development

Location: Hybrid

Department: Assessment

Reports to: Vice President for Assessment

Exemption Status: Exempt

Job Summary:

The Director of Test Development provides leadership and direction for the Test Development team. This position is crucial for ensuring the accurate and timely development of over 50 high-stakes examinations and longitudinal assessments annually. The role involves significant independence, judgment, and initiative to ensure project completion with a focus on timeliness and accuracy.

Essential Duties and Responsibilities:

  • Oversee all aspects of the test development processes and assessment products while integrating best practices, current research, and innovations in testing within the department.
  • Provide test development expertise to staff and subject matter experts (SMEs), while building and maintaining the necessary strong relationships to achieve desired results.
  • Oversee recruitment for the Certification Development Experts, General Pediatrics Examination Committee, and General Pediatrics MOCA-Peds Committee, as well as Medical Editors for the Subboards.
  • Design test development processes, workflows, and committee/subboard meetings to ensure high-quality exams and assessments.
  • Manage the team by setting clear objectives, establishing priorities, tracking projects, and delegating responsibilities appropriately.
  • Promote a culture of collaboration, particularly between the test development team and the entire organization, particularly the psychometrics team, to strengthen integration and cooperation to drive assessment forward.
  • Coordinate and partner with vendors to ensure the development and delivery of high-quality assessments.
  • Explore, plan, lead, and implement innovative approaches to testing and item development (eg AI for item generation), including but not limited to process improvements and strategic initiatives.

Other Functions:

  • Support the training and orientation of SMEs.
  • Represent the ABP at national professional organizations and serve as a testing expert on various internal committees.
  • Communicate effectively with external stakeholders, including the American Academy of Pediatrics (AAP), American Board of Medical Specialties (ABMS), other member boards, diplomates, and the wider testing community.
  • Engage the department in research activities and share results with national testing audiences.
  • Oversee the creation and maintenance of standard policy and procedure documents relating to test development activities ensuring compliance with industry standards.
  • Initiate, lead, and participate in special projects outside of standard role and responsibilities.
  • Performs other duties as assigned.

Supervisory Responsibilities:

This role currently supervises a team of 8 members.

Required Qualifications:

  • Minimum of a master’s degree in Educational Measurement, Educational Statistics, Industrial/Organizational Psychology, Education, Psychology, or a related field. Additional experience may be considered in lieu of the educational requirement
  • Minimum of 7 years of related experience in assessment and testing, particularly certification
  • At least 5 years of personnel management experience
  • Demonstrated experience in managing vendors

Preferred Qualifications:

Excellent leadership, motivational, and organizational skills

Strong communication skills, both written and in-person

Solid time and task management skills

Strong analytical skills: ability to solve complex problems

Working knowledge of LLMs and AI.

Strong innovative skills, both in conceptualization and implementation

Ability to integrate technological improvements and solutions

Proficiency with item-banking best practices and software (eg, ExamDeveloper)

Expert knowledge of computer and Internet-based testing

Proficient with project management tools and applications

Expertise in Microsoft Office applications, particularly Excel and SharePoint

Superior communication skills, both oral and written

Demonstrated public speaking and presentation skills

Excellent facilitation skills

Travel Required

This role requires an on-campus presence up to 15 days a month, subject to change.

This is not a remote position.

Work Environment:

The work environment is an office setting. The noise level in the work environment is usually low to moderate. The environment is also temperature-controlled. This may vary if working from home.

Physical Demands:

While performing the duties of this job, the employee is regularly required to communicate with others. The employee is frequently required to stand, walk, sit, demonstrate hand and finger dexterity in the course of their work, handle or feel, and reach with hands and arms.

Reasonable accommodations may be made to enable individuals with disabilities to perform the essential duties and responsibilities.

The expected physical workload is to be sedentary work—exerting up to 10 pounds of force occasionally and/or a negligible amount of force frequently or constantly to lift, carry, push, pull or otherwise move objects, including the human body. Sedentary work involves sitting most of the time. Jobs are sedentary if walking and standing are required only occasionally and all other sedentary criteria are met.

This role is expected to use the following machines, tools, and equipment:

  • Computer and associated equipment (eg, external monitors, mouse, printer, keyboard)
  • Virtual meeting tools and software
  • AV system for meeting rooms

  • Development Associate Director

    3 weeks ago

    Chapel Hill, United States Inside Higher Ed Full time

    Department: Exec Dir for the Arts-506000 Career Area : Development and Fundraising Position Type: Permanent Staff (EHRA NF) Hours per week: 40 Position Location: North Carolina, US Primary Purpose of Organizational Unit: The Office of the Executive Director for the Arts administratively houses Carolina Performing Arts, a comprehensive performing arts...

  • Director of Development

    3 weeks ago

    Chapel Hill, United States Association of Academic Museums & Galleries Full time

    Director of Development – Carolina Performing Arts, Chapel Hill, NC Lindauer is proud to partner with Carolina Performing Arts in its search for a Director of Development. Carolina Performing Arts (CPA), the acclaimed presenting arm of the University of North Carolina at Chapel Hill, sparks curiosity, encouraging all members of the community to discover...

  • Director of Development

    4 weeks ago

    Crest Hill, United States Catholic Charities, Diocese of Joliet Full time

    Job DescriptionJob DescriptionDescription:Catholic Charities, Diocese of Joliet offers 43 paid days off per year, excellent medical benefits, and an employer-sponsored 403b plan that requires no contribution from employee. We prioritize your well-being and financial security.Do you want to use your skills and talents to make a lasting difference in the...

  • Director of Development

    4 weeks ago

    Crest Hill, United States Catholic Charities, Diocese of Joliet Full time

    Job DescriptionJob DescriptionDescription:Catholic Charities, Diocese of Joliet offers 43 paid days off per year, excellent medical benefits, and an employer-sponsored 403b plan that requires no contribution from employee. We prioritize your well-being and financial security.Do you want to use your skills and talents to make a lasting difference in the...

  • Community Director

    1 month ago

    Chapel Hill, United States The University of North Carolina at Chapel Hill Full time

    s develop and coordinate residential communities of approximately -0 predominantly undergraduate students that augment and extend the intellectual climate of the University. Community Directors serve as the lead educator for students in the community and are designated as managers of their communities; including facilities operations, budget management,...

  • Senior Director

    2 months ago

    Chapel Hill, United States The University of North Carolina at Chapel Hill Full time

    Flexible work arrangements, including virtual/hybrid work locations, are an integral part of the School of Medicine’s Working Forward initiative. As such, this position’s work location is designated as hybrid. Please note that the designated work location is subject to change based on the unit’s business needs. The of Medical Student Education for the...

  • Director of Finance

    2 weeks ago

    Chapel Hill, Tennessee, United States The University of North Carolina at Chapel Hill Full time

    DetailsPosted: 12-Jan-24Location: Chapel Hill, North CarolinaSalary: OpenInternal Number: 272626Vacancy ID: NF0007707Position Summary/Description:The Director of Finance is responsible for the day-to-day finance operations of the UNC Eshelman School of Pharmacy. In this capacity, the position incumbent is responsible for providing overall direction of...

  • Director of Fund Development

    3 weeks ago

    Camp Hill, United States Girl Scouts Heart of Pennsylvania Full time

    Job Type Full-time Description Director of Development is responsible for supervising Fund Development staff, and personally generating funds to support Girl Scouts in the Heart of Pennsylvania and its various initiatives. Director of Development will assist with creating, and then implement and oversee strategies for identification, cultivation,...

  • Director of Fund Development

    1 month ago

    Camp Hill, United States Girl Scouts Heart of Pennsylvania Full time

    Job Type Full-time Description Director of Development is responsible for supervising Fund Development staff, and personally generating funds to support Girl Scouts in the Heart of Pennsylvania and its various initiatives. Director of Development will assist with creating, and then implement and oversee strategies for identification, cultivation,...

  • Assistant Director of Human Resources

    2 weeks ago

    Chapel Hill, United States University of North Carolina at Chapel Hill Full time

    Department University Development Office-250100Career Area Human ResourcesOpen Until Filled NoPosition Type Permanent Staff (EHRA NF)Working Title Assistant Director of Human ResourcesAppointment Type EHRA Non-FacultyPosition Number 20043964Vacancy ID NF0008192Full Time/Part Time Full-Time PermanentFTE 1Hours per week 40Position Location North Carolina,...

  • Assistant Director at Primrose School

    3 weeks ago

    Chapel Hill, United States Primrose School of Chapel Hill at Briar Chapel Full time

    Job DescriptionJob DescriptionBenefits:401(k) matchingCompetitive salaryDental insuranceFlexible scheduleFree food & snacksPaid time offVision insuranceBuild a brighter future for all children.As Assistant Child Care Director of Primrose School of Chapel Hill at Briar Chapel, your dedication to the success of our next generation will ensure we deliver on our...

  • Director of Development

    3 weeks ago

    Cherry Hill, United States Temple Beth Sholom Full time

    Job DescriptionJob DescriptionTemple Beth Sholom Director of Development Job DescriptionTemple Beth Sholom (TBS) is a welcoming and inclusive sacred community that connects its members to one another, Judaism, and Israel through interactive spiritual, educational, and social experiences. TBS is a Conservative synagogue consisting of more than 800 families....

  • Associate Director of Media Relations

    2 months ago

    Chapel Hill, United States NCPRSA Full time

    The University Communications office at the University of North Carolina at Chapel Hill seeks an associate director of media relations for its best-in-class media relations team. Individuals who thrive on driving and supporting a team to accomplish their goals are well suited for this position. If you enjoy combining communications, operations and team...

  • Director, Applications Support

    2 months ago

    Chapel Hill, United States Brighton Health Plan Solutions Full time

    About The Role The Director of Applications Support has responsibility for strategic development and execution of a quality program for system configuration and changes. The role is responsible for establishing a quality dashboard and implement the changes needed to improve quality metrics. This job description is not designed to cover or contain a...

  • Associate Director

    2 months ago

    Chapel Hill, United States InsideHigherEd Full time

    Department:Med Ad-Research-420107Career Area :Research ProfessionalsPosting Open Date:06/10/2024Application Deadline:06/24/2024Open Until Filled:NoPosition Type:Permanent Staff (EHRA NF)Working Title:Associate DirectorAppointment Type:EHRA Non-FacultyPosition Number:20026999Vacancy ID:NF0008222Full Time/Part Time:Full-Time PermanentFTE:1Hours per...

  • Senior Director

    2 months ago

    Chapel Hill, United States InsideHigherEd Full time

    Department:Medical Student Education-420201Career Area :Academic AdministrationPosting Open Date:06/06/2024Application Deadline:07/05/2024Open Until Filled:NoPosition Type:Permanent Staff (EHRA NF)Working Title:Senior DirectorAppointment Type:EHRA Non-FacultyPosition Number:20039158Vacancy ID:NF0008208Full Time/Part Time:Full-Time PermanentFTE:1Hours per...

  • Night Auditor

    2 months ago

    Chapel Hill, United States OTO Development Full time

    Nationally: $13.20 - $15.10*Rate depends upon state/market and experience*OTO Development is pleased to announce a wonderful opportunity for a Night Auditor. What will you be doing most days?Execute guest reservation, check-in, check-out, payment, and service procedures in compliance with brand quality assurance standardsMaintain a friendly and hospitable...

  • Development and Communications Coordinator

    4 weeks ago

    Chapel Hill, United States Chapel Hill-Carrboro Public School Foundation Full time

    BACKGROUNDOur VisionAll students in Chapel Hill-Carrboro City Schools receive an excellent and equitable education from the highest quality teachers.Our MissionAs a champion for local public education since 1984, the Chapel Hill-Carrboro PSF provides additional funding for innovative programs and projects that advance student achievement and teacher...

  • Director of Research

    3 weeks ago

    Chapel Hill, United States InsideHigherEd Full time

    Department:VC for Res-620100Career Area :Research ProfessionalsPosting Open Date:07/10/2024Application Deadline:07/24/2024Open Until Filled:NoPosition Type:Permanent Staff (EHRA NF)Working Title:Director of ResearchAppointment Type:EHRA Non-FacultyPosition Number:20065552Vacancy ID:NF0008312Full Time/Part Time:Full-Time PermanentFTE:1Hours per...

  • Director of Leasing

    2 months ago

    Chestnut Hill, United States WS Development Full time

    The Director of Leasing will lead and manage assigned centers and collaborate with all stakeholders to drive business and develop new opportunities. This position will maximize the leasing potential of the Company's shopping center portfolio by analyzing, planning, and implementing leasing strategy to attain the financial and tenant mix objectives of...