Director, Assessments and Evaluation

Overview

The Director, Assessments and Evaluations (Program Director III) will lead the Assessment and Evaluations program under the Undergraduate Medical Education (UME) department across all Wake Forest University School of Medicine (WFUSM) campuses. This role will oversee all aspects of assessment and evaluation for the UME department and is responsible for supporting activities related to academic and program review, helping the program to develop a culture of analysis for the program through leadership, strategic vision, clear guidance/communication, and careful execution.

This position will report directly to the AVP, Operations and Administration for Undergraduate Medical Education and will collaborate with other Wake Forest University School of Medicine (WFUSM), Atrium Health and Atrium Health Wake Forest Baptist Health leaders, to implement a vision and strategy for the collective academic enterprise with defined goals and outcomes that encompass measures of justice, equity, diversity, and inclusion. The candidate will be a team player focused on using assessment and evaluations data for the greater good of the Undergraduate Medical Education department.

Minimum Requirements:

• Masters / Ph.D degree and at least five (5) years of experience directly related to the duties and responsibilities specified.
• Degree in Mathematics, Statistics, or Educational Psychology strongly preferred.
• Experience as a Chief Proctor with National Board of Medical Examiners
• Experience with SACSCOC accreditation;
• Experience as a SACSCOC evaluator
• At least three (3) years of progressive supervisory experience in medical education in evaluation or assessment team
• High energy, team-oriented, people-focused with a passion for excellence consistent with WFUSM's culture and core values and operating with the utmost integrity.
• Able to successfully navigate a complex academic, clinical, research organization with multiple internal and external stakeholders, leading through influence and with transparency to gain trust and credibility.

Essential Functions:

• Responsible for leading the evaluation of critical aspects of the institution's recently reformed medical student curriculum, overseeing learner assessment, providing faculty development, and collaborating with the institution's medical education committee.
• Serves as the Executive Chief Proctor (ECP) for the UME under WFUSM. This person is responsible for communications between UME and the National Board of Medical Examiners.
• Provides strategic oversight of the Assessment and Evaluation program; manages the related staff and budgetary needs.
• Collaborates with other departments within the UME and the WFUSM to ensure quality and efficiency in all evaluations and assessment activities.
• Proactively conducts and/or supervises data collection, data analysis, and reporting for robust program evaluation and improvement at various levels;
• Ongoing review of evaluation ensuring all accreditation standards are met for LCME and SACSCOC accreditation in collaboration with the Office of Education Institutional Effectiveness and Compliance.
• Analyzes data and creates reports to be shared with Senior Leadership and relevant committees to inform policies and decision-making. These range from analysis of admissions data for predicting performance in medical school, to academic surveillance reports for both pre-clinical and clinical years, to an MD Program Evaluation report to collate and summarize program evaluation data annually, and to data after graduation including but not limited to Step 3 data and residency director survey data;
• Work with the Office of Education Institutional Effectiveness and Compliance to review data and results;
• Serve as an Ex-Officio member of various committees;
• Work with course directors, clerkship directors, and Directors of Pre-Clerkship, Longitudinal, and Clinical programs to ensure comprehensive program evaluation and student assessment needs are met;
• Participate in development of new programs and platforms for assessment purposes by the National Board of Medical Examiners (NBME);
• Ensure NBME standards and practices are upheld in the testing environment;
• Explore and implement innovative ways to increase work efficiency and effectiveness for the evaluation unit;
• Supervise test construction, proctoring, scoring, reporting and remediation as well as providing mid-course and end-of-course feedback to students;
• In collaboration with the assessment and evaluation team, lead and support the training of proctors for both in-house and NBME examinations
• Facilitates the provision of testing accommodations, in partnership with the learning assistance specialists;
• Provide training to staff and faculty on new testing platforms;
• Facilitate test construction and assessment quality improvement by providing item level data;
• Analyze student performance on standardized and local exams, prepare reports and guide course directors on interpreting results;
• Collaborate with IT teams to ensure quality and efficiency in evaluation and assessment processes;
• Consultation, collaboration and initiation of medical education research projects;
• Serve on committees for national and international professional organizations;
• Other duties as assigned.

Preferred Requirements/Core Competencies:

Excellence:

• Strives continuously for improvement in work performance.
• Acknowledges and takes responsibility for commitments to the university.
• Contributes to the university's success by consistently delivering quality results in the performance of job duties and responsibilities.

Respect:

• Treats others with courtesy, respect and dignity in the workplace
• Promotes cooperation through open and honest communication, considering others' ideas, thoughts, and opinions.

Integrity

• Upholds high ethical standards of conduct in job performance.
• Takes responsibility for actions.
• Respects and complies with department and university policies, procedures.

Service Mindset

• Address our students, Deans, faculty and staff needs and expectations within the department
• Mentors and guides department/section staff, sharing knowledge and best practices.
• Maintains positive interactions with students, faculty and other staff, ensuring professional conduct and consistent application of university policies and procedures and follow up on requests.
• Assumes responsibility for addressing complex and/or unusual requests.

Organizational Management

• Manages department consistent with the organizations mission and vision.
• Supervises the work of staff employees.
• Sets clear goals and expectations within reasonable timeframes.
• Fosters a collaborative and productive work environment that advances the program's operations and initiatives through motivation, encouragement and professional development of staff
• Develops program's procedures and work rules for compliance with regulations and university policies; leads and/or participates in the development and revision of applicable policies/procedures.
• Competently represents the program through interactions with the university community and/or external constituents.
• Possesses comprehensive knowledge and skills in the technical area of assessment of evaluation.
• Effectively applies expertise to troubleshoot existing systems and develop solutions with existing technology.
• Competent to learn new technologies and integrate them with existing technology.
• Strives continuously for improvement in work performance.

Specific Job Duties:

• Supports continuous academic program assessment (curricular and co-curricular activities) and improvement of student learning through consultation, mentoring and hands-on training of staff and faculty in state of the art assessment methodology.
• Leads the development, organization, analysis and reporting of student learning outcomes.
• Directs internal and external communication of assessment results.
• Supports the ongoing development and implementation of comprehensive outcomes assessment programs for all academic and administrative units that support the goals of the university's strategic plan and Continuous Quality Improvement (CQI).
• Records, stores, manages, and disseminates confidential and sensitive assessment data, as appropriate.
• Leads and supervises office personnel, to include work allocation, training, and problem resolution; provides performance management feedback as appropriate.
• Partners with the Office of Institutional Effectiveness to implement and sustain a climate of leading edge assessment strategy and quality improvement methodology.
• Demonstrate and uphold Atrium Health's Culture Commitments:

We create a space where all Belong

We Work as One Team to make great things happen

We earn Trust in all we do

We Innovate to better the now and create the future

We drive for Excellence – always

Wake Forest University values diversity and is committed to equal opportunity in employment.

WFUSOM-1