Substance Use Programs Evaluator

Job Description:
Management Analyst IV

The Management Analyst IV, functionally known as the Substance Use Programs (SUP) Evaluator, will work in the Health and Human Services Commission's (HHSC) Substance Use Programs section and report to the Director of Substance Use Programs in Behavioral Health Services. The Programs Evaluator is integral to advancing the mission and vision of substance use services across the state. The SUP Evaluator will perform highly advanced (senior-level) professional organizational analysis and is responsible for developing a comprehensive strategic evaluation plan that encompasses all of prevention, intervention, treatment and recovery focused grants and ensuring that evaluation activities are complementary to the Texas Targeted Opioid Response grant and the Substance Use Prevention, Treatment and Recovery Services Block Grant (SUBG). The Programs Evaluator will interface and work cross-functionally to support projects within the Prevention and Behavioral Health Promotion Unit (PBHP), the Substance Use Intervention and Treatment Programs Unit (SITP), the Texas Targeted Opioid Response (TTOR) Unit, and Peer Support and Recovery (PSR) services to provide complex planning, implementation, and evaluation of programmatic strategies to achieve HHSC priorities and ensure alignment with the BHS Strategic Plan. Coordination and collaboration with additional internal stakeholders, including Contracts Management, Quality Management, Business Operations, Integrated Care Strategies, and Mental Health Programs areas is critical to ensure consistency and continuity for people in need of behavioral health services. In this role, the SUP evaluator will assess the quality, performance, and impact of all SUP programs and projects and help guide future directions for programs and program oversight while ensuring operations are efficient and effective.

The ideal candidate will serve as a consultant and subject matter expert to Substance Use Programs for evaluation activities. Key job functions include, staying abreast of best-practice strategies to evaluate the effectiveness of substance use-related interventions and identify performance measures/tools that should be utilized to measure program effectiveness and to identify and mitigate risks while recommending improvements to better meet the needs of Texas. They will represent SUP on committees, workgroups and projects with key stakeholders across Texas to meet evaluation and data needs; and may represent the state at the national level on substance use evaluation issues. Excellent communication skills and statistical analysis required. Works under minimal supervision, with extensive latitude for the use of initiative and independent judgment. Essential Job Functions:
Data Collection, Analysis, and Quality Improvement: Develops and facilitates the implementation of a multi-stage and multi-year plan for collecting, analyzing and utilizing data at local, regional, and statewide levels. Conducts comprehensive literature reviews, environmental scans, and data analysis to identify and recommend best-practices for the team. Researches and develops possible assessment tools and identifies the most appropriate set of output/outcome measures. Stays abreast of national best practices and literature to identify the most appropriate measures. Provides advanced training to the field on collecting participant data. Reviews and interprets complex data sets, conducts statistical analysis. Performs ongoing qualitative and quantitative analyses of data and information related to evidence based practices. Leads development of protocols for and collect primary data through conducting interviews, focus groups, or surveys; may participate in site visits. Develops recommendations for improvement and/or corrective action to standardize and improve existing systems and can initiate the development of project workplans. Designs and maintains tracking systems for project deliverables and performance measures. (35%)

Comprehensive Strategic Evaluation Plan: Develops a comprehensive strategic evaluation plan that encompasses all substance use focused grants and ensures that evaluation activities are complementary to the grant and funding sources to assess the quality, performance, and impact of all SUP programs and projects. Ensure evaluation plan contains program objectives and goal, evaluation questions, evaluation methods, and timeline for all evaluation activities. (25%)

Stakeholder Collaboration: Collects, organizes, analyzes, and prepares material or presentations in response to requests for information and to present new information. Performs tasks associated to the grants, LBB, the legislative process, external funding organizations, and other priorities and strategies of the BHS section and HHSC that promotes the goals, mission and vision of HHSC. Supports SUP by using data to improve programs and respond to client needs. Participates and may facilitate statewide and regional epidemiological work groups, as applicable. (20%)

Technical Writing and Information Dissemination: Translates and communicates research findings for a variety of different audiences through compelling written, visual, and real-time mediums, including reports, data visualization tools/dashboards, and other tools to communicate findings. Communicates research findings through compelling written, visual, and real-time mediums that must be accessible, engaging, and actionable ways for our diverse set of clients in alignment with CLAS standards. Participates in the development of grant or funding applications as it relates to evaluation and data analysis. Contributes to the development of dissemination materials, including manuscripts, presentations, policy manuals, and grant reports. Develops and prepares internal reports on status, progress and outcomes of evaluation activities. (15%)

Completes other duties as assigned in accordance with the direction of the Substance Use Programs Director or their designee. (5%) Knowledge Skills Abilities:
Knowledge of:
- Principles of health and human services policy and planning;
- local, state, and federal laws related to the program area;
- public administration and management techniques;
- statistical analysis processes, budget processes; research techniques; training and marketing techniques; and of program management processes and techniques
-Demonstrated knowledge with substance use data and surveillance

Skills In:
- Developing and implementing communications strategies;
- Managing multiple and competing priorities;
- Leadership, communication and public speaking;
- Use of computer software, specifically Windows, Microsoft Outlook, Word, Excel, PowerPoint, PowerApps, and Access;
- developing, writing and editing executive documents and briefings
-Ability to engage with, listen to, and learn from a broad range of evaluation stakeholders, encouraging their meaningful participation ;
- Survey design;
- Statistical testing, data analysis and experience using statistical software programs (e.g., SPSS, R, SAS, Stata, MAXQDA, NVivo);
Experience using data collection programs (i.e. SurveyMonkey, REDCap, Qualtrics, etc).

Ability to:
- Communicate, clarify, and analyze strategies across multiple projects; interpret, and evaluate potential for overlap among various allocations; develop contingency plans, draw solutions, and convey expected actions for moving forward with project activities --
- Ensure evaluation activities are done in a culturally competent manner --
- Conduct statistical analysis and use data visualization to communicate data in easily digestible ways for a variety of audiences.
- Understand and effectively interpret agency and program rules, policies and procedures
- Communicate effectively orally and in writing -
- Gather, assemble, correlate and analyze facts
- Demonstrate strong organizational skills and prioritize workload
- Work independently with minimal supervision
- Think strategically and holistically while simultaneously being detail-oriented
- Establish and maintain positive relationships with external partners, and individuals and groups with diverse needs and priorities
Ability to convene groups

---