Project Title
Readiness for Program Evaluation Among Departments of Public Health
Faculty Mentor(s) Name(s)
Damian Francis
Abstract
INTRODUCTION: Program evaluation is a critical component of public health practice and can enhance effectiveness and accountability for public health actions. METHODS: As part of a State-wide public health district (PHD)program evaluation, an online survey was administered to 17 PHD program managers to assess readiness for program evaluation of the Healthy Communities Initiative (HCI) nutrition and physical program. The 31-item survey assessed readiness using the CDC framework for evaluation practice on a 5-point Likert scale ranging from “strongly agree” to “strongly disagree”. RESULTS: 11PHDs completed the survey. In assessing capacity for evaluation, 64% of districts strongly agreed that planned goals were aligned with HCI goals. In contrast 64% reported an inadequate evaluation team. While 54.6% reported representing stakeholders’ interest, 45.5% had no plan for engaging stakeholders. Approximately 75% strongly agreed they identified the target population but 55% were unfamiliar with resources needed for program evaluation. There was low readiness in the domain “focus of the evaluation” with 50% of districts strongly disagreeing that they had a clear evaluation design, evaluation questions, or plan to address the CDC standards. Fifty percent or more strongly disagreed that they had a plan for use of evaluation findings or a medium to disseminate findings to target audience. CONCLUSION: PHDs program evaluation goals are aligned with HCI goals for nutrition and physical activity and addresses the priority target population. Deficits in readiness related to capacity and resources, stakeholder engagement, focus of the evaluation, gathering credible evidence and planned dissemination of findings needs to be addressed.
Readiness for Program Evaluation Among Departments of Public Health
INTRODUCTION: Program evaluation is a critical component of public health practice and can enhance effectiveness and accountability for public health actions. METHODS: As part of a State-wide public health district (PHD)program evaluation, an online survey was administered to 17 PHD program managers to assess readiness for program evaluation of the Healthy Communities Initiative (HCI) nutrition and physical program. The 31-item survey assessed readiness using the CDC framework for evaluation practice on a 5-point Likert scale ranging from “strongly agree” to “strongly disagree”. RESULTS: 11PHDs completed the survey. In assessing capacity for evaluation, 64% of districts strongly agreed that planned goals were aligned with HCI goals. In contrast 64% reported an inadequate evaluation team. While 54.6% reported representing stakeholders’ interest, 45.5% had no plan for engaging stakeholders. Approximately 75% strongly agreed they identified the target population but 55% were unfamiliar with resources needed for program evaluation. There was low readiness in the domain “focus of the evaluation” with 50% of districts strongly disagreeing that they had a clear evaluation design, evaluation questions, or plan to address the CDC standards. Fifty percent or more strongly disagreed that they had a plan for use of evaluation findings or a medium to disseminate findings to target audience. CONCLUSION: PHDs program evaluation goals are aligned with HCI goals for nutrition and physical activity and addresses the priority target population. Deficits in readiness related to capacity and resources, stakeholder engagement, focus of the evaluation, gathering credible evidence and planned dissemination of findings needs to be addressed.