PUBH 4100 Week 11 Evaluation Report Example

For the Reader With a Decision Waiting: The Evaluation Report on a Composite County's Swim Lesson Voucher Program, Its Judgment and the Recommendations It Declines to Make

Student Name

Walden University

PUBH 4100: Evaluating Public Health Programs

Instructor Name

Month Day, Year

For the Reader With a Decision Waiting: The Evaluation Report on a Composite County's Swim Lesson Voucher Program, Its Judgment and the Recommendations It Declines to Make

Front Matter

Program: Free Swim Lesson Vouchers, run jointly by county parks and health departments. Evaluation period: summer 2026. Commissioned by: the Director of Parks and Recreation and the Health Officer. Evaluator: program evaluator, county health department. Report date: October 2026.

Judgment in Brief

The program brought most children who completed it to a defined level of water competence: 72.0% of tested completers passed every one of the five checklist items when last tested, compared with 18.5% at the first lesson. Against the 70% standard agreed in advance, the result is "not clearly met," because the confidence interval, 68.8% to 74.9%, includes values below the threshold. The program reached about 13% of eligible children. Most of the gain among completers is likely due to the lessons.

The Program

Vouchers for eight free group lessons at county pools went to 4- to 12-year-olds whose families were on Medicaid or food assistance, distributed through WIC, food assistance offices and schools. In summer 2026, 1,560 vouchers were issued and 1,240 children attended at least one lesson.

The Evaluation Question and Standard

Main question: what share of children attending six or more lessons cleared the full five-part checklist in the closing session, and was that share 70% or more? The standard, its failure point below 60% and a precision rule were agreed with both departments before data collection, following an evaluation framework that places standards before evidence gathering (Milstein & Wetterhall, 2000).

Methods

Children were tested with a five-element water competence checklist at the first and final lessons, an approach consistent with the practical idea of water competence in drowning prevention research (Stallman et al., 2017). Attendance came from instructor check-in sheets. A second instructor scored a random 10% of final tests. Reach used a county estimate of eligible children. The design had no comparison group; its limits were set out in a design memo before results were known.

Findings

Delivery was close to plan: 112 of 120 sessions were held, though classes averaged 9.4 children against a planned 8, and one pool's sessions were shortened by repairs.

Table 1

Key Findings, Summer 2026 (Composite)

Note. Composite figures from the evaluation.

How the Evaluation Was Run

The evaluation followed a sequence fixed at the start of the year. The evaluation question was agreed in May, the evidence standard in early June and the design memo, which named the missing comparison group and the claims to be given up, in mid June. Instructors were trained on the checklist before the first session. Check-in sheets and test forms reached the evaluator weekly, completeness checks ran after each session, and the second-instructor sample was drawn at random from all final tests. An interim summary reached the parks director in late August, in time for the budget request, and this full report follows the schedule set out in the stakeholder map. Every decision that could have been bent to fit the results, the threshold, the failure point, the precision rule and the attribution language, was written down before the relevant data were seen.

Attribution

Maturation over a four-week interval, outside practice, lenient scoring and selection were each weighed. Outside practice and possible leniency contribute modestly; none explains most of the rise. Single-group pre-post designs cannot rule out all alternatives (Harris et al., 2006), so the report's conclusion is limited to completers and avoids estimating the size of the effect.

Recommendations

1. Continue the program next summer; the evidence supports its value for children who complete it.

2. Cap class size at eight, since the lowest-performing pool also had the largest classes; treat this as a test, with pass rates compared by class size next year.

3. Add practice time on floating and treading, the element children most often failed.

4. Pilot a waitlist comparison at one pool to strengthen next year's evaluation.

5. Survey eligible families who did not use vouchers, through WIC offices, to learn why reach was low.

Recommendations the Report Declines to Make

It does not recommend expanding the program on the grounds that it reduced drowning, because the evaluation did not measure drowning; whatever protection lessons may give against drowning is documented in other studies (Brenner et al., 2009). It does not recommend closing pool D or replacing its instructors, because class size, not instruction, is the more likely explanation and has not yet been tested. It does not recommend changing the 70% standard after seeing the results.

What Each Reader Should Take From This Report

For the parks director, the pass rate is close to the agreed standard, delivery was largely as planned, and the class size finding gives a concrete change to fund. For the county board, the program served 1,240 local children, most completers gained water competence, and continuing it is supported. For the health officer, reach is the larger problem: about 87% of eligible children did not use a voucher, and the program's benefit cannot extend to them until that changes. For pool managers, pool-level results and class sizes are included in an appendix so each pool can see its own figures. For parents, a one-page notice in plain language will report what most children could do by the last lesson: enter the water, come back up, float or tread for a minute, swim 25 yards and climb out.

Limits

No comparison group; completers only for the main question; skills measured once, at the end of lessons; reach based on an approximate denominator; and pool E reported separately because its sessions were shortened.

References

Brenner, R. A., Taneja, G. S., Haynie, D. L., Trumble, A. C., Qian, C., Klinger, R. M., & Klebanoff, M. A. (2009). Association between swimming lessons and drowning in childhood: A case-control study. Archives of Pediatrics & Adolescent Medicine, 163(3), 203-210. https://doi.org/10.1001/archpediatrics.2008.563

Harris, A. D., McGregor, J. C., Perencevich, E. N., Furuno, J. P., Zhu, J., Peterson, D. E., & Finkelstein, J. (2006). The use and interpretation of quasi-experimental studies in medical informatics. Journal of the American Medical Informatics Association, 13(1), 16-23. https://doi.org/10.1197/jamia.M1749

Milstein, B., & Wetterhall, S. (2000). A framework featuring steps and standards for program evaluation. Health Promotion Practice, 1(3), 221-228. https://doi.org/10.1177/152483990000100304

Stallman, R. K., Moran, K., Quan, L., & Langendorfer, S. (2017). From swimming skill to water competence: Towards a more inclusive drowning prevention future. International Journal of Aquatic Research and Education, 10(2), Article 3. https://doi.org/10.25035/ijare.10.02.03