MMHA 6530 Week 8 Scale-Up Evidence Critique Example

Would It Work Here? Four Tests of an Urban Program's Evidence Before Bluestem Scales Up

Student Name

Walden University

MMHA 6530: Disease Prevention and Care Management

Instructor Name

Month Day, Year

Would It Work Here? Four Tests of an Urban Program's Evidence Before Bluestem Scales Up

The Evaluation Being Tested

Bluestem Health Network's leadership has been shown an evaluation from an urban clinic system, here a composite of the kind of report health systems share at conferences, describing a program that paired community health workers with clinical pharmacists for adults with hypertension. According to its authors, blood pressure control among participants improved substantially over one year, and the program is described as ready for adoption elsewhere. The report is careful and honest about what it did. The question here is narrower: whether its results tell Bluestem what to expect if it scales up its own program across all five counties. This critique applies four tests and reaches a verdict.

Test 1: Populations

The urban program enrolled patients who agreed to join when invited during a clinic visit. Many lived near a bus line, within a short trip of the clinic. Bluestem's first priority tier is adults who stopped coming to clinic at all, many of them an hour or more from the nearest site. Patients who accept an invitation during a visit are already engaged with care and may be more motivated than average; adults the clinic has lost track of for twelve months or more are, almost by definition, the opposite. The urban results therefore describe a more favorable population than Bluestem's first tier. Improvements in a group that volunteers during a visit may overstate what outreach to disengaged adults can achieve.

Test 2: Resources

The urban program was funded by a multiyear grant that paid for a staffing level, per patient, well above what Bluestem's operating budget allows. Its community health workers carried smaller caseloads, and its pharmacists had more time per patient. Bluestem's design assumes about 120 active patients per worker and a single pharmacist for the whole network. Team-based hypertension care is effective across many studies (Carter et al., 2009), but the size of the effect depends on how much contact patients actually receive. A program delivered at lower intensity should expect a smaller improvement, at least until its own data show otherwise.

Test 3: The Outcome Measured

The report measured blood pressure control among patients who completed the program, not among everyone enrolled. Patients who dropped out, moved or stopped responding were excluded from the final analysis. Completers are likely to be the patients who were doing well, so control among completers overstates the program's effect on the population it set out to serve. A fair comparison would count every enrolled patient, treating those lost to follow-up as not controlled or reporting them separately, and would compare against similar patients who were not enrolled. Rigorous trials of team-based hypertension care have done this. One cluster randomized trial of home telemonitoring with pharmacist management compared whole clinics and still found a meaningful improvement in control (Margolis et al., 2013), which shows such programs can work, but also that their effects should be measured on everyone.

Test 4: Authorship and Incentives

The report was written by the team that ran the program, and it was presented as part of the case for renewing its grant. That does not make it wrong. It does mean the authors had reasons to emphasize success and limited time or funds for independent analysis. Bluestem should read it as a credible account of what one program did and achieved among its participants, not as an independent estimate of what similar programs achieve elsewhere.

Verdict

The urban program's evidence supports adopting the model: community health workers and a pharmacist working under protocol, with home monitoring. Stronger evidence from randomized studies supports the same components (Carter et al., 2009; Margolis et al., 2013), and community health worker programs have shown benefits in rigorous trials as well (Kangovi et al., 2020). The evidence does not support expecting Bluestem to match the urban program's results, especially in its first tier of disengaged rural patients and at lower staffing per patient. Bluestem should plan for a smaller effect, measure control among everyone enrolled and everyone eligible, and scale up only when its own data show progress.

What Bluestem Should Do

Three steps follow. First, launch in the two remote counties as planned, but describe the expected improvement to leadership as uncertain and likely smaller than the urban report's. Second, measure control among all enrolled patients, not only completers, and compare with eligible patients in counties where the program has not yet started. Third, adopt an expansion rule: add counties only when process targets, such as the share of Tier 1 patients reached and the share submitting home readings, are met for two consecutive quarters. That rule ties growth to Bluestem's own evidence rather than to another system's report.

Questions to Ask the Urban Team

The urban team may be able to answer some of these concerns, and Bluestem should ask rather than assume. Five questions would help most. How many patients were invited, how many enrolled and how many completed, so that the share lost along the way is known? What was control among all enrolled patients, counting those who left? How many patients did each community health worker and pharmacist carry at a time? Did the team see any difference in results between patients who lived near the clinic and those farther away? And what happened to blood pressure control in the year after the program ended for each patient?

Answers to these questions would let Bluestem adjust its own expectations and design. If control among all enrolled patients was still good, the case for the model strengthens. If most of the improvement came from patients who lived close to the clinic, Bluestem's remote counties will need more support than planned. If control slipped after the program ended, Bluestem should plan for longer follow-up than four months. The goal of the critique is not to dismiss a colleague's work but to learn as much from it as possible before committing resources. Asking these questions openly also models the kind of evidence Bluestem will want to produce about its own program.

References

Carter, B. L., Rogers, M., Daly, J., Zheng, S., & James, P. A. (2009). The potency of team-based care interventions for hypertension: A meta-analysis. Archives of Internal Medicine, 169(19), 1748-1755. https://doi.org/10.1001/archinternmed.2009.316

Kangovi, S., Mitra, N., Grande, D., Long, J. A., & Asch, D. A. (2020). Evidence-based community health worker program addresses unmet social needs and generates positive return on investment. Health Affairs, 39(2), 207-213. https://doi.org/10.1377/hlthaff.2019.00981

Margolis, K. L., Asche, S. E., Bergdall, A. R., Dehmer, S. P., Groen, S. E., Kadrmas, H. M., Kerby, T. J., Klotzle, K. J., Maciosek, M. V., Michels, R. D., O'Connor, P. J., Pritchard, R. A., Sekenski, J. L., Sperl-Hillen, J. M., & Trower, N. K. (2013). Effect of home blood pressure telemonitoring and pharmacist management on blood pressure control: A cluster randomized clinical trial. JAMA, 310(1), 46-56. https://doi.org/10.1001/jama.2013.6549