DDHA 8006 Week 5 Claim-Based Literature Appraisal Example

Where the Studies Agree, Where They Contradict, and Why: A Claim-by-Claim Appraisal of the Referral Completion Literature

Student Name

Walden University

DDHA 8006: Doctor of Healthcare Administration Foundational Concepts

Instructor Name

Month Day, Year

Where the Studies Agree, Where They Contradict, and Why: A Claim-by-Claim Appraisal of the Referral Completion Literature

Approach

The annotated bibliography for this course judged sources one at a time against the problem at Tallgrass Medical Group, the invented primary care group whose specialty referrals too often go unclosed. This appraisal reorganizes the same literature by claim. For each of four claims that matter to the inquiry, it asks where studies agree, where they contradict each other and what explains the contradiction. Organizing by claim rather than by source shows what the field knows, as opposed to what each author said.

Claim 1: Referral Breakdowns Occur at Several Distinct Stages

The literature agrees on this claim. Mehrotra et al. (2011) described failures at the referral question, the transfer of information to the specialist, scheduling and the return of information. Forrest et al. (2000), writing a decade earlier in pediatrics, found that physicians on both sides judged referrals by whether information moved between them. Patel et al. (2018) measured completion in an academic system and found failures both before and after the specialist visit. No study reviewed argues that breakdowns are confined to a single stage. The agreement is strong because it comes from different methods, a review, a survey and a records analysis, which would be unlikely to share the same bias.

Claim 2: Referral Volume Has Grown

Here the evidence is narrower but uncontradicted. Barnett et al. (2012) showed a large rise in visits ending in referral in national data between 1999 and 2009. No reviewed study disputes the trend. The limit is age: the data end in 2009, and the more recent shift toward value-based contracts and e-consults may have changed the pattern since. The claim should be stated with its period.

Claim 3: Electronic Referral Systems Improve Referral Outcomes

This is where the literature appears to contradict itself, and the contradiction is instructive. Studies from integrated public systems report clear benefits: clinicians perceived improved access and communication after electronic referral was introduced (Kim-Hwang et al., 2010), and the system's leaders described shorter waits and more appropriate referrals (Chen et al., 2013). A systematic review of e-consults found evidence of improved timely access, but also variable study quality and some studies showing little effect (Vimalananda et al., 2015).

What explains the apparent contradiction? Two things. First, the studies measured different outcomes. Perceived communication and timely access can improve while completion remains incomplete, because completion depends also on patients attending and specialists reporting back. Second, every study shares a setting feature: primary and specialty care on one record within one organization. In that setting, an electronic referral is visible to both sides. In a group like Tallgrass, whose cardiologists and dermatologists mostly sit in outside practices with their own charts, an electronic order may disappear at the organizational boundary. The contradiction is therefore less between studies than between outcomes, and the evidence is silent on the setting that matters most here.

Table 1

Studies on Electronic Referral and Their Settings

Positive findings cluster where outcomes were perceptions or access; the one record-based completion study found many referrals still unclosed.

Claim 4: Information Return Is Part of Completion

The literature agrees in principle but varies in practice. Forrest et al. (2000) and Mehrotra et al. (2011) treat the report back as essential to coordinated care. Patel et al. (2018) distinguished completed visits from fully closed loops. But many studies of electronic referral measure only whether the patient reached the specialist. The inconsistency is one of definition, not disagreement: researchers who include information return find lower completion than those who do not. For Tallgrass, the definition matters because clinicians remain responsible for acting on specialist findings they never receive.

What the Synthesis Means for the Inquiry

Read by claim, the literature supports three conclusions for Tallgrass. Referral failure should be measured stage by stage, because the stages fail for different reasons. Completion should be defined to include the report back, because the literature that includes it finds the problem larger and more relevant to patient safety. And the evidence for electronic referral should not be imported without qualification, because the positive findings come from integrated settings and from outcomes other than completion. The gap identified in the problem statement is confirmed: there is little evidence on referral completion when referrals cross organizational boundaries.

Implications for Measurement Design

The synthesis also shapes how Tallgrass should measure its problem. Because the studies that included information return found lower completion than those that did not, Tallgrass should report two rates: visits completed and loops closed, with closure requiring a report in the record. Because failures differ by stage, the measurement should record where each unclosed referral stopped. And because the integrated-system studies cannot speak to referrals crossing organizational lines, the sample should be stratified by whether the receiving specialist shares Tallgrass's record, so that the difference, if any, can be seen directly. These three design choices follow from the literature's agreements and from the reasons behind its apparent contradictions.

Limits of the Appraisal

The appraisal draws on seven sources, chosen for relevance to a bounded problem rather than through a systematic search. A systematic search might find studies from independent practice settings that change the third conclusion. That search is planned as the next step.

Conclusion

The literature agrees that referrals fail at multiple stages, that referral volume has grown and that information return matters. It appears to disagree about electronic referral, but the disagreement dissolves once outcomes and settings are compared: perceived access improves in integrated systems, while measured completion remains incomplete even there. For Tallgrass, the most important finding is what the literature does not yet show: how referrals fare when they leave one organization for another.

References

Barnett, M. L., Song, Z., & Landon, B. E. (2012). Trends in physician referrals in the United States, 1999-2009. Archives of Internal Medicine, 172(2), 163-170. https://doi.org/10.1001/archinternmed.2011.722

Chen, A. H., Murphy, E. J., & Yee, H. F. (2013). eReferral: A new model for integrated care. New England Journal of Medicine, 368(26), 2450-2453. https://doi.org/10.1056/NEJMp1215594

Forrest, C. B., Glade, G. B., Baker, A. E., Bocian, A., von Schrader, S., & Starfield, B. (2000). Coordination of specialty referrals and physician satisfaction with referral care. Archives of Pediatrics and Adolescent Medicine, 154(5), 499-506. https://doi.org/10.1001/archpedi.154.5.499

Kim-Hwang, J. E., Chen, A. H., Bell, D. S., Guzman, D., Yee, H. F., & Kushel, M. B. (2010). Evaluating electronic referrals for specialty care at a public hospital. Journal of General Internal Medicine, 25(10), 1123-1128. https://doi.org/10.1007/s11606-010-1402-1

Mehrotra, A., Forrest, C. B., & Lin, C. Y. (2011). Dropping the baton: Specialty referrals in the United States. The Milbank Quarterly, 89(1), 39-68. https://doi.org/10.1111/j.1468-0009.2011.00619.x

Patel, M. P., Schettini, P., O'Leary, C. P., Bosworth, H. B., Anderson, J. B., & Shah, K. P. (2018). Closing the referral loop: An analysis of primary care referrals to specialists in a large health system. Journal of General Internal Medicine, 33(5), 715-721. https://doi.org/10.1007/s11606-018-4392-z

Vimalananda, V. G., Gupte, G., Seraj, S. M., Orlander, J., Berlowitz, D., Fincke, B. G., & Simon, S. R. (2015). Electronic consultations (e-consults) to improve access to specialty care: A systematic review and narrative synthesis. Journal of Telemedicine and Telecare, 21(6), 323-330. https://doi.org/10.1177/1357633X15582108