PUBH 4900 Week 11 Capstone Report Example

Measured Before It Began: A Capstone Report Asking Whether the Published Record Shows San Francisco's Flavored Tobacco Restriction Raising Smoking Among High School Minors

Student Name

Walden University

PUBH 4900: Capstone in Public Health

Instructor Name

Month Day, Year

Measured Before It Began: A Capstone Report Asking Whether the Published Record Shows San Francisco's Flavored Tobacco Restriction Raising Smoking Among High School Minors

Abstract

San Francisco enforced a comprehensive restriction on flavored tobacco sales from January 2019. A widely cited analysis linked the policy to odds of past-month smoking more than twice those expected among high schoolers under 18 in the city. This capstone asked whether the published record can carry that claim. It appraised seven sources on the policy's timing, retail compliance, tobacco sales and youth behavior. The decisive finding is that the San Francisco survey wave used as the post-policy observation was reportedly given to students in the last four months of 2018, ahead of enforcement and at a time when 17% of retailers complied. Sales data show flavored products disappearing and cigarette sales falling after enforcement. The verdict: the causal claim lacks support, though the same evidence cannot show that the policy reduced minors' smoking either.

Introduction

Flavored tobacco restrictions are among the most common local tobacco control policies in the United States. Evaluations of them vary in design and quality, and a review of local restrictions found moderate to high quality evidence that they cut the availability, promotion and sales of the products they target, alongside weaknesses in many study designs (Rogers et al., 2022). In that uneven literature, a single finding that a restriction increased youth smoking carries unusual weight. The San Francisco analysis (Friedman, 2021) is such a finding. It has been cited against flavor restrictions in other places. This capstone examines whether it can bear that weight.

The question has not changed since its approval in Week 2. Put briefly: can the published record sustain the claim that enforcing the restriction in January 2019 caused more past-month cigarette smoking among San Francisco high schoolers under 18?

Methods

The capstone is an evidence appraisal, not a new analysis. Sources were included if they reported on the San Francisco policy's timing, implementation or effects, or on comparable local restrictions as context. Each was judged on what it measured, its directness for this question and the strength of its result. Vaping was excluded as an outcome because the survey did not distinguish nicotine from cannabis in a year when California legalized recreational cannabis (Friedman, 2021). Students aged 18 and older were excluded to match the population of the original claim. The reasoning from evidence to verdict was set out step by step, and the strongest counterclaim was stated and answered.

Findings

The Policy's Timeline

Voters upheld the restriction in June 2018. The health department ran a retailer education campaign from September to December 2018. Compliance inspections began in December 2018, when 17% of retailers complied; by January 2019 it was climbing, and across that year it averaged 80% (Vyas et al., 2021).

Retail Sales

Scanner records of weekly sales, mid-2015 to the end of 2019, put San Francisco's flavored tobacco sales down an estimated 96% after enforcement relative to the pre-policy period, with no substitution toward products bearing vague flavor names. Total tobacco sales fell 25%, while San Jose's fell 8% and San Diego's 17% (Gammon et al., 2022).

The Original Estimate

Using district survey data from 2011 to 2019, the original analysis compared San Francisco with seven other districts. The 2019 wave put recent smoking among San Francisco minors at 6.2%, compared with 2.8% across the comparison districts. The estimated adjusted odds ratio was 2.24 (95% CI 1.42 to 3.53), robust to district time trends and to a California-only comparison. Exposure was coded by whether the ban was active on the first day of each survey year, on the assumption that students answered in spring (Friedman, 2021).

The Survey's Timing

According to an inquiry to CDC by Liu et al. (2023), students in San Francisco took the 2019 survey during fall 2018, between September and December. The national survey for that cycle spanned August 2018 through June 2019 (Underwood et al., 2020), so a fall fielding for a district is plausible. Friedman (2022) later corrected the record on when the waves were collected.

Context From Other Settings

In Oakland, where a partial restriction took effect in July 2018 and the 2019 survey followed it, the high school smoking rate went from 4.4% in 2017 to 2.4% in 2019, and vaping from 11.2% to 8.0% (Liu et al., 2023). Massachusetts data show lower teen e-cigarette use, and lighter smoking among teens who smoked, where local restrictions were more extensive (Hawkins et al., 2022).

Table 1

Summary of Evidence Against the Claim's Requirements

Note. Each row is a condition the causal claim needs; none is met.

Discussion

The capstone's verdict turns on one fact. A difference-in-differences estimate compares change after a policy in a treated place with change elsewhere. If the "after" observation predates the policy, the estimate measures something else. The best available evidence places San Francisco's 2019 survey before enforcement, and the compliance record, produced independently by the city's health department, agrees that the policy had not yet taken hold during those months. The original analysis was well designed for the dates it assumed. The dates appear to have been wrong.

The strongest counterclaim is that students surveyed in fall 2018 may have been responding to a policy already decided and publicized. This is possible in principle, but it requires substitution toward cigarettes while most stores still sold flavored products, and it is contradicted by falling cigarette sales once the policy did take hold.

What the higher 2019 smoking figure does reflect remains unexplained. Possible explanations include chance in a small number of smokers and effects of cannabis legalization in 2018, both raised by Liu et al. (2023). The capstone cannot choose among them.

Recommendations

Anyone citing the San Francisco estimate should state that the survey wave appears to predate enforcement. Survey programs should publish district fielding windows with their data. Evaluators should date policy exposure by enforcement and measured compliance rather than adoption, and should check single-district survey findings against supply data. The capstone declines to recommend that other cities adopt San Francisco's policy, because its findings concern the flaw in one study, not the policy's benefit.

Limitations

The timing finding rests on a published report of a communication with CDC that I could not verify from public files. I did not reanalyze raw data. The capstone cannot rule out every early effect of the policy before enforcement, and it says nothing about minors' smoking after January 2019, for which no direct published estimate was found.

Conclusion

Published evidence gives no support to the charge that the flavored tobacco restriction made more of San Francisco's high school minors smoke. The study behind the claim appears to have measured the city before the policy began. That verdict is narrow: the evidence also does not show that the policy reduced minors' smoking. What it shows is that a policy cannot be blamed for a change recorded before it took effect.

References

Friedman, A. S. (2021). A difference-in-differences analysis of youth smoking and a ban on sales of flavored tobacco products in San Francisco, California. JAMA Pediatrics, 175(8), 863-865. https://doi.org/10.1001/jamapediatrics.2021.0922

Friedman, A. S. (2022). Clarification and correction of survey wave collection dates in an analysis of youth smoking and a ban on sales of flavored tobacco products in San Francisco, California. JAMA Pediatrics, 176(9), 947. https://doi.org/10.1001/jamapediatrics.2022.2388

Gammon, D. G., Rogers, T., Gaber, J., Nonnemaker, J. M., Feld, A. L., Henriksen, L., Johnson, T. O., Kelley, T., & Andersen-Rodgers, E. (2022). Implementation of a comprehensive flavoured tobacco product sales restriction and retail tobacco sales. Tobacco Control, 31(e2), e104-e110. https://doi.org/10.1136/tobaccocontrol-2021-056494

Hawkins, S. S., Kruzik, C., O'Brien, M., & Levine Coley, R. (2022). Flavoured tobacco product restrictions in Massachusetts associated with reductions in adolescent cigarette and e-cigarette use. Tobacco Control, 31(4), 576-579. https://doi.org/10.1136/tobaccocontrol-2020-056159

Liu, J., Hartman, L., Tan, A. S. L., & Winickoff, J. P. (2023). Youth tobacco use before and after flavoured tobacco sales restrictions in Oakland, California and San Francisco, California. Tobacco Control, 32(e1), e118-e120. https://doi.org/10.1136/tobaccocontrol-2021-057135

Rogers, T., Brown, E. M., Siegel-Reamer, L., Rahman, B., Feld, A. L., Patel, M., Vallone, D., & Schillo, B. A. (2022). A comprehensive qualitative review of studies evaluating the impact of local US laws restricting the sale of flavored and menthol tobacco products. Nicotine & Tobacco Research, 24(4), 433-443. https://doi.org/10.1093/ntr/ntab188

Underwood, J. M., Brener, N., Thornton, J., Harris, W. A., Bryan, L. N., Shanklin, S. L., Deputy, N., Roberts, A. M., Queen, B., Chyen, D., Whittle, L., Lim, C., Yamakawa, Y., Leon-Nguyen, M., Kilmer, G., Smith-Grant, J., Demissie, Z., Jones, S. E., Clayton, H., & Dittus, P. (2020). Overview and methods for the Youth Risk Behavior Surveillance System: United States, 2019. MMWR Supplements, 69(1), 1-10. https://doi.org/10.15585/mmwr.su6901a1

Vyas, P., Ling, P., Gordon, B., Callewaert, J., Dang, A., Smith, D., Chan, B., & Glantz, S. (2021). Compliance with San Francisco's flavoured tobacco sales prohibition. Tobacco Control, 30(2), 227-230. https://doi.org/10.1136/tobaccocontrol-2019-055549