When Scale and Replication Work: Learning from Summer Youth Employment Experiments
Because successful human capital interventions often fail to scale or replicate, public investment decisions require understanding how program size, context, and implementation shape program effects. This paper uses two new randomized controlled trials of summer youth employment programs in Chicago and Philadelphia to demonstrate how multiple experiments can help explain replicability and inform the expansion of promising approaches. Even when these programs grow or change models across contexts, participation consistently reduces criminal justice involvement. It may also decrease the need for child protective services and behavioral health treatment. Experimental variation in program model and local provider generates no detectable heterogeneity, suggesting that effects replicate partly because variability in implementation does not matter. There is, however, individual-level heterogeneity that explains differences in effect magnitudes across populations and informs optimal targeting; youth at higher risk of socially costly outcomes experience larger benefits. Identifying more interventions that combine this pattern of treatment heterogeneity with robust replicability could aid efforts to reduce social inequality efficiently.
Published Versions
Sara B. Heller, 2022. "When scale and replication work: Learning from summer youth employment experiments," Journal of Public Economics, vol 209.
Related
Programs
Working Groups
More from NBER
In addition to working papers, the NBER disseminates affiliates’ latest findings through a range of free periodicals — the NBER Reporter, the NBER Digest, the Bulletin on Retirement and Disability, the Bulletin on Health, and the Bulletin on Entrepreneurship — as well as online conference reports, video lectures, and interviews.
