Disrupted schooling
Disrupted schooling is a barrier to human progress within the educational factors. The evidence for it, and the methods proposed to address it, follow.
Betthäuser, Bach-Mortensen, and Engzell (2023) pooled 42 studies from 15 countries on COVID-19 school disruptions.
Evidence
- Learning lost. Students lost about 35% of a normal school year's worth of learning. The losses stayed stable over time rather than being recovered.
- Who lost more. Children from lower socioeconomic backgrounds and children in poorer countries lost more, widening inequality. Losses were larger in math than in reading.
- Persistence. Historical evidence from teacher strikes, shortened school years, and wartime disruption suggests learning deficits tend to persist long-term.
- Strikes and adult earnings. In Argentina, the number of teacher strikes differed across provinces and birth cohorts. Exposure to the average amount of strikes during primary school lowered later earnings by 3.2% for men and 1.9% for women. This exposure also raised unemployment and the chance of working in lower-skill jobs. The authors estimate a total loss of about US$2.34 billion in earnings each year. They attribute the effects at least partly to less education (Jaume and Willén, 2019).
- Disaster and learning. Four years after the 2005 earthquake in northern Pakistan, children living within 20 km of the fault line scored 0.31 standard deviations lower on tests. That is about 1.5 school grades. This happened even though affected families received cash aid worth 150% of their yearly consumption spending within two years. Children under age 3 at the time had large height deficits. Children whose mothers had completed primary school did not fall behind. Household and adult outcomes showed no gaps, so the losses were concentrated in children (Andrabi, Daniels, and Das, 2023).
- Everyday absences. Researchers used records of the date and class period of every absence in middle and high school. They compared the same student's absences across subjects. Missing 10 classes lowered math or English test scores by 3% to 4% of a standard deviation and course grades by 17% to 18% of a standard deviation. Ten absences across all subjects in 9th grade reduced the likelihood of graduating on time and of ever enrolling in college by 2%. Absences after the state testing window had no effect on scores, which supports a causal reading (Liu, Lee, and Gershenson, 2021).
- What helps. Keeping schools open and targeted catch-up. The evidence is moderate and still being studied.
Note: A later paper, not yet peer reviewed, has reanalyzed the dataset for publication bias (Luskova et al., 2026). So the exact size is still being examined.
What can be done
Actions rated on the strength-rating scale (A strong and replicated, B solid but limited, C weak or debated, D contested or failed), applied to the specific claim made.
- Send parents personalized information on their child's absences (B). A randomized trial involved the parents of 28,080 high-risk students from kindergarten to grade 12. In the trial, letters corrected parents' underestimates of how many days their child had missed. These letters reduced chronic absenteeism by 10% or more, at lower cost than usual practices (Rogers and Feller, 2018). A second trial in 10 school districts, with families of children in kindergarten to grade 5, reduced chronic absenteeism by 15% (Robinson et al., 2018). Both trials involved the same lead researcher.
- Dropout prevention programs for students at risk (B). A Campbell systematic review of 167 studies found that dropout programs had a mean odds ratio of 1.72. This equals cutting a 21.1% dropout rate to about 13%. The review found little difference across program types. But it found attendance monitoring programs were less successful than most others (Wilson et al., 2011). Many included studies were not randomized.
- Summer learning programs (B). A meta-analysis looked at 37 experimental and quasi-experimental studies of summer programs with mathematics. It found an average gain of 0.10 standard deviations in math, similar in higher and lower poverty settings (Lynch, An, and Mancenido, 2023). A meta-analysis of 41 summer reading interventions found significant reading gains. It found the gains were larger for low-income children and for programs using research-based reading instruction (Kim and Quinn, 2013).
- Mixed: early warning systems that flag students at risk (C). A randomized trial in 73 Midwest U.S. high schools with 37,671 students tested the Early Warning Intervention and Monitoring System. After one year, the system lowered chronic absence from 14% to 10% and course failure from 26% to 21%. But it did not change credits earned, despite low implementation (Faria et al., 2017). Interim results from a later scale-up trial in 51 schools found no significant effect on chronic absence or course failure (Harvill et al., 2025).
Proposed and experimental methods
Methods that are proposed, under trial, approved in some places, or tried and then failed. Each shows a stage label and an evidence rating. A stage label shows how far a method has progressed, not whether it works. The stage labels are explained on the educational factor page.
- Phone-call tutoring during school closures (Large trial, B). During COVID-19 closures in Botswana, weekly SMS messages plus phone calls to parents and children raised learning by 0.12 standard deviations. That is 0.63 standard deviations per $100 (0.89 for households that took part in all sessions) (Angrist et al., 2022). Randomized trials in India, Kenya, Nepal, the Philippines, and Uganda found that phone tutorials raised learning by 0.30 to 0.35 standard deviations on average. The same trials found that government teachers achieved effects similar to NGO instructors and that SMS alone gave mixed results (Angrist et al., 2023). Unlike many replications, implementation quality improved as the program spread (Angrist et al., 2023b). The five-country paper is not yet peer reviewed.
- High-dosage tutoring, and the fade of its effects at scale (In wide use, contested, B). A meta-analysis of 89 randomized trials found a pooled effect of 0.288 standard deviations. The meta-analysis found effects were largest for programs that used teachers or paraprofessionals and met at least three days a week during school (Nickow et al., 2024). In Chicago, daily two-to-one math tutoring raised math scores by 0.18 to 0.40 standard deviations for participants across two trials. It cost $3,500 to $4,300 per student a year (Guryan et al., 2023). An expanded meta-analysis of 265 trials found effects of 0.55 standard deviations in programs with under 100 students. It found effects of 0.14 in programs with 1,000 or more (Kraft et al., 2024). Several post-pandemic district programs reported small or no gains. In one large urban district, students completed only about 30% to 36% of recommended sessions (Schwartz, 2025).
- Large unconditional recovery grants to schools (In wide use, B). A study used differences in U.S. federal pandemic relief created by the funding formula. It covered more than 5,000 districts in 29 states. It found that each $1,000 per student improved 2022-23 test scores by 0.0086 standard deviations in math and 0.0049 in reading (Dewey et al., 2024). The data cannot show which uses of the money worked, and the study is a working paper.
- Reversed: replacing canceled exams with a statistical grading model (Failed or reversed, B). England canceled its 2020 exams. The regulator Ofqual then adjusted teachers' predicted grades with a model based on schools' past results. The model lowered 39.1% of A-level teacher grades, 35.6% by one grade (Whittaker, 2020). After public protest, on August 17, 2020, Ofqual withdrew the model. Ofqual gave students their teacher-assessed grade or the model grade, whichever was higher (Ofqual, 2020).
Sources cited on this page
- Betthäuser, B. A., Bach-Mortensen, A. M., & Engzell, P. (2023). A systematic review and meta-analysis of the evidence on learning during the COVID-19 pandemic. Nature Human Behaviour, 7(3), 375-385. DOI A Strong
- Andrabi, T., Daniels, B., & Das, J. (2023). Human capital accumulation and disasters: Evidence from the Pakistan earthquake of 2005. Journal of Human Resources, 58(4), 1057-1096. DOI B Moderate
- Angrist, N., Djankov, S., Goldberg, P. K., & Patrinos, H. A. (2021). Measuring human capital using global learning data. Nature, 592(7854), 403-408. DOI B Moderate
- Jaume, D., & Willén, A. (2019). The long-run effects of teacher strikes: Evidence from Argentina. Journal of Labor Economics, 37(4), 1097-1139. DOI B Moderate
- Liu, J., Lee, M., & Gershenson, S. (2021). The short- and long-run impacts of secondary school absences. Journal of Public Economics, 199, 104441. DOI B Moderate
- Angrist, N., Evans, D. K., Filmer, D., Glennerster, R., Rogers, H., & Sabarwal, S. (2025). How to improve education outcomes most efficiently? A review of the evidence using a unified metric. Journal of Development Economics, 172, 103382. link B Moderate
- Angrist, N., Ainomugisha, M., Bathena, S. P., Bergman, P., Crossley, C., Cullen, C., et al. (2023). Building resilient education systems: Evidence from large-scale randomized trials in five countries (NBER Working Paper No. 31208, revised June 2025). National Bureau of Economic Research. link B Moderate
- Angrist, N., Bergman, P., & Matsheng, M. (2022). Experimental evidence on learning using low-tech when school is out. Nature Human Behaviour, 6(7), 941-950. link B Moderate
- Dewey, D. C., Fahle, E. M., Kane, T. J., Reardon, S. F., & Staiger, D. O. (2024). Federal pandemic relief and academic recovery (NBER Working Paper No. 32897). National Bureau of Economic Research. link B Moderate
- Guryan, J., Ludwig, J., Bhatt, M. P., Cook, P. J., Davis, J. M., Dodge, K., et al. (2023). Not too late: Improving academic outcomes among adolescents. American Economic Review, 113(3), 738-765. link B Moderate
- Kraft, M. A., Schueler, B. E., & Falken, G. (2024). What impacts should we expect from tutoring at scale? Exploring meta-analytic generalizability (EdWorkingPaper No. 24-1031). Annenberg Institute at Brown University. link B Moderate
- Nickow, A., Oreopoulos, P., & Quan, V. (2024). The promise of tutoring for PreK-12 learning: A systematic review and meta-analysis of the experimental evidence. American Educational Research Journal, 61(1), 74-107. link B Moderate: (A for smaller programs)
- Schwartz, S. (2025, November 18). Why hasn't tutoring been more effective? Education Week. link B Moderate
- Whittaker, F. (2020, August 13). A-level results 2020: Top grades up by 2.4 percentage points. Schools Week. link B Moderate
- Kraft, M. A., Blazar, D., & Hogan, D. (2018). The effect of teacher coaching on instruction and achievement: A meta-analysis of the causal evidence. Review of Educational Research, 88(4), 547-588. link B Moderate
- Angrist, J. D., Lavy, V., Leder-Luis, J., & Shany, A. (2019). Maimonides' rule redux. American Economic Review: Insights, 1(3), 309-324. link B Moderate
- Faria, A.-M., Sorensen, N., Heppen, J., Bowdon, J., Taylor, S., Eisner, R., & Foster, S. (2017). Getting students on track for graduation: Impacts of the Early Warning Intervention and Monitoring System after one year (REL 2017-272). Regional Educational Laboratory Midwest, Institute of Education Sciences. link B Moderate
- Harvill, E. L., Shea, M., Freeman, B., & Andrichik, A. (2025). Interim impacts from the Early Warning Intervention and Monitoring System (EWIMS) EIR evaluation [Conference abstract]. Society for Research on Educational Effectiveness. link B Moderate
- Kim, J. S., & Quinn, D. M. (2013). The effects of summer reading on low-income children's literacy achievement from kindergarten to grade 8: A meta-analysis of classroom and home interventions. Review of Educational Research, 83(3), 386-431. link B Moderate
- Lynch, K., An, L., & Mancenido, Z. (2023). The impact of summer programs on student mathematics achievement: A meta-analysis. Review of Educational Research, 93(2), 275-315. link B Moderate
- Robinson, C. D., Lee, M. G., Dearing, E., & Rogers, T. (2018). Reducing student absenteeism in the early grades by targeting parental beliefs. American Educational Research Journal, 55(6), 1163-1192. link B Moderate
- Rogers, T., & Feller, A. (2018). Reducing student absences at scale by targeting parents' misbeliefs. Nature Human Behaviour, 2(5), 335-342. link B Moderate
- Wilson, S. J., Tanner-Smith, E. E., Lipsey, M. W., Steinka-Fry, K., & Morrison, J. (2011). Dropout prevention and intervention programs: Effects on school completion and dropout among school-aged children and youth: A systematic review. Campbell Systematic Reviews, 7(1), csr.2011.8. link B Moderate
Every source for this factor is listed on the educational factor page.