Custodes Futurifor the advancement of humanity

Rigid gatekeeping

Rigid gatekeeping is a barrier to human progress within the educational factors. The evidence for it, and the methods proposed to address it, follow.

Systems that require strength in every subject can screen out people with exceptional ability in one. Einstein failed an entrance exam because of languages and history. Ramanujan lost his scholarship because he neglected non-math subjects.

Evidence

  • Exam-day pollution. Israeli students scored lower on matriculation exams taken on days with more fine-particle pollution. The same students had lower post-secondary attainment and earnings years later (Ebenstein, Lavy, and Roth, 2016).
  • Why it matters. A random disturbance on one exam day had lasting effects. This shows that heavy reliance on single noisy tests misallocates talent.
  • Later studies. Pollution affected China's College English Test (Yao et al., 2023). Hot exam days lowered New York City exit exam scores by up to 13% of a standard deviation and reduced high school graduation (Park, 2022). Only the Israeli study followed students to adult earnings.
  • Exit exam cutoffs. In Massachusetts, students scoring just below or just above the passing score on the 10th grade exit exam have nearly equal skills. For most students, barely failing did not affect graduation. But low-income urban students who just failed the math exam were 8 percentage points less likely to graduate than similar students who just passed. They were also 4 points more likely to drop out the next year. These students retook the test as often as suburban students but passed less often (Papay, Murnane, and Willett, 2010).
  • Scores pushed over the line. On New York's Regents exit exams, the exam design and decentralized scoring led to systematic manipulation of scores that fell just below key passing cutoffs. Researchers used reforms that ended this. They found that having a score inflated past the cutoff raised a student's chance of graduating from high school by about 17 percentage points. But the inflated score lowered the chance of taking advanced courses by about 10 points. The authors conclude that this helped students at risk of dropping out. The authors also conclude that it harmed stronger students who lacked a solid grounding in introductory material (Dee et al., 2019).
  • One sitting. Only half of U.S. students who take the SAT retake it. Retake rates are lower for low-income and underrepresented minority students. Researchers used jumps in retaking just below round-number scores (multiples of 100). They found that retaking substantially raised scores and four-year college enrollment, especially for these groups. Closing the gaps in retaking could close up to 10% of the income gap and up to 7% of the racial gap in four-year college enrollment (Goodman, Gurantz, and Smith, 2020).
  • What helps. Flexible pathways and second chances. The evidence is moderate. It comes from one long-run natural experiment (rated B), with short-run replications.

Note: The Einstein and Ramanujan cases are a historical observation from the pioneer cases, not a finding from a controlled study.

What can be done

Actions rated on the strength-rating scale (A strong and replicated, B solid but limited, C weak or debated, D contested or failed), applied to the specific claim made.

  • Universal screening for gifted programs instead of referrals (B). A large U.S. urban district screened all second graders, with no change in the standards for gifted status. The share of low-income and English learner students placed in gifted programs rose from 1.4% to 4.3%. The odds rose 74% for Black students and 118% for Hispanic students. Newly identified students had IQ scores similar to those who would have been placed anyway (Card and Giuliano, 2016). The district cut and then suspended screening in 2010 because of budget pressures.
  • Automatic admission for top students at every high school, as in the Texas Top Ten Percent rule (B). Some highly ranked students at more disadvantaged high schools gained access to selective universities. These students had higher college enrollment and graduation. Some less highly ranked students at advantaged schools lost access. These students moved to less selective colleges, without declines in overall enrollment, graduation, or earnings (Black, Denning, and Rothstein, 2023).
  • Give every high school student a free college entrance exam (B). Before such policies, for every ten poor students who scored college-ready on the ACT or SAT, five more would have scored college-ready but took neither test. Eleven states adopted a policy of requiring and paying for the exam between 2001 and the time of the study. This led to small increases in four-year college enrollment, concentrated in the poorest schools. Those induced to enroll persisted at similar rates (Hyman, 2017).
  • Mixed: direct admission letters that admit students before they apply (C, because two B-rated studies conflict). In 2015 Idaho proactively admitted all high school graduates to a set of public colleges. After that, first-time enrollment rose 4% to 8%, mainly at two-year open-access colleges. There was little or no effect on Pell-eligible students (Odle and Delaney, 2022). In a four-state experiment, direct admission offers raised applications by 2.7 percentage points (about 12%). But the offers did not raise enrollment (Odle and Delaney, 2023). This study is not yet peer reviewed.

Proposed and experimental methods

Methods that are proposed, under trial, approved in some places, or tried and then failed. Each shows a stage label and an evidence rating. A stage label shows how far a method has progressed, not whether it works. The stage labels are explained on the educational factor page.

  • Removing admission advantages that do not predict later success (Approved but not scaled, contested, B). Children from the top 1% of families are more than twice as likely to attend Ivy-Plus colleges as middle-class children with the same SAT or ACT scores. The study finds this is mainly because of preferences for alumni children, athletes, and non-academic ratings. These are uncorrelated or negatively correlated with outcomes after college, while test scores are highly predictive (Chetty et al., 2026). Attending such a college instead of a flagship public university raised the chance of reaching the top 1% of earnings by about 50%. So who passes this gate matters. Maryland bans legacy preferences at public and private colleges. California banned them at private colleges from September 1, 2025. Illinois, Colorado, and Virginia ban them at public colleges. But the effects of these bans have not been evaluated (BestColleges, 2024).
  • Skills-based hiring that drops degree requirements (Approved but not scaled, contested, C). Many U.S. employers and some state and federal governments have announced that some jobs no longer require degrees. In March 2022, Maryland announced that thousands of state jobs would no longer require four-year degrees (Schweitzer, 2022). The federal Chance to Compete Act was signed on December 23, 2024. It is meant to replace degree-based hiring in the civil service with skills- and competency-based hiring (Chance to Compete Act of 2024). A review of hiring data concluded that many companies announced such changes. The same review concluded that lasting changes in who gets hired remain elusive for most. In 11,300 roles at large firms that dropped a degree requirement, the share of hires without a bachelor's degree rose by about 3.5 percentage points. But only about 3.6% of roles dropped the requirement. So the authors estimate the change reached fewer than 1 in 700 U.S. hires in 2023. The authors also found that nearly all of it came from 37% of the firms (Sigelman et al., 2024).
  • Lottery admission to oversubscribed programs (Approved but not scaled, contested, C). The Netherlands used a weighted lottery to admit students to oversubscribed programs such as medicine until 2017 (HOP and Konings, 2020). Since September 1, 2023, it has again allowed programs to choose a lottery (Studiekeuze123, n.d.). In a multi-site survey of Dutch medical students, those admitted through selection procedures did not outperform lottery-admitted students or show better motivation. In the same survey, students admitted directly for top school grades performed best, though only 35% responded (Wouters et al., 2017). The lotteries also allow clean tests of what a degree is worth. Completing medical school raised earnings by at least 20% in every year after graduation, and by almost 50% after 22 years (Ketel et al., 2016).
  • Not shown to help: admission to exam-gated elite high schools for students near the cutoff (Large trial, B). In Boston and New York City, students just above the admission score for exam schools gained much higher-achieving classmates. But they showed little effect on test scores or college quality (Abdulkadiroğlu et al., 2014). This suggests that the exam gate itself adds less than assumed for students near the cutoff. That matters for proposals to replace such gates with lotteries or wider entry.
  • Reversed: test-optional admissions at some selective colleges (Failed or reversed, contested, B). At nearly 100 private colleges that went test-optional between 2005-06 and 2015-16, the policy was associated with 3% to 4% more Pell Grant recipients. It was also associated with 10% to 12% more first-year students from underrepresented groups (Bennett, 2022). MIT brought back its SAT and ACT requirement on March 28, 2022. MIT stated that scores, especially in math, improve prediction of success. It also stated that scores help identify well-prepared students from less-advantaged backgrounds (Schmill, 2022). Dartmouth brought back its requirement in February 2024. This followed a faculty working group that used 2017 to 2022 applicant data. The group found that SAT scores alone explained about 22% of the variation in first-year grades, versus 9% for high school GPA. The group also found that under test-optional rules, less-advantaged applicants with scores of 1450 to 1490 who revealed them had an admission probability of 7.4%, versus 2% for those who withheld them (Cascio et al., 2024).

Sources cited on this page

  1. Ebenstein, A., Lavy, V., & Roth, S. (2016). The long-run economic consequences of high-stakes examinations: evidence from transitory variation in pollution. American Economic Journal: Applied Economics, 8(4), 36-65. DOI B Moderate
  2. Yao, Z., Zhang, W., Ji, X., & Weng, W. (2023). Short-term exposure to air pollution and cognitive performance: new evidence from China's College English Test. Environmental and Resource Economics, 85(1), 211-237. DOI B Moderate
  3. Park, R. J. (2022). Hot temperature and high-stakes performance. Journal of Human Resources, 57(2), 400-434. DOI B Moderate
  4. Chetty, R., Friedman, J. N., & Rockoff, J. E. (2014). Measuring the impacts of teachers II: teacher value-added and student outcomes in adulthood. American Economic Review, 104(9), 2633-2679. AEA C Limited: B for test-score effects
  5. Rothstein, J. (2017). Measuring the impacts of teachers: Comment. American Economic Review, 107(6), 1656-1684. AEA B Moderate
  6. Dee, T. S., Dobbie, W., Jacob, B. A., & Rockoff, J. (2019). The causes and consequences of test score manipulation: Evidence from the New York Regents Examinations. American Economic Journal: Applied Economics, 11(3), 382-423. DOI B Moderate
  7. Goodman, J., Gurantz, O., & Smith, J. (2020). Take two! SAT retaking and college enrollment gaps. American Economic Journal: Economic Policy, 12(2), 115-158. DOI B Moderate
  8. Papay, J. P., Murnane, R. J., & Willett, J. B. (2010). The consequences of high school exit examinations for low-performing urban students: Evidence from Massachusetts. Educational Evaluation and Policy Analysis, 32(1), 5-23. DOI B Moderate
  9. Roth, S., Robbert, T., & Straus, L. (2015). On the sunk-cost effect in economic decision-making: A meta-analytic review. Business Research, 8(1), 99-138. DOI B Moderate: for the effect in decision experiments, C for its size in real-world decisions
  10. Dee, T. S., & Wyckoff, J. (2015). Incentives, selection, and teacher performance: Evidence from IMPACT. Journal of Policy Analysis and Management, 34(2), 267-297. link B Moderate
  11. Abdulkadiroğlu, A., Angrist, J., & Pathak, P. (2014). The elite illusion: Achievement effects at Boston and New York exam schools. Econometrica, 82(1), 137-196. link B Moderate
  12. Bennett, C. T. (2022). Untested admissions: Examining changes in application behaviors and student demographics under test-optional policies. American Educational Research Journal, 59(1), 180-216. link B Moderate
  13. Chetty, R., Deming, D. J., & Friedman, J. N. (2026). Diversifying society's leaders? The determinants and causal effects of admission to highly selective private colleges. The Quarterly Journal of Economics, 141(1), 51-145. link B Moderate
  14. Schmill, S. (2022, March 28). We are reinstating our SAT/ACT requirement for future admissions cycles. MIT Admissions. link B Moderate
  15. Sigelman, M., Fuller, J., & Martin, A. (2024). Skills-based hiring: The long road from pronouncements to practice. Burning Glass Institute and Harvard Business School Project on Managing the Future of Work. link C Limited
  16. Black, S. E., Denning, J. T., & Rothstein, J. (2023). Winners and losers? The effect of gaining and losing access to selective colleges on education and labor market outcomes. American Economic Journal: Applied Economics, 15(1), 26-67. link B Moderate
  17. Card, D., & Giuliano, L. (2016). Universal screening increases the representation of low-income and minority students in gifted education. Proceedings of the National Academy of Sciences, 113(48), 13678-13683. link B Moderate
  18. Hyman, J. (2017). ACT for all: The effect of mandatory college entrance exams on postsecondary attainment and choice. Education Finance and Policy, 12(3), 281-311. link B Moderate
  19. Odle, T. K., & Delaney, J. A. (2022). You are admitted! Early evidence on enrollment from Idaho's direct admissions system. Research in Higher Education, 63(6), 899-932. link B Moderate
  20. Odle, T. K., & Delaney, J. A. (2023). Experimental evidence on "direct admissions" from four states: Impacts on college application and enrollment [Working paper]. SSRN. link B Moderate
  21. Cascio, E., Sacerdote, B., Staiger, D., & Tine, M. (2024, January 30). Report from working group on the role of standardized test scores in undergraduate admissions. Dartmouth College. link C Limited: (B for Dartmouth applicants)
  22. Chance to Compete Act of 2024, Pub. L. No. 118-188, 138 Stat. 2643 (2024). link B Moderate
  23. HOP, & Konings, H. (2020, February 19). House of Representatives wants to reinstate admission by lottery. Cursor (Eindhoven University of Technology). link B Moderate
  24. Ketel, N., Leuven, E., Oosterbeek, H., & van der Klaauw, B. (2016). The returns to medical school: Evidence from admission lotteries. American Economic Journal: Applied Economics, 8(2), 225-254. link B Moderate
  25. Schweitzer, A. (2022, March 16). Maryland will no longer require four-year degrees for thousands of state jobs. DCist (WAMU), via NPR. link B Moderate
  26. Wouters, A., Croiset, G., Schripsema, N. R., Cohen-Schotanus, J., Spaai, G. W. G., Hulsman, R. L., & Kusurkar, R. A. (2017). A multi-site study on medical school selection, performance, motivation and engagement. Advances in Health Sciences Education, 22(2), 447-462. link C Limited

Every source for this factor is listed on the educational factor page.