Vivalt, E. (forthcoming). “How Much Can We Generalize from Impact Evaluations?”, Journal of the European Economics Association.
Vivalt, E. (2019). “Specification Searching and Significance Inflation Across Time, Methods and Disciplines”, Oxford Bulletin of Economics and Statistics, 81(4): 797–816.
Vivalt, E. (2015). “Heterogeneous Treatment Effects in Impact Evaluation”, American Economic Review, Papers and Proceedings, 105(5): 467–470.
Coverage of research on this theme:
- The Atlantic: “Make Science More Reliable, Win Cash Prizes”
- Vox: “Don’t teach a man to fish. Just give him the goddamn fish”
- The Washington Post: “The Wonkblog Guide to Holiday Giving”
- Mother Jones: “Most Studies of Social Interventions Are Pretty Worthless”
- Lant Pritchett’s mini-series for the Center for Global Development: “Is Your Impact Evaluation Asking Questions That Matter? A Four Part Smell Test”
- Marginal Revolution: “Everyone in development economics should read this paper”
- 3ie’s blog: “Trends in impact evaluation: Did we ever learn?”
Popular articles, podcasts, blog posts and talks:
- Harvard Business Review: “How to Be a Smart Consumer of Social Science Research”
- 80,000 Hours podcast: “Dr Eva Vivalt’s research suggests social science findings don’t generalize. So evidence-based development – what is it good for?”
- Centre for the Study of African Economies (CSAE) Conference 2018, Closing plenary: “Limits to evidence-based interventions for development”
- Effective Altruism Global: Global Poverty talk
- The Inter-American Development Bank’s blog: “How much do impact evaluations (really) help policymaking?”
- The NYU Development Research Institute’s blog: “5 ways to improve your impact evaluation”
- The World Bank’s Development Impact blog: “What do 600 papers on 20 types of interventions tell us about how much impact evaluations generalize?” and “What isn’t reported in impact evaluations?”
Basic income / cash transfer programs:
Y Combinator Research’s Basic Income RCT with David Broockman, Sarah Miller, Elizabeth Rhodes, and Alex Bartik
This is a large project in the U.S. that will test the impact of receiving $1,000/month, unconditionally, for 3 years. An older overview of the project can be found here. Researchers may contact me privately for pre-analysis plans on any of the following 11 topics (some of which may merge but which are currently envisaged as separate papers):
- Employment, work quality, and job search
- Time use
- Income, expenditures, and financial health
- Mental and physical health outcomes
- Cognitive outcomes
- Material wellbeing
- Subjective, psychological, and social wellbeing
- Political and social attitudes
- Children’s educational outcomes
- Intrahousehold outcomes and intimate partner violence
- Migration and housing outcomes
Another cash transfer study is in development (independently).
Forecasting and development economics:
DellaVigna, S., Pope, D. and Vivalt, E. “Forecasting Social Science Results” (revise and resubmit Science).
DellaVigna, S., Otis, N. and Vivalt, E. “Forecasting the Results of Economic Research” (invited AEA Papers and Proceedings).
The above papers are part of a project generously supported by the Alfred P. Sloan Foundation and an anonymous foundation.
Vivalt, E. and Coville, A. “How Do Policymakers Update Their Beliefs?” (under review)
Vivalt, E. and Coville, A. “The Implications of Variance Neglect for the Formation and Estimation of Subjective Expectations” (under review)
Coville, A. and Vivalt, E. “Weighing Evidence: Which Attributes Matter?” (in preparation)
Vivalt, E. (forthcoming). “Using Priors in Experimental Design: How Much Are We Leaving on the Table?” in Bédécarrats F., I. Guérin, and F. Roubaud, eds., Randomized Control Trials in the Field of Development: The Gold Standard Revisited. London: Oxford University Press.