Going beyond
The “causal inference revolution” means our course materials on program evaluation are now commonly taught not only at education schools but also in other social sciences. They are also highly sought after by employers.
Here are additional resources in case you would like to go beyond what we cover in class. You may also find it helpful to see someone else explain the same concept.
Doing the work
There is no better way of learning about evaluations than related internships or a related job once you graduate.
Of course, one way is to work with a professor at UCI or other university centers (such as the Annenberg Institute). I also highly recommend the The Abdul Latif Jameel Poverty Action Lab (J-PAL), where I started out myself. Without endorsing them, here is a long (and incomplete) list of other potential employers: Abt, AIR, Brookings, the Center for Global Development, CEPR (including the Strategic Data Project), development finance institutions (such as the AfDB, IADB, or the World Bank), IDinsight, the Institute of Education Sciences, IPA, Mathematica, MDRC, RAND, the Urban Institute, USAID, and WestEd. Finally, even if you want to work outside of education, causal inference skills are in very high demand in the economy, where many employers “are drowning in information but starving for wisdom.”
Other courses
Andrew Heiss teaches a phenomenal program evaluation class at Georgia State University. In fact, much of our course builds on his materials. Go here if you would like to review some of the materials we covered in class.
Fiona Burlig teaches a great program evaluation class at the University of Chicago. During the pandemic, she put all of her lectures online. Go here if you are looking for a slightly more advanced class.
Matt Blackwell provides a great introduction to data science for the social sciences. Go here if you are looking for a broader introduction to data analysis with R.
Other books
To recap, here are the main books we used in class:
Rachel Glennerster and Kudzai Takavarasha, Running Randomized Evaluations (Princeton University Press, 2014), https://press.princeton.edu/books/paperback/9780691159270/running-randomized-evaluations.
Richard J. Murnane and John B. Willett, Methods Matter (Oxford University Press, 2011), https://global.oup.com/academic/product/methods-matter-9780199753864.
Then, we also covered a few chapters from the following books:
Joshua Angrist and Jörn-Steffen Pischke, Mastering ’Metrics: The Path from Cause to Effect (Princeton University Press, 2014), https://theeffectbook.net/. This book has a companion site
Nick Huntington-Klein, The Effect: An Introduction to Research Design and Causality (CRC Press, 2021), https://theeffectbook.net/. Free as a HTML version
We did not cover three additional books–all three are great, but they are slightly more math heavy (esp. the last one).
Scott Cunningham, Causal Inference: The Mixtape (Yale University Press, 2021), https://mixtape.scunning.com/. Free as a HTML version
Paul Glewwe and Petra Todd, Impact Evaluation in International Development: Theory, Methods, and Practice (The World Bank, 2022), https://doi.org/10.1596/978-1-4648-1497-6. Free online
Joshua Angrist and Jörn-Steffen Pischke, Mostly Harmless Econometrics (Princeton University Press, 2014), https://theeffectbook.net/. This book also has a companion site
If you are intrigued, there are many more excellent (more technical) books on causal inference and program evaluation, including this one by Imbens and Rubin, this “classic” by Jeff Wooldridge, and the J-PAL Handbook of Field Experiments.1 But stop here for a moment and consider just how much we’ve learned this quarter—I find it amazing how much we’ve already covered in our course!
Going beyond program evaluations, I also recommend the following books on social science research and writing.
- Marc Bellemare, Doing Economics: What You Should Have Learned in Grad School―But Didn’t (MIT Press, 2022), https://marcfbellemare.com/wordpress/research/doing-economics.
- William Strunk Jr. and Elwyn Brooks White , The Elements of Style (Harcourt, Brace & Howe, 1920), https://en.wikipedia.org/wiki/The_Elements_of_Style.
Other online resources
I highly recommend the following online resources.
- J-PAL’s research resources
- The World Bank’s DIME Wiki, its Development Impact blog, and its curated list of posts on technical topics
- EGAP’s Methods Guides
- MIT’s “MicroMasters” Program in Data, Economics, and Design of Policy
- The APA Reporting Standards (JARS)
- The IES What Works Clearinghouse Standards Handbook
- The IES Standards for Excellence in Education Research
Footnotes
You can even win the Nobel Prize for the “experimental approach to alleviating global poverty”. And yet another one for “answering causal questions using observational data”.↩︎