Research / BFI Working PaperDec 19, 2022

Using Machine Learning for Efficient Flexible Regression Adjustment in Economic Experiments

John List, Ian Muir, Gregory K. Sun

This study investigates how to use regression adjustment to reduce variance in experimental data. We show that the estimators recommended in the literature satisfy an orthogonality property with respect to the parameters of the adjustment. This observation greatly simplifies the derivation of the asymptotic variance of these estimators and allows us to solve for the efficient regression adjustment in a large class of adjustments. Our efficiency results generalize a number of previous results known in the literature. We then discuss how this efficient regression adjustment can be feasibly implemented. We show the practical relevance of our theory in two ways. First, we use our efficiency results to improve common practices currently employed in field experiments. Second, we show how our theory allows researchers to robustly incorporate machine learning techniques into their experimental estimators to minimize variance.

More Research From These Scholars

BFI Working Paper Jun 1, 2016

A New Approach to an Age-Old Problem: Solving Externalities by Incenting Workers Directly

John List, Greer Gosnell, Robert D. Metcalfe
Topics:  Early Childhood Education, Energy & Environment, Health care, K-12 Education, Economic Mobility & Poverty, Fiscal Studies
BFI Working Paper Jan 24, 2019

The Dozen Things Experimental Economists Should Do (More Of)

Eszter Czibor, David Jimenez-Gomez, John List
Topics:  Tax & Budget, Technology & Innovation, Fiscal Studies
BFI Working Paper Dec 9, 2022

High-Frequency Location Data Shows That Race Affects the Likelihood of Being Stopped and Fined for Speeding

Pradhi Aggarwal, Alec Brandon, Ariel Goldszmidt, Justin Holz, John List, Ian Muir, Gregory Sun, Thomas Yu
Topics:  Uncategorized