Research / BFI Working PaperAug 30, 2021

Errors in Reporting and Imputation of Government Benefits and Their Implications

Pablo A. Celhay, Bruce Meyer, Nikolas Mittag

We document the extent, nature, and consequences of survey errors in cash welfare and SNAP receipt in three major U.S. household surveys. We find high rates of misreporting, particularly failure to report receipt. The surveys inaccurately capture patterns of multiple program participation, even though there is little evidence of program confusion. Error rates are higher among imputed observations, which account for a large share of false positive errors. Many household characteristics have significant effects on both false positives and false negative errors. Error rates sharply differ by race, ethnicity, income and other household characteristics. The errors greatly affect models of program receipt and estimated effects of income and race are noticeably biased. We examine error due to item non-response and imputation, as well as whether imputation improves estimates. Item non-respondents have higher receipt rates than the population conditional on covariates. The assumptions for consistent estimates in multivariate models fail both when excluding item non-respondents and when using the imputed values. In binary choice models of program receipt, linked data estimates favor excluding item non- respondents rather than using imputed values. Biases are well predicted by the error patterns we document, helping researchers make informed decisions on whether to use imputed values. 

More Research From These Scholars

BFI Working Paper Jun 21, 2022

The Size and Census Coverage of the U.S. Homeless Population

Bruce Meyer, Angela Wyse, Kevin Corinth
Topics:  Economic Mobility & Poverty
BFI Working Paper Aug 23, 2022

Real-Time Poverty, Material Well-Being, and the Child Tax Credit

Jeehoon Han, Bruce Meyer, James X. Sullivan
Topics:  Economic Mobility & Poverty
BFI Working Paper Oct 7, 2021

The Anti-Poverty, Targeting, and Labor Supply Effects of the Proposed Child Tax Credit Expansion

Kevin Corinth, Bruce Meyer, Matthew Stadnicki, Derek Wu
Topics:  Economic Mobility & Poverty