Research / BFI Working PaperMar 19, 2020

Inference for Ranks with Applications to Mobility across Neighborhoods and Academic Achievement across Countries

Magne Mogstad, Joseph P. Romano, Azeem Shaikh, Daniel Wilhelm

It is often desired to rank different populations according to the value of some feature of each population. For example, it may be desired to rank neighborhoods according to some measure of intergenerational mobility or countries according to some measure of academic achievement. These rankings are invariably computed using estimates rather than the true values of these features. As a result, there may be considerable uncertainty concerning the rank of each population. In this paper, we consider the problem of accounting for such uncertainty by constructing confidence sets for the rank of each population. We consider both the problem of constructing marginal confidence sets for the rank of a particular population as well as simultaneous confidence sets for the ranks of all populations. We show how to construct such confidence sets under weak assumptions. An important feature of all of our constructions is that they remain computationally feasible even when the number of populations is very large. We apply our theoretical results to re-examine the rankings of both neighborhoods in the United States in terms of intergenerational mobility and developed countries in terms of academic achievement. The conclusions about which countries do best and worst at reading, math, and science are fairly robust to accounting for uncertainty. By comparison, several celebrated findings about intergenerational mobility in the United states are not robust to taking uncertainty into account.

More Research From These Scholars

BFI Working Paper Dec 17, 2020

Do Employees Benefit from Worker Representation on Corporate Boards?

Christine Blandhol, Magne Mogstad, Peter Nilsson, Ola L.Vestad
Topics:  Uncategorized
BFI Working Paper Sep 8, 2020

On the Use of Outcome Tests for Detecting Bias in Decision Making

Ivan A. Canay, Magne Mogstad, Jack Mountjoy
Topics:  Uncategorized
BFI Working Paper Jul 16, 2020

Inference with Imperfect Randomization: The Case of the Perry Preschool Program

James Heckman, Rodrigo Pinto, Azeem Shaikh
Topics:  Early Childhood Education