Research / BFI Working PaperFeb 28, 2022

Statistical Uncertainty in the Ranking of Journals and Universities

Magne Mogstad, Joseph P. Romano, Azeem Shaikh, Daniel Wilhelm

Economists are obsessed with rankings of institutions, journals, or scholars according to the value of some feature of interest. These rankings are invariably computed using estimates rather than the true values of such features. As a result, there may be considerable uncertainty concerning the ranks. In this paper, we consider the problem of accounting for such uncertainty by constructing confidence sets for the ranks. We consider both the problem of constructing marginal confidence sets for the rank of, say, a particular journal as well as simultaneous confidence sets for the ranks of all journals. We apply these confidence sets to draw inferences about uncertainty in the ranking of economics journals and universities by impact factors.

More Research From These Scholars

BFI Working Paper Dec 2, 2020

Imperfect Competition, Compensating Differentials and Rent Sharing in the U.S. Labor Market

Thibaut Lamadon, Magne Mogstad, Bradley Setzler
Topics:  Employment & Wages
BFI Working Paper Jan 15, 2019

Inference under Covariate-Adaptive Randomization with Multiple Treatments

Federico A. Bugni, Ivan A. Canay, Azeem Shaikh
Topics:  Uncategorized
BFI Working Paper Dec 22, 2019

Randomization Tests in Observational Studies with Staggered Adoption of Treatment

Azeem Shaikh, Panos Toulis
Topics:  Uncategorized