Saturday 24 September 2011

Understanding Uncertainty in School League Tables

an article by George Leckie and Harvey Goldstein (University of Bristol) published in Fiscal Studies: the journal of applied public economics Volume 32 Issue 2 (June 2011)

Abstract

In England, contextual value added (CVA) school performance tables are published annually by the government. These tables present statistical-model-based estimates of the educational effectiveness of schools, together with 95 per cent confidence intervals to communicate their statistical uncertainty. However, this information, particularly the notion of statistical uncertainty, is hard for users to understand. There is a real need to make school performance tables clearer. The media attempt to do this for the public by ranking schools in so-called ‘school league tables’; however, they invariably discard the 95 per cent confidence intervals and, in doing so, encourage the public to over-interpret differences in schools’ ranks. In this paper, we explore a simulation method to produce simple graphical summaries of schools’ ranks that clearly communicate their associated uncertainty.


No comments: