In our keenness to attribute success or failure to an intervention, we often forget that the change may well be a case of reversion to the mean

๐Ÿ’Ž In our keenness to attribute success or failure to an intervention, we often forget that the change may well be a case of reversion to the mean (league tables)

It is not only sports teams that are ranked in league tables. Take the example of the PISA Global Education Tables, which compare different countries’ school systems in mathematics. A change in league table position between 2003 and 2013 was strongly negatively correlated with initial position, meaning that countries at the top tended to go down, and those at the bottom tended to go up. The correlation was -0.60, and some theory shows that if the rankings were complete chance and all that was operating were regression-to-the-mean, the correlation would be expected to be -0.71, not very different from what was observed. This suggest the differences between countries were far less than claimed, and that change in league position had little do with changes in teaching philosophy.

Excerpt from: The Art of Statistics: Learning from Data by David Spiegelhalter

HT: @rshotton

Facebook Comments

Product Geek?

Join over 5,000 product geeks and get one email every Monday containing the best excerpts I've read over the previous week.

See some of what you're missing...