Econometric forecasting — no icing on the economist’s cake

29 Aug, 2019 at 21:44 | Posted in Statistics & Econometrics | 1 Comment

twice_two__fav_scene_It is clearly the case that experienced modellers could easily come up with significantly different models based on the same set of data thus undermining claims to researcher-independent objectivity. This has been demonstrated empirically by Magnus and Morgan (1999) who conducted an experiment in which an apprentice had to try to replicate the analysis of a dataset that might have been carried out by three different experts (Leamer, Sims, and Hendry) following their published guidance. In all cases the results were different from each other, and different from that which would have been produced by the expert, thus demonstrating the importance of tacit knowledge in statistical analysis.

Magnus and Morgan conducted a further experiment which involved eight expert teams, from different universities, analysing the same sets of data each using their own particular methodology. The data concerned the demand for food in the US and in the Netherlands and was based on a classic study by Tobin (1950) augmented with more recent data. The teams were asked to estimate the income elasticity of food demand and to forecast per capita food consumption. In terms of elasticities, the lowest estimates were around 0.38 whilst the highest were around 0.74 – clearly vastly different especially when remembering that these were based on the same sets of data. The forecasts were perhaps even more extreme – from a base of around 4000 in 1989 the lowest forecast for the year 2000 was 4130 while the highest was nearly 18000!

John Mingers

1 Comment

  1. C.Wright Mills called them “Abstracted empiricists”. A great deal of data to say something about society, and a lot of observation and analysis that lacks all knowledge of society and human nature. Both ontology and structures were missing. He dealed with them, in harsh words long ago. But apparently one need to repeat the criticism again and again !!

Sorry, the comment form is closed at this time.

Blog at
Entries and comments feeds.