Skip to main content

Escape from Model Land - Erica Thompson ***

Over the last few years a number of books, notably Sabine Hossenfelder's Lost in Math, David Orrell's Economyths, Cathy O Neil's Weapons of Math Destruction and Tim Palmer's The Primacy of Doubt, have pointed out problems with the mathematical modelling done by businesses, physicists, meteorologists, epidemiologists, economists and more. These are not anti-science polemics, but rather people who know what they're talking about pointing out the dangers of getting too carried away with elegant mathematics and models, often assuming that the models effectively are reality (and certainly presenting them that way in some of the writing and press releases from the scientists building and using the models).

Erica Thompson takes on the problems of mentally inhabiting the mathematical world she describes as 'model land'. As she cogently points out, it's fine to play in model land all that you like - the problem comes with the way that you exit model land and tie back to the real world. This book is loaded with examples from climate forecasts, economics, pandemic forecasting and more where the modellers have been unable to successfully get out of model land and present their information usefully to those who have to make decisions (or the public). This is not an attempt to get rid of models. Thompson's key argument is that while models will pretty well always be wrong they can still be very useful - and an understanding of uncertainty/risk combined with expert interpretation is the best (if sometimes narrow) bridge to link model land to the real world.

Unfortunately, unlike the books mentioned above, Thompson's doesn't read particularly well - the writing is very dry. It's also arguable that having set us up to ask questions about scientific output and models, we don't get the same degree of analysis applied to Thompson's personal ideas. So, for example, she tells us 'Diversity in boardrooms is shown to result in better decision making'. I don't doubt this, or the parallel she is drawing for needing diversity of models - but how was success of decision making measured, and what does diversity mean in this context? In fact diversity is something of a running theme, with Thompson several times referring to model makers as largely WEIRD (apparently standing for Western, Educated, Industrial, Rich, Developed) - the acronym seems an unnecessarily ad hominem jibe - and is it really possible to develop mathematical models without being educated?

There are a few oddities and omissions. One of Palmer's big points in The Primacy of Doubt is the oddity that economics hasn't taken up ensemble forecasting - something that isn't mentioned here. The way (mathematical) chaos is presented is also a little odd - it's mostly referred to as 'the butterfly effect', which is really only a specific example of a potential (though relatively unlikely) impact of a chaotic system. Thompson also calls chaotic systems complex, yet they can be surprisingly simple. It's also unfortunate when describing the limitations of vaccine modelling there is no mention of a point emphasised in the scientific journal Nature: the way surface transmission and cleaning continued to be pushed many months after there was clear evidence that transmission was primarily airborne. 

Thompson's enthusiasm for diversity has one notable exception that throws into doubt her concept that the best way to use models is to have more intuitive human input from academics to interpret and modify the results. She has an impressive list of diversity requirements - age, social class, background, gender and race for those academics. But she omits the diversity elephant in the room, which is political leanings. When the vast majority of academics are politically left wing, surely this too needs to be taken into account.

Overall, some interesting points, but a dry academic writing style combined with some limitations means that it has less impact than the books mentioned above.

Hardback:   
Kindle 
Using these links earns us commission at no cost to you
Review by Brian Clegg - See all of Brian's online articles or subscribe to a weekly digest for free here

Comments

Popular posts from this blog

Philip Ball - How Life Works Interview

Philip Ball is one of the most versatile science writers operating today, covering topics from colour and music to modern myths and the new biology. He is also a broadcaster, and was an editor at Nature for more than twenty years. He writes regularly in the scientific and popular media and has written many books on the interactions of the sciences, the arts, and wider culture, including Bright Earth: The Invention of Colour, The Music Instinct, and Curiosity: How Science Became Interested in Everything. His book Critical Mass won the 2005 Aventis Prize for Science Books. Ball is also a presenter of Science Stories, the BBC Radio 4 series on the history of science. He trained as a chemist at the University of Oxford and as a physicist at the University of Bristol. He is also the author of The Modern Myths. He lives in London. His latest title is How Life Works . Your book is about the ’new biology’ - how new is ’new’? Great question – because there might be some dispute about that! Many

Stephen Hawking: Genius at Work - Roger Highfield ****

It is easy to suspect that a biographical book from highly-illustrated publisher Dorling Kindersley would be mostly high level fluff, so I was pleasantly surprised at the depth Roger Highfield has worked into this large-format title. Yes, we get some of the ephemera so beloved of such books, such as a whole page dedicated to Hawking's coxing blazer - but there is plenty on Hawking's scientific life and particularly on his many scientific ideas. I've read a couple of biographies of Hawking, but I still came across aspects of his lesser fields here that I didn't remember, as well as the inevitable topics, ranging from Hawking radiation to his attempts to quell the out-of-control nature of the possible string theory universes. We also get plenty of coverage of what could be classified as Hawking the celebrity, whether it be a photograph with the Obamas in the White House, his appearances on Star Trek TNG and The Big Bang Theory or representations of him in the Simpsons. Ha

The Blind Spot - Adam Frank, Marcelo Gleiser and Evan Thompson ****

This is a curate's egg - sections are gripping, others rather dull. Overall the writing could be better... but the central message is fascinating and the book gets four stars despite everything because of this. That central message is that, as the subtitle says, science can't ignore human experience. This is not a cry for 'my truth'. The concept comes from scientists and philosophers of science. Instead it refers to the way that it is very easy to make a handful of mistakes about what we are doing with science, as a result of which most people (including many scientists) totally misunderstand the process and the implications. At the heart of this is confusing mathematical models with reality. It's all too easy when a mathematical model matches observation well to think of that model and its related concepts as factual. What the authors describe as 'the blind spot' is a combination of a number of such errors. These include what the authors call 'the bifur