Skip to main content

How to Expect the Unexpected - Kit Yates ****

The topic here is one everyone is interested in - getting a better handle on the future, and it's an interesting read. Arguably Kit Yates' title is a touch misleading. This isn't a 'how to' book - after reading it, you won't be any better at doing anything, but you may be less likely to make some popular errors.

My background is in Operational Research, which includes a lot on forecasting and mathematical prediction, so I was slightly disappointed that this isn't really covered here. Instead it gives us mostly ways that we instinctively get predictions wrong, so it's arguably more a psychology book that a mathematical one. There have been quite a few others that tread the path of uncovering our biases, for example with a mathematical approach in Jordan Ellenberg's How Not to be Wrong and with a more psychological twist in Richard Nesbitt's Mindware. But Yates has a particular focus on our tendency to assume linearity - that things will broadly continue the way they always have. By bringing in plenty of examples where this isn't the case - it's very often true in reality - including chaotic systems, he gives us a fresh viewpoint.

For me, the best chapter was 'reading between the lines', where Yates focuses most directly on non-linearity and really unpacks what's happening in some real world examples. And there were plenty of others with interesting examples and observations in other chapters - but I did have a few issues.

Occasionally Yates makes a statement that is hard to back up. Some of this, as is often the case with academics dipping a toe into popular science, was on historical matters - we are told 'It was will into the Middle Ages before the spherical view of the world became the predominant theory.' This just isn't true. I think he is also wrong about the millennium bug, calling it a self-defeating impact from predictions. The idea is that because of all the effort that was put in, there were few big problems, so people thought it was overhyped. I was consulting for the IT department of a global company at the time, and the reality was far more nuanced - the analysis was that it genuinely was overhyped, in that far too much was spent on checking non-critical systems that can have failed relatively painlessly, where a more effective approach would have been only to check mission- or safety-critical systems and leave the rest to fail and be fixed if necessary. 

On other occasions, Yates provides a lack of explanation. For example, he introduces Benford's law, without telling us why it occurs. Some of the material was a little dull - I was particularly disappointed with the chapter on game theory, which failed to capture the intriguing nature of the subject and didn't explain enough for the reader to get their head around what was going on. Bearing in mind a lot of the book is based on psychological research, I was really surprised there was no mention of the replication crisis (surely in itself demonstrating a glaring lack of ability to predict the future) - I would be surprised if some of the studies he cites haven't failed to be capable of reproduction, or weren't based on far too small a sample to be meaningful. At the very least, this should be discussed in a book based on such studies.

The linearity bias isn't the only one that Yates covers, though most of the ones mentioned tie into it. As is always the case with books like this, it proved very interesting to read about, but I very rapidly forgot what all the biases are (again), and found it difficult to think of practical applications of what I've read. It's fine if you are a business or government wanting to deal with uncertainty (though even there, the book isn't a practical guide), but I think it's very unlikely to make much difference to the way we go about making predictions about the future in our everyday lives, beyond 'don't bother'.

Overall, this is an interesting topic and Yates presents a novel approach and does a good job of getting the reader to appreciate the dangers of relying on linearity. The book does have a few issues, but is still well worth a read.

Hardback:   
Kindle 
Using these links earns us commission at no cost to you
Review by Brian Clegg - See all Brian's online articles or subscribe to a weekly email free here

Comments

Popular posts from this blog

Mathematics with Love – Mary Stopes-Roe *****

Admittedly it’s early days (this review is written in January), but this, for me, is the surprise hit of the year so far! I approached this book with trepidation, but found it absolutely delightful. It is described on the cover as the “courtship correspondence of Barnes Wallis, inventor of the bouncing bomb”, and contains a series of letters between Wallis and his cousin and eventual wife Molly Bloxham, along with some useful annotation by their daughter, Mary. The courtship itself is not without difficulties, as Wallis was 18 years older than the 17-year-old Molly at the start of the correspondence, and her father, not surprisingly, wasn’t too pleased about the interest of such an elderly suitor, but that isn’t the only reason the letters are interesting – it’s also because of maths, and Wallis’s position in the UK as the engineering hero of the Second World War. (Incidentally, it seemed very strange to see letters addressed to “Barnes” – I had always assumed Barnes Wallis was a ...

Data Empire - Roopika Risam ****

The central thesis presented by Roopika Risam is that information gives us (and particularly countries) the power to organise, control and dominate others. Although I have a couple of issues with the presentation, this is a genuinely interesting trip through the history of our use of stored information from the earliest tallies to the latest information technology. I loved a quote from Lisa Gitelman that data is is always 'cooked' so 'raw data is an oxymoron'. This neatly underlines Risam's thesis that data and information are not neutral facts, but rather tools that (like everything from fire to electronics) can be used for good or evil. As we are taken through the historical context, it can sometimes be a little difficult to judge whether Risam regards a particular example as bad or good, even when the outcome is disastrous. One thing I didn't like too much is the adherence to a popular science writing approach that has got distinctly hackneyed: opening chapte...

Andrew Jaffe - Five way interview

Andrew Jaffe is professor of astrophysics and cosmology at Imperial College, London and director of the Imperial Centre for Inference and Cosmology. His new book is The Random Universe. Why science? I’ve always been interested in science, in particular in  astronomy, astrophysics, and space. One of my earliest memories - back in nursery school in New Jersey, I think - was watching one of the moon launches. I wanted that excitement to be part of my life! I never got to be an astronaut, but I did get to be part of the Planck Satellite team, and was privileged to be able to travel to the ESA Spaceport in French Guiana to watch the launch.  In between, I was lucky enough to have a supportive family, get a good education, and find inspiring teachers, mentors, and collaborators. They helped me model the universe, and helped me learn how to refine those models in the face of experimental and observational evidence. That is, they taught me to be a scientist. Why this book? The Random...