Skip to main content

May Contain Lies - Alex Edmans ****

If we are to believe the media we are bombarded with misinformation and disinformation - there's certainly a lot of it out there and Alex Edmans sets out to give a guide to the many ways that information can be badly or misleadingly presented, and how we can defend ourselves from it.

At the heart of his argument are two biases. I'm so glad he limits it to two - I get totally lost trying to keep on top of all the biases that psychologists introduce, so sticking to confirmation bias plus black and white thinking as the key errors to look out for, both in how we receive information ourselves and how others present it, is very helpful.

At the heart of the book is a ladder of levels of something like quality of information. These are statement, fact, data, evidence and proof. Edmans goes into plenty of detail on each rung - how we get, for example, from statement to fact, or data to evidence. Most of all, he demonstrates brilliantly how both those undertaking studies and those interpreting them and making use of them fail to make the leap from one rung to the next. Some of the examples are horrific - where, for instance, politicians make use of a totally opposite finding to the one in a paper, or where there is no finding at all in the study itself, yet the authors claim there is one. It's a catalogue of errors, both conscious (fraudulent) and unconscious (often dues to the biases mentioned above).

Although Edmans avoids getting over-technical I found the way he presented the content wasn't always easily approached - for instance, the way he breaks down the shades of grey that are the alternative to black and white thinking into moderate, granular and marbled is hard to get your head around. Similarly, when he is talking in details about various kinds of error he introduces, for example, the concept of an 'instrument' which 'causes the input to change, but for random reasons that having nothing to do with the output' - this isn't well introduced and needs better handling.

Edmans does a really good job in identifying all the problems in that ladder from statement to proof. I think he's less effective on giving ordinary people tools to deal with them. He accepts we can't all go into detail on the what a study really says, but his 'checklist for smart thinking' requires answers to about 17 questions, though admittedly he does then condense this into around four shortcuts. For me, a focus on source, evidence and quality is about the most we can expect most to manage. Edmans also covers studies and books/articles as key sources of information/misinformation but misses university press releases, which often employ hyperbole. Similarly, he could have made more of the replication crisis.

Despite these relatively minor negatives, this is a fascinating book that really does make it clear not only how difficult it is to be sure what a study shows, but also how difficult it is for those undertaking studies to get it all right. Recommended.

Paperback:   
Kindle:  
Using these links earns us commission at no cost to you
These articles will always be free - but if you'd like to support my online work, consider buying a virtual coffee or taking out a membership:
Review by Brian Clegg - See all Brian's online articles or subscribe to a weekly email free here

Labels:

Comments

Post a Comment

Popular posts from this blog

The Laws of Thought - Tom Griffiths *****

In giving us a history of attempts to explain our thinking abilities, Tom Griffiths demonstrates an excellent ability to pitch information just right for the informed general reader.  We begin with Aristotelian logic and the way Boole and others transformed it into a kind of arithmetic before a first introduction of computing and theories of language. Griffiths covers a surprising amount of ground - we don't just get, for instance, the obvious figures of Turing, von Neumann and Shannon, but the interaction between the computing pioneers and those concerned with trying to understand the way we think - for example in the work of Jerome Bruner, of whom I confess I'd never heard.  This would prove to be the case with a whole host of people who have made interesting contributions to the understanding of human thought processes. Sometimes their theories were contradictory - this isn't an easy field to successfully observe - but always they were interesting. But for me, at least, ...
Post a Comment
Read more

The Infinity Machine - Sebastian Mallaby ****

It's very quickly clear that Sebastian Mallaby is a huge Demis Hassabis fan - writing about the only child prodigy and teen genius ever who was also a nice, rounded personality. After a few chapters, though, things settle down (I'm reminded of Douglas Adams' description of the Hitchhiker's Guide to the Galaxy ) and we get a good, solid trip through the journey that gave us DeepMind, their AlphaGo and AlphaFold programs, the sudden explosion of competition on the AI front and thoughts on artificial general intelligence. Although Mallaby does occasionally still go into fan mode - reading this you would think that AlphaFold had successfully perfectly predicted the structure of every protein, where it is usually not sufficiently accurate for its results to have direct practical application - we get a real feel for the way this relatively unusual company was swiftly and successfully developed away from Silicon Valley. It's readable and gives an important understanding of...
Post a Comment
Read more

Nanotechnology - Rahul Rao ****

There was a time when nanotechnology was both going to transform the world and wipe us out - a similar position to our view of AI today. On the positive transformation side there was K. Eric Drexler's visions in the 1986 Engines of Creation. Arguably as much science fiction as engineering possibilities, it predicted the ability to use vast armies of assemblers to put objects together from individual atoms.  On the negative side was the vision of grey goo, out of control nanotechnology consuming all in its path as it made more and more copies of itself. In 2003, for instance, the then Prince Charles made the headlines  when newspapers reported ‘The prince has raised the spectre of the “grey goo” catastrophe in which sub-microscopic machines designed to share intelligence and replicate themselves take over and devour the planet.’ These days the expectations have been eased down a notch or two. Where nanotechnology has succeeded, it has been with the likes of atom-thick mat...
Post a Comment
Read more