Skip to main content

Beyond Belief - Helen Pearson *****

Apparently it comes as a surprise to many that medicine was not particularly scientific until the end of the twentieth century (to be honest, it's no surprise to me - we had a GP who used homeopathy in the 90s). Instead it was based on anecdotal guidance - the kind of thing that appeared to work. Evidence-based medicine has since improved the field, trying where possible to base decisions on evidence, ideally based on randomised controlled trials.

The first part of Helen Pearson's book covers this well - though I think it's by far the least interesting part of what we discover. Instead what's truly fascinating is the rest of it, looking at a wide range of other fields where evidence was rarely properly used and that are only now starting to dip a toe in the water. These include social policy, policing, conservation, business and education.

The main part of the book gives us examples of how bad these areas have been in terms of basing decisions on what's always been done, or anecdotally is said to work without any evidence to back it up. Pearson is honest that in some cases it is near impossible to provide gold standard blinded randomised controlled trials, but emphasises the benefit of 'aluminium standard' approaches where the best approximation is made, and of systematic reviews when carried out in a timely fashion. This was a fascinating section with plenty of examples of things going well and badly, and a look at why it can be difficult to make the change.

Finally we get a shorter section labelled 'What to do' - this is a little confusing as it feels like it should be a 'what can I do about it' section, but this only applies to two of the chapters: children and parenting, and how to join the evidence revolution (technically an afterword). The first chapter 'A Crisis of Evidence: The Pandemic and Beyond' makes some interesting points about how evidence was handled in the pandemic, but spends quite a lot of time on applying the approach outside of Western countries, and on political difficulties in the US - which seem far removed from 'What to do' that applies to the reader. Though this part does not work as well as the main body of the book, because it seems more focused on high level concerns, it still has good material on the pandemic and parenting.

I just have two small complaints. One is the feeling we get primarily is that the evidence-based approach started with medicine. In reality, good science has always been evidence based, and there were fields of applied science such as engineering and industrial chemistry where the evidence-based approach was there long before medicine came close to being a scientifically-based activity. The other is that although some of the fields covered are very much those where the science element is social sciences, there is only a brief passing mention of the social sciences replication crisis in the evidence-based management section, yet a good number of the examples elsewhere are from pre-crisis dates. At the very least this should be underlined across the board.

However, that doesn't stop this being a highly readable and informative look at the way these areas that affect all our lives have traditionally ignored properly obtained evidence and relied on anecdote.

Hardback:   
Kindle:  
Using these links earns us commission at no cost to you
These articles will always be free - but if you'd like to support my online work, consider buying a virtual coffee or taking out a membership:
Review by Brian Clegg - See all Brian's online articles or subscribe to a weekly email free here

Comments

Popular posts from this blog

Six Maths Essentials - Terence Tao *****

This is a book in the 'compact collection of science/maths essays' category beloved of publishers because they can charge hardback prices for fewer than 80 pages of text - but don't let that put you off, because it's excellent. Terence Tao introduces six areas of mathematics: numbers, algebra, geometry, probability, analysis and dynamics. Each of these is descriptive rather than practical (there are only a couple of school-level equations in sight), done in a way that gets to the heart of 'what's the point of this subject' with precision and a good level of storytelling. It's a shame in a way that analysis and dynamics form the final third of the book (apart from a short epilogue), because they don't work as well as the other sections. For the first four, practically everyone will have a vague idea of what they are and what they do - but Tao is then able to open our eyes to their wonders and power. Because Tao has to stay away from any detail of what...

To Think Like a Statistician - Bradley Efron ****

An old advert had the tag line 'it does what it says on the tin'. There's a vagueness about the title of this book that requires Bayes' theorem to work out whether it really does what it says on the cover. If you think this book will tell you how to think like a statistician, it's unlikely that you will be satisfied. But if you think it will tell you how a statistician thinks, it is much closer to being true. Sadly this makes the tag line I've seen 'Why you don’t need to be a statistician to think like one' entirely wrong. In the book, Bradley Efron gives us plenty of detail on how statisticians apply probability to try to understand better what is happening in the world. He makes a great point that his high school mathematical education consisted primarily of algebra, geometry and trigonometry. While these 'proved invaluable to my subsequent scientific studies' they hardly ever crop up in the news, where the one mathematical subject that does oc...

Bradley Efron - Five Way Interview

Bradley Efron is Max Stein Professor emeritus of Statistics and of Biomedical Data Science at Stanford University. He is the inventor of the bootstrap method for assessing statistical accuracy and has published extensively on the theory and practice of data analysis. He has served as president of the American Statistical Association and the Institute of Mathematical Statistics.  A MacArthur fellow, he is a member of the National Academy of Sciences and received the National Medal of Science in 2005. His remarkable contributions to his field were recognized again with the 2018 International Prize in Statistics, which noted his influence on 'statistical thinking in every way, including new pathways in how we communicate and teach statistics to all.' His latest book is To Think Like a Statistician . Why mathematics?   Abstract mathematics and I had an amicable divorce following my Caltech graduation. (I really wasn’t very good at it.) Statistics is a branch of applied mathematics...