Skip to main content

Beyond Belief - Helen Pearson *****

Apparently it comes as a surprise to many that medicine was not particularly scientific until the end of the twentieth century (to be honest, it's no surprise to me - we had a GP who used homeopathy in the 90s). Instead it was based on anecdotal guidance - the kind of thing that appeared to work. Evidence-based medicine has since improved the field, trying where possible to base decisions on evidence, ideally based on randomised controlled trials.

The first part of Helen Pearson's book covers this well - though I think it's by far the least interesting part of what we discover. Instead what's truly fascinating is the rest of it, looking at a wide range of other fields where evidence was rarely properly used and that are only now starting to dip a toe in the water. These include social policy, policing, conservation, business and education.

The main part of the book gives us examples of how bad these areas have been in terms of basing decisions on what's always been done, or anecdotally is said to work without any evidence to back it up. Pearson is honest that in some cases it is near impossible to provide gold standard blinded randomised controlled trials, but emphasises the benefit of 'aluminium standard' approaches where the best approximation is made, and of systematic reviews when carried out in a timely fashion. This was a fascinating section with plenty of examples of things going well and badly, and a look at why it can be difficult to make the change.

Finally we get a shorter section labelled 'What to do' - this is a little confusing as it feels like it should be a 'what can I do about it' section, but this only applies to two of the chapters: children and parenting, and how to join the evidence revolution (technically an afterword). The first chapter 'A Crisis of Evidence: The Pandemic and Beyond' makes some interesting points about how evidence was handled in the pandemic, but spends quite a lot of time on applying the approach outside of Western countries, and on political difficulties in the US - which seem far removed from 'What to do' that applies to the reader. Though this part does not work as well as the main body of the book, because it seems more focused on high level concerns, it still has good material on the pandemic and parenting.

I just have two small complaints. One is the feeling we get primarily is that the evidence-based approach started with medicine. In reality, good science has always been evidence based, and there were fields of applied science such as engineering and industrial chemistry where the evidence-based approach was there long before medicine came close to being a scientifically-based activity. The other is that although some of the fields covered are very much those where the science element is social sciences, there is only a brief passing mention of the social sciences replication crisis in the evidence-based management section, yet a good number of the examples elsewhere are from pre-crisis dates. At the very least this should be underlined across the board.

However, that doesn't stop this being a highly readable and informative look at the way these areas that affect all our lives have traditionally ignored properly obtained evidence and relied on anecdote.

Hardback:   
Kindle 
Using these links earns us commission at no cost to you
These articles will always be free - but if you'd like to support my online work, consider buying a virtual coffee or taking out a membership:
Review by Brian Clegg - See all Brian's online articles or subscribe to a weekly email free here

Comments

Popular posts from this blog

Luna: Moon Rising (SF) - Ian McDonald ****

I'm not the natural audience for this book. Game of Thrones l eaves me cold - and it's hard not to feel the influence of GoT (and a whole lot of Dune )   underneath a veneer of science fiction and the trappings of a South American drug cartel in the cod-medieval family power battles and chivalric details. There are even dragons (of a sort). I'd be really sad if the future did involve this sort of throwback feudalism. However, remarkably, despite this I found Luna: Moon Rising kept me engaged. The fact is that Ian McDonald can put together a good plot with intricate machinations, which is enough to carry the reader through what can be a bewildering collection of characters. The two page scene-setter saying who did what to whom at the start was useful, but I could have done with family trees for the main family as I was constantly forgetting who was who - especially easy as McDonald endows many families with characters with the same first initial (e.g. Ariel and Al...

Adventures of a Computational Explorer - Stephen Wolfram ***

Stephen Wolfram, the man behind the scientist's mathematical tool of choice, Mathematica, plus a whole host of other software products, including the uncanny Wolfram Alpha knowledge engine, is undoubtedly a genius of the first order. In this book, we get an uncensored excursion into the mind of genius - which is, without doubt, a fascinating prospect. The book consists of a collection of essays and speeches that Wolfram has produced over the last ten to fifteen years, covering an eclectic range of topics. Like all such collections, the result is something that lacks the coherence of a book with a narrative that runs through it, inevitably introducing a degree of repetition and a mix of interesting and not-so-interesting topics - but there's likely to be something to catch the attention anyone who is into computing or mathematics. One of the most interesting pieces is the opening one, where Wolfram describes being a consultant on the SF movie Arrival. He seems to hav...

The AI Paradox - Virginia Dignum ****

This is a really important book in the way that Virginia Dignum highlights various ways we can misunderstand AI and its abilities using a series of paradoxes. However, I need to say up front that I'm giving it four stars for the ideas: unfortunately the writing is not great. It reads more like a government report than anything vaguely readable - it really should have co-authored with a professional writer to make it accessible. Even so, I'm recommending it: like some government reports it's significant enough to make it necessary to wade through the bureaucrat speak. Why paradoxes? Dignum identifies two ways we can think about paradoxes (oddly I wrote about paradoxes recently , but with three definitions): a logical paradox such as 'this statement is false', or a paradoxical truth such as 'less is more' - the second of which seems a better to fit to the use here.  We are then presented with eight paradoxes, each of which gives some insights into aspects of t...