Skip to main content

The Master Algorithm - Pedro Domingos ***

I am really struggling to remember a book that has irritated me as much as this one, which is a shame because it's on a very interesting and significant subject. Pedro Domingos takes us into the world of computer programs that solve problems through learning, exploring everything from back propagating neural networks to Bayesian algorithms, looking for the direction in which we might spot the computing equivalent of the theory of everything, the master algorithm that can do pretty much anything that can be done with a computer (Turing proved a long time ago that there will always be some things that can't). As the subtitle puts it, this is the quest for the ultimate learning machine that will remake our world.

So far, so good. Not only an interesting subject but one I have a personal interest in as I had some involvement in artificial intelligence many moons ago. But just reading the prologue put my hackles up. It was one of those descriptions of how a technology influences every moment of your life, as the author takes us through a typical day. Except 90% of his examples have only ever been experienced by a Silicon Valley geek, and those that the rest of us have come across, like algorithms to make recommendations to you on shopping websites and video streaming sites, in my experience, are always so terrible that they are almost funny.

The pain carries on in part because of a kind of messianic fervour for the topic that means that the author seems convinced it is about to totally takeover the world - and like most fanatics, he presents this view while viciously attacking everyone who disagrees, from the likes of Marvin Minsky and Noam Chomsky to Black Swan author Nassim Nicholas Taleb. It's interesting that Domingos is totally dismissive of the early knowledge engineers who thought their methodology would take over the world, but can't see that his own pursuit of the 'master algorithm' (think of Lord of the Rings, but substitute 'algorithm' for 'ring') is equally likely to be a pursuit that is much easier to theorise about than to bring to success.

To make matters worse, Domingos repeatedly claims, for instance, that thanks to learning algorithms it's possible to predict the movement of the stock market, or to predict the kind of 'black swan' events that Taleb shows so convincingly are unpredictable. Yet I have never seen any evidence that this is true, it seems to go totally against what we know from chaos theory, and Domingos doesn't present any evidence, he just states it as fact. (Could you really have predicted the existence of black swans before they were discovered? How about blue ones?)

One other problem I have with the book is that the author isn't very good at explaining the complexities he is dealing with. I've seen many explanations of Bayesian statistics over the years, for instance, and this was one of the most impenetrable I've ever seen.

I can't tell you to avoid this book, because I've not come across another that introduces the whole range of machine learning options in the way that Domingos does. But any recommendation has to be made through gritted teeth because I did not like the way that information was put across.


Hardback 

Kindle 
Using these links earns us commission at no cost to you

These articles will always be free - but if you'd like to support my online work, consider buying a virtual coffee:
Review by Brian Clegg - See all Brian's online articles or subscribe to a weekly email free here

Comments

Popular posts from this blog

Rakhat-Bi Abdyssagin Five Way Interview

Rakhat-Bi Abdyssagin (born in 1999) is a distinguished composer, concert pianist, music theorist and researcher. Three of his piano CDs have been released in Germany. He started his undergraduate degree at the age of 13 in Kazakhstan, and having completed three musical doctorates in prominent Italian music institutions at the age of 20, he has mastered advanced composition techniques. In 2024 he completed a PhD in music at the University of St Andrews / Royal Conservatoire of Scotland (researching timbre-texture co-ordinate in avant- garde music), and was awarded The Silver Medal of The Worshipful Company of Musicians, London. He has held visiting affiliations at the Universities of Oxford, Cambridge and UCL, and has been lecturing and giving talks internationally since the age of 13. His latest book is Quantum Mechanics and Avant Garde Music . What links quantum physics and avant-garde music? The entire book is devoted to this question. To put it briefly, there are many different link...

Should we question science?

I was surprised recently by something Simon Singh put on X about Sabine Hossenfelder. I have huge admiration for Simon, but I also have a lot of respect for Sabine. She has written two excellent books and has been helpful to me with a number of physics queries - she also had a really interesting blog, and has now become particularly successful with her science videos. This is where I'm afraid she lost me as audience, as I find video a very unsatisfactory medium to take in information - but I know it has mass appeal. This meant I was concerned by Simon's tweet (or whatever we are supposed to call posts on X) saying 'The Problem With Sabine Hossenfelder: if you are a fan of SH... then this is worth watching.' He was referencing a video from 'Professor Dave Explains' - I'm not familiar with Professor Dave (aka Dave Farina, who apparently isn't a professor, which is perhaps a bit unfortunate for someone calling out fakes), but his videos are popular and he...

Everything is Predictable - Tom Chivers *****

There's a stereotype of computer users: Mac users are creative and cool, while PC users are businesslike and unimaginative. Less well-known is that the world of statistics has an equivalent division. Bayesians are the Mac users of the stats world, where frequentists are the PC people. This book sets out to show why Bayesians are not just cool, but also mostly right. Tom Chivers does an excellent job of giving us some historical background, then dives into two key aspects of the use of statistics. These are in science, where the standard approach is frequentist and Bayes only creeps into a few specific applications, such as the accuracy of medical tests, and in decision theory where Bayes is dominant. If this all sounds very dry and unexciting, it's quite the reverse. I admit, I love probability and statistics, and I am something of a closet Bayesian*), but Chivers' light and entertaining style means that what could have been the mathematical equivalent of debating angels on...