Skip to main content

Deep Learning: John Kelleher **

This is an entry in a series from the MIT Press that selects a small part of a topic (in this case, a subset of artificial intelligence) and gives it an 'essential knowledge' introduction. The problem is, there seems to be no consistency over the target audience of the series.

I previously reviewed Virtual Reality in the same series and it kept things relatively simple and approachable to the general reader, even if it did overdo the hype. This book by John Kelleher starts gently, but by about half way through it has become a full-blown simplified textbook with far too much in-depth technical content. That's exactly what you don't want in a popular science title.

What we get is plenty of detail of what deep learning-based systems are and how they work at the technical level, but there is practically nothing on how they fit with applications (unless you count playing games), which are described but not really explained, nor is there anything much on the problems that arise when deep learning is used for real world applications. There is a passing reference, admittedly to the difficulties of understanding how a deep learning AI system came to a decision and how this clashes with the EU's GDPR requirement for transparency and explanation, but if feels more like this is done to criticise the naivety of the legislation than the danger of using such systems.

Similarly, I saw nothing about the dangers of deep learning systems using big data picking up on correlations that don't involve any causal link, nor does the book discuss the long tail problems that arise with inputs that are relatively uncommon and so are unlikely to turn up in the training data. Similarly we read nothing about the dangers of adversarial attacks, which can fool the systems into misinterpreting inputs with tiny changes, or the difficulties such systems have with real, messy environments as opposed to the rigid rules of a game.

Overall, the book is both pitched wrong and doesn't cover the aspects that really matter to the public. It may well do fine as an introductory text for a computer science student, but that doesn't fit with the blurb on the back, which implies it is for public consumption.

Paperback:   
Kindle 
Using these links earns us commission at no cost to you
Review by Brian Clegg

Comments

Popular posts from this blog

The Laws of Thought - Tom Griffiths *****

In giving us a history of attempts to explain our thinking abilities, Tom Griffiths demonstrates an excellent ability to pitch information just right for the informed general reader.  We begin with Aristotelian logic and the way Boole and others transformed it into a kind of arithmetic before a first introduction of computing and theories of language. Griffiths covers a surprising amount of ground - we don't just get, for instance, the obvious figures of Turing, von Neumann and Shannon, but the interaction between the computing pioneers and those concerned with trying to understand the way we think - for example in the work of Jerome Bruner, of whom I confess I'd never heard.  This would prove to be the case with a whole host of people who have made interesting contributions to the understanding of human thought processes. Sometimes their theories were contradictory - this isn't an easy field to successfully observe - but always they were interesting. But for me, at least, ...

The AI Paradox - Virginia Dignum ****

This is a really important book in the way that Virginia Dignum highlights various ways we can misunderstand AI and its abilities using a series of paradoxes. However, I need to say up front that I'm giving it four stars for the ideas: unfortunately the writing is not great. It reads more like a government report than anything vaguely readable - it really should have co-authored with a professional writer to make it accessible. Even so, I'm recommending it: like some government reports it's significant enough to make it necessary to wade through the bureaucrat speak. Why paradoxes? Dignum identifies two ways we can think about paradoxes (oddly I wrote about paradoxes recently , but with three definitions): a logical paradox such as 'this statement is false', or a paradoxical truth such as 'less is more' - the second of which seems a better to fit to the use here.  We are then presented with eight paradoxes, each of which gives some insights into aspects of t...

Einstein's Fridge - Paul Sen ****

In Einstein's Fridge (interesting factoid: this is at least the third popular science book to be named after Einstein's not particularly exciting refrigerator), Paul Sen has taken on a scary challenge. As Jim Al-Khalili made clear in his excellent The World According to Physics , our physical understanding of reality rests on three pillars: relativity, quantum theory and thermodynamics. But there is no doubt that the third of these, the topic of Sen's book, is a hard sell. While it's true that these are the three pillars of physics, from the point of view of making interesting popular science, the first two might be considered pillars of gold and platinum, while the third is a pillar of salt. Relativity and quantum theory are very much of the twentieth century. They are exciting and sometimes downright weird and wonderful. Thermodynamics, by contrast, has a very Victorian feel and, well, is uninspiring. Luckily, though, thermodynamics is important enough, lying behind ...