Winning by Insights... and Other Means


Here’s how Deep Blue, the computer that famously defeated (then) world champion Garry Kasparov in the pre-Big Data age “learnt” to play, writes Steven Strogatz:
“Principles, which have been refined over decades of human grandmaster experience, are programmed into the engines as complex evaluation functions that indicate what to seek in a position and what to avoid”
Sure, it was insanely fast, but was “utterly lacking insight”.

Today’s chess engines “learn” by playing and looking at games, “discovering” for themselves patterns. It’s how all of machine learning works: the more and better the data you throw at it in the learning phase, the better it gets. With machine learning techniques, computers often appear to identify insights never known to humans! Take this description of AlphaZero, Google’s machine learning algorithm world champion at chess, shogi (Japanese chess) and Go. It crushed its “programmed” learning counterpart, Stockfish by:
“thinking smarter, not faster; it examined only 60 thousand positions a second, compared to 60 million for Stockfish. It was wiser, knowing what to think about and what to ignore.”
Kasparov himself hailed AlphaZero saying it “reflects the truth” rather than the “priorities and prejudices of programmers”.

Machine learning is increasingly proving better and faster in other areas like medical diagnosis as well. But, and this is becoming a problem now:
“The algorithms can’t articulate what they’re thinking. We don’t know why they work, so we don’t know if they can be trusted.”

But why bother about how it works as long as it works? Aha. Take this AI that applied machine learning on an old arcade (video) game called Q’bert. Soon it was getting “impossibly high scores”, writes Charlie Osborne. Since this was a video game, it was easy for researchers to see how it was doing this. The surprising answer? The AI had found a bug in the game, something it then exploited to rake up a million points!

Does it even make sense to say that the AI cheated? Now we’re entering philosophy, so I’ll take a diversion into something my 7 yo daughter did recently. I was trying to introduce her to computer programming via this made-for-kids language called Scratch. I talked her through the program code for a sample game, and then let her play the game. I soon found her getting “impossibly high scores”. How? She’d gone and changed the program code to increase the score by 10 (instead of the original 1) every time she did what was expected. I was stuck in two minds. Should I be happy that she was programming? Or unhappy with her cheating?

I still haven’t made up my mind.

Comments

Post a Comment

Popular posts from this blog

Student of the Year

Image
As a toddler, my daughter loved Alia Bhatt’s songs, esp. the ones from Student of the Year . (That movie did have many good songs and well-choreographed dances). Fast forward to present day, when she is 12 yo. She rarely watches Hindi movies now, but one of the few ones she likes of late, Raja aur Rani ki Prem Kahani has, yes, Alia Bhatt.   If I had any hopes that there was anything to be read in the name of her toddler-time favorite ( Student of the Year ), they have been dashed. Our conversations come exam time are perfectly captured by this photo and its caption: In fact, the pic below captures how she and I look at her answer sheets – me intently, she with an expression of “It’s over, so why are you even looking at it?”   Of late, we pull her leg and tell her that she isn’t showing any signs of academic prowess, she’d better find a rich guy to marry. Some time later, she showed us this meme on the Internet: “Me No Study, Me No Care Me Go Marry Millionaire If He Die
Read more

The Retort of the "Luxury Person"

Image
Coming up with biting and witty retorts. It’s something we dream of, but rarely manage to pull off. Worse, the more we stew over the offending remark, the more likely we are to come up with that dream retort, as Calvin ruefully points out: During our last holiday at the Taj Resort, seeing my wife carrying towels to our poolside chairs, one of the kids there mistook her for a member of the staff and asked for a towel. When my wife narrated this to us, I did not imagine that my 8 yo daughter would come up with her own retort. But a day later, my daughter recapped the incident, an incident that didn’t even involve her in the first place , and said, “You know what I’d have told that kid who asked for the towel?”. And without waiting for an answer, she told us anyway: “I don’t work here. I too am a luxury person who is living at this resort. Go get your own towel.” We were highly amused by the phrase she had coined: “luxury person”. It certainly captures the kind of holid
Read more

Animal Senses #7: Touch and Remote Touch

Instinctively, we think touch is based on contact. Not entirely true, explains Ed Yong in Immense World – there’s a more important aspect than contact: “These incredible feats are possible through movement. If you rest a fingertip upon a surface, you can get only a limited idea of its features. But as soon you’re allowed to move, everything changes. Hardness becomes apparent with a press. Textures resolve at a stroke.” As you run your fingers over a surface, they hit the tiny peaks and troughs and set off vibrations in the mechanoreceptors at their tips.   At the tip of its snout, the star-nosed mole has many pairs of hairless appendages. It uses them to touch things around itself. Alive or dead? Food or ignore? It does these movements at an insane speed. In the time it takes to blink our eyes, the star-nosed mole can probe, identify and swallow its food. “Light may be the fastest thing in the universe, but light sensors have their limits, and the star-nosed mole’s sense of
Read more