ChatGPT, Hallucinations and Plugins

I was amused to find yet another thing ChatGPT can do. One guy asked the tool to identify the author of an article based on its first 4 paragraphs. ChatGPT correctly identified the author! (The author in question, Ben Thompson, publishes on the Net, so the dataset to compare against was large enough).

 

ChatGPT then explained how it had arrived at the answer. Read the entire explanation here (it’s quite short)– it sounds exactly the way a human would reason. Scary? Impressive? Both?

 

ChatGPT, like all AI’s, builds its own models, writes Ben Thompson. And like humans, its model can be wrong. But it can’t realize that. There’s even a technical term for it – hallucination:

“In artificial intelligence (AI), a hallucination or artificial hallucination (also occasionally called delusion) is a confident response by an AI that does not seem to be justified by its training data. For example, a hallucinating chatbot with no knowledge of Tesla’s revenue might internally pick a random number (such as “$13.6 billion”) that the chatbot deems plausible, and then go on to falsely and repeatedly insist that Tesla’s revenue is $13.6 billion, with no sign of internal awareness that the figure was a product of its own imagination.”

 

Hallucinations are obviously a bad thing – if you are looking for correctness. Look at it differently though and a hallucination is a creation. Is creativity then an act less severe than outright hallucination, wonders Thompson… It reminded me of that wonderful Calvin and Hobbes strip that said the same thing.

 

Nowadays there are even plugins (add-on’s) for ChatGPT. Some may be maths focussed (equation solving, graphs etc); others have interesting commercial uses. For example, say you ask ChatGPT for a recipe. With the plugin installed, at the end of the answer (recipe + ingredients), it will ask if you want to buy all the ingredients? If you say Yes, the plugin will add the items to your shopping cart with the affiliated site.

 

Even if one feels that the danger of an AI going rogue is far-fetched, some wonder if the intention of the human using the AI can now lead to highly negative outcomes. As Jeff Hawkins wrote, the AI’s model is like the map of a place. That map though can be used by a trader for one purpose and a military general for a very different purpose.

Comments

Post a Comment

Popular posts from this blog

Why we Deceive Ourselves

In their book, The Elephant in the Brain , the authors describe this weird aspect of deception that we practice: deceiving ourselves! That is so weird: “If our minds contain maps of our worlds, what good comes from having an inaccurate version of these maps?” The Sigmund Freud school of thought treats self-deception as a defense mechanism, “a way for the ego to protect itself”. The mind seeks to protect itself from anxiety and other negative emotions. Many object to this reasoning: since accurate information is so critical to our survival, surely distorting information would be dangerous. Wouldn’t the goal of protecting our self-esteem have been better achieved by making the brain’s self-esteem mechanism stronger instead? The new school of thought explains self-deception as “primarily outward-facing, manipulative, and ultimately self-serving”. This is based on Thomas Schelling’s work on game theory: “In a variety of scenarios, limiting or sabotaging yourself is the winn...
Read more

Europe #3 - Innsbruck

The last city we visited in Europe was Innsbruck in the Austrian Alps. After the cold and windy experience (at times) of Paris and Netherlands, Innsbruck was a wonderful change – it didn’t feel that cold, it was not windy all of which made it easy to walk around. Something absolutely necessary given how scenic the place is.   Since the hotel check-in time was much later in the day, we left the baggage and went to the Swarovski HQ-cum-museum about an hour by bus from Innsbruck. The crystal exhibits were brilliant – colorful, bright, shiny. Jewellery aside, it was a display of what one can do with crystals. While my wife and daughter loved the jewellery, I liked the superhero themed exhibits of Batman, Spiderman, the Hulk, and Star Wars. We didn’t buy anything there, though we did buy stuff in the Swarovski store in Innsbruck – jewellery, not the superhero stuff.   Innsbruck is a major tourist attraction during the skiing season but now in summer, we saw many groups of ...
Read more

The Thrill of the Chase

So many people complain about the difficulty in making decisions while shopping. Do you buy Brand X that gives 20% extra free? Or Brand Y that has 10% off? Or Brand Z that gives something else free with it? Do you buy that flat screen TV today or wait for the sale at Diwali? Now since the customer is king, shouldn’t companies be simplifying pricing choices? Like maybe offering consistently low prices all the time? Not so fast, as the US store, JC Penney discovered to its cost. Turns out that while people do complain about pricing choices, they are irrational. Also, they enjoy the thrill of the chase. Huh? The word “sale” acts like a siren call for many people: it lures them in to make that purchase. Consistently low prices don’t do the same. Besides, if a competitor lowers their prices just one time of the year, and Poof! Suddenly that low price claim becomes suspect in shoppers’ eyes. Then there are those sites that offer coupons: have lunch at Restaurant A on Wedne...
Read more