Rosetta Stone to TikTok

How was the Hieroglyphics script cracked? The found-by-luck Rosetta Stone showed side by side translations in Hieroglyphics, Demotic and ancient Greek. That one piece was the help that cracked the Hieroglyphics code.

 

And what did Google Translate use as its Rosetta Stone (of different languages) when it was launched in 2006? Documents from the United Nation and European Parliament. On the Internet, finding huge data sets which can be fed to a software algorithm isn’t hard, and it is the reason why Google can search for pictures, and Facebook can recognize your friends. All those machine learning algorithms are only as good as the data set that they “learnt” from.

 

Which brings us to TikTok, the app that shows you 10-second videos. But how was TikTok’s machine learning (ML) algorithm  going to “learn” when there were almost no 10-second videos to feed to the algorithm to train it? That’s the question Eugene Wei asks and answers in this great piece:

“In a unique sort of chicken and egg problem, the very types of video that TikTok’s algorithm needed to train on weren’t easy to create without the app’s camera tools and filters, licensed music clips, etc.”

 

TikTok had to something that was seemingly impossible:

“For its algorithm to become as effective as it has, TikTok became its own source of training data.”

And to do that, they had to something very counter-intuitive. Most apps (and products) are designed to feel “intuitive, ingenious, even stylish” to the user. Aka user-friendly design. TikTok did something radically different:

“It is optimized to feed its algorithm as much useful signal as possible. It is an exemplar of what I call algorithm-friendly design.”

 

Most apps show you a large number of things at a time. This means it’s hard for the app to “know” which part of the screen you were looking at. Not TikTok. It shows one video that fills your entire screen. And it starts playing almost immediately:

“This design puts the user to an immediate question: how do you feel about this short video and this short video alone?”

All the things that the app allows you to do feeds its algorithm: did you swipe on to the next video without finishing this video? Did you watch it again? Did you share the video? Did you click the icon that shows other videos with the same soundtrack? Did you click on the video creator’s profile and watch other videos by the same guy? Notice how all the feedback is about this one video, no ambiguity?

 

I imagine most engineers would be fans of the algorithm friendly approach. And most hearteningly, as Wei writes:

 “Algorithm-friendly design need not be user-hostile. It simply takes a different approach as to how to best serve the user’s interests.”

Comments

Post a Comment

Popular posts from this blog

Student of the Year

Image
As a toddler, my daughter loved Alia Bhatt’s songs, esp. the ones from Student of the Year . (That movie did have many good songs and well-choreographed dances). Fast forward to present day, when she is 12 yo. She rarely watches Hindi movies now, but one of the few ones she likes of late, Raja aur Rani ki Prem Kahani has, yes, Alia Bhatt.   If I had any hopes that there was anything to be read in the name of her toddler-time favorite ( Student of the Year ), they have been dashed. Our conversations come exam time are perfectly captured by this photo and its caption: In fact, the pic below captures how she and I look at her answer sheets – me intently, she with an expression of “It’s over, so why are you even looking at it?”   Of late, we pull her leg and tell her that she isn’t showing any signs of academic prowess, she’d better find a rich guy to marry. Some time later, she showed us this meme on the Internet: “Me No Study, Me No Care Me Go Marry Millionaire If He Die
Read more

Animal Senses #7: Touch and Remote Touch

Instinctively, we think touch is based on contact. Not entirely true, explains Ed Yong in Immense World – there’s a more important aspect than contact: “These incredible feats are possible through movement. If you rest a fingertip upon a surface, you can get only a limited idea of its features. But as soon you’re allowed to move, everything changes. Hardness becomes apparent with a press. Textures resolve at a stroke.” As you run your fingers over a surface, they hit the tiny peaks and troughs and set off vibrations in the mechanoreceptors at their tips.   At the tip of its snout, the star-nosed mole has many pairs of hairless appendages. It uses them to touch things around itself. Alive or dead? Food or ignore? It does these movements at an insane speed. In the time it takes to blink our eyes, the star-nosed mole can probe, identify and swallow its food. “Light may be the fastest thing in the universe, but light sensors have their limits, and the star-nosed mole’s sense of
Read more

The Retort of the "Luxury Person"

Image
Coming up with biting and witty retorts. It’s something we dream of, but rarely manage to pull off. Worse, the more we stew over the offending remark, the more likely we are to come up with that dream retort, as Calvin ruefully points out: During our last holiday at the Taj Resort, seeing my wife carrying towels to our poolside chairs, one of the kids there mistook her for a member of the staff and asked for a towel. When my wife narrated this to us, I did not imagine that my 8 yo daughter would come up with her own retort. But a day later, my daughter recapped the incident, an incident that didn’t even involve her in the first place , and said, “You know what I’d have told that kid who asked for the towel?”. And without waiting for an answer, she told us anyway: “I don’t work here. I too am a luxury person who is living at this resort. Go get your own towel.” We were highly amused by the phrase she had coined: “luxury person”. It certainly captures the kind of holid
Read more