Why can’t AI models answer the question, ‘how many Rs are there in the word strawberry?’

It appears that AI models are unable to respond correctly to a specific query, especially one that involves strawberry.

Many social media users found that the majority of well-known AI models gave the wrong response when asked, “How many Rs [are] in the word strawberry?”

The system insisted there were only “two,” as opposed to the expected response of “three.” In response to a challenge, AI reiterated its response saying, “I apologize for the confusion, but I must respectfully disagree. The word ‘strawberry’ does contain two ‘Rs’.”

chatgpt

Screengrab from TikTok

TikTok user Alberta Tech, who’s a software engineer, took to the platform to give an explanation for the error, which seems to have been fixed now. She indicates the language model, which allocates a token ID (a number) to each word you enter.

@alberta.nyc First let’s figure out the strawberry problem then we can worry about AI taking over 🍓 #ai ♬ original sound – Alberta Tech

“The way large language model works today is that before the AI model actually receives your input before it receives the text that you typed in chatGPT.com, it tokenizes that input and it makes it easier for the computer to deal with all this data,” she stated.

“Then, the prediction that the AI model makes is based on these numbers. It’s not based on the actual text input. So the AI model never gets to actually see the word strawberry,” she added.

The software engineer also mentioned that when you ask how many R’s are in the word strawberry, it is making a random guess as they call it in the computer science world.

In order to fix the said error, the word strawberry has to be broken down then “taking all the letters and asking it the same question.”

By moving the letters into their own tokens, the model acquires more information.

 

Other POP! stories you might like:

Family poisoned after using AI-generated foraging book bought online

Why is ‘Maybe This Time’ trending online?

Fans express concerns over BINIverse concert perks, copyright claims on fancams

95-year-old man marries 90-year-old long-time love

Filipinos react to the ₱91M flood mitigation project in Pampanga that collapsed recently

Read more...