When Google CEO Sundar Pichai introduced a generative artificial intelligence feature for the company’s search engine recently, he and his colleagues demonstrated the new capability with six text-based queries that the public could try out.
The questions included “how do you clean a fabric sofa” and “what should I use to get a coffee stain out of my carpet”. These were intended to highlight how Google’s new feature, AI Overviews, could generate full and useful information summaries above traditional search results.
But after a few days, only one of the six queries still yielded an AI Overview. Instead, the feature was noticeably less prevalent. The search for “what should I use to get a coffee stain out of my carpet” now resulted in a snippet of text from a website, JDog Carpet Cleaning & Floor Care, while “how do you clean a fabric sofa” was replaced by a link to HGTV’s website with the answer. (The results of the searches may vary depending on the user and location.)
The disappearance of AI Overviews for some of the searches appeared to be part of a broader rollback after the new technology produced a litany of untruths and errors — including recommending glue as part of a pizza recipe and suggesting that people ingest rocks for nutrients. Users loudly complained on social media about the mistakes, in many cases outright making fun of Google.
Liz Reid, Google’s head of search, wrote in a blog post that the company had pared back AI Overviews in certain ways, launching “additional triggering refinements” to offer more careful responses about health, disabling misleading advice, and limiting the inclusion of satire and user responses from forums like Reddit.
“We’ll keep improving when and how we show AI Overviews and strengthening our protections,” she wrote.
The backtracking was a blow to Google’s efforts to keep up with rivals Microsoft and OpenAI in the frenzied race to lead AI. It also underscored the difficult strategic choice that Google faces over whether to embrace AI technology that may not be dependable or keep its highly popular search engine the same — and risk falling behind its peers.
Google had chosen to go slower than Microsoft, which placed more conversational AI into its Bing search engine early last year. Google, which has significantly more users than Bing, tested AI features for its search engine a year before introducing AI Overviews. The company said the new feature would be rolled out to users in the US immediately and to more than 1 billion people by the end of the year.
But ultimately, Google “should have rolled this out more slowly”, said Patrick Hall, an assistant professor of decision sciences at the George Washington University School of Business, US. “Once something like this happens, you really have to retreat. And if nothing else, there’s reputational harm” to the company.
Google, which has led Internet search for over two decades, has scrambled since OpenAI released ChatGPT in 2022. Some tech industry insiders considered the chatbot’s ability to generate answers to be a serious threat to Google’s search engine, which has been the most popular way to get information online.
Since then, Google has aggressively worked to regain its advantage, releasing a family of technology named Gemini, including new AI models for developers. The company also infused the technology into YouTube, Gmail and Docs, helping users create videos, emails and drafts with less effort.
Reid said at Google’s developer conference that the search engine would do more of the Googling for users with AI Overviews. She highlighted increasingly complex requests that Google could answer with the feature, but those capabilities have not yet been launched for users.
Of the six questions that Google had launched, the only one that consistently triggered an AI Overview on May 31 was “what are interesting science projects I can do with my son who is 12 years old”?
And the answer? Growing crystals, extracting DNA from saliva and writing a message with invisible ink.
NYTNS
