MY KOLKATA EDUGRAPH
ADVERTISEMENT
regular-article-logo Tuesday, 26 November 2024

Sentient AI capable of discrimination

...said a Google engineer who has since been sidelined

Nico Grant, Cade Metz Published 27.06.22, 03:38 AM
While chasing the AI vanguard, Google’s research organisation has spent the past few years mired in scandal and controversy.

While chasing the AI vanguard, Google’s research organisation has spent the past few years mired in scandal and controversy. NYTNS

Google placed an engineer on paid leave recently after dismissing his claim that its artificial intelligence is sentient, surfacing yet another fracas about the company’s most advanced technology.

The company’s human resources department said Blake Lemoine, a senior software engineer in Google’s Responsible AI organisation, had violated Google’s confidentiality policy. The day before his suspension, Lemoine said, he handed over documents to a US senator’s office, claiming they provided evidence that Google and its technology engaged in religious discrimination.

ADVERTISEMENT

Google said its systems imitated conversational exchanges and could riff on different topics but did not have consciousness. “Our team — including ethicists and technologists — has reviewed Blake’s concerns per our AI principles and have informed him that the evidence does not support his claims,” Brian Gabriel, a Google spokesperson. “Some in the broader AI community are considering the long-term possibility of sentient or general AI, but it doesn’t make sense to do so by anthropomorphising today’s conversational models, which are not sentient.”

For months, Lemoine had tussled with Google managers, executives and human resources over his surprising claim that the company’s Language Model for Dialogue Applications, or LaMDA, had consciousness and a soul. Google says hundreds of its researchers and engineers have conversed with LaMDA, an internal tool, and reached a different conclusion than Lemoine did. Most AI experts believe the industry is a very long way from computing sentience.

Some AI researchers have long made optimistic claims about these technologies soon reaching sentience, but many others are extremely quick to dismiss these claims. “If you used these systems, you would never say such things,” said Emaad Khwaja, a researcher at the University of California, Berkeley, and the University of California, San Francisco, US, who is exploring similar technologies.

While chasing the AI vanguard, Google’s research organisation has spent the past few years mired in scandal and controversy. The division’s scientists and other employees have regularly feuded over technology and personnel matters in episodes that have often spilled into the public arena. In March, Google fired a researcher who had sought to publicly disagree with two of his colleagues’ published work. And the dismissals of two AI ethics researchers, Timnit Gebru and Margaret Mitchell, after they criticised Google language models, have continued to cast a shadow on the group.

Lemoine, a military veteran who has described himself as a priest, an ex-convict and an AI researcher, told Google executives as senior as Kent Walker, president of global affairs, that he believed LaMDA was a child age seven or eight. He wanted the company to seek the computer program’s consent before running experiments on it. His claims were founded on his religious beliefs, which he said the company’s human resources department discriminated against.

“They have repeatedly questioned my sanity,” Lemoine said. “They said, ‘Have you been checked out by a psychiatrist recently’?”

Yann LeCun, head of AI research at Meta, said these types of systems are not powerful enough to attain true intelligence.

Google’s technology is what scientists call a neural network, which is a mathematical system that learns skills by analysing large amounts of data. By pinpointing patterns in thousands of cat photos, for example, it can learn to recognise a cat.

Tech companies have designed neural networks that learned from enormous amounts of prose, including unpublished books and Wikipedia articles by the thousands. These “large language models” can be applied to many tasks.

But they are extremely flawed. Sometimes, they generate perfect prose. Sometimes, they generate nonsense. The systems are very good at recreating patterns they have seen in the past, but they cannot reason like a human.

NYTNS

Follow us on:
ADVERTISEMENT
ADVERTISEMENT