May 3, 2023
3 mins read

New ChatGPT, Bard like AI tool to turn thoughts into text

It might help people who are mentally conscious yet unable to physically speak…reports Asian Lite News

US scientists have developed a new artificial intelligence (AI) system that can translate a person’s brain activity — while listening to a story or silently imagining telling a story — into a continuous stream of text.

The system, developed by a team at the University of Texas at Austin relies in part on a transformer model, similar to the ones that power Open AI’s ChatGPT and Google’s Bard.

It might help people who are mentally conscious yet unable to physically speak, such as those debilitated by strokes, to communicate intelligibly again, according to the team who published the study in the journal Nature Neuroscience.

Unlike other language decoding systems in development, this system called semantic decoder does not require subjects to have surgical implants, making the process noninvasive. Participants also do not need to use only words from a prescribed list.

Brain activity is measured using an functional MRI scanner after extensive training of the decoder, in which the individual listens to hours of podcasts in the scanner.

Later, provided that the participant is open to having their thoughts decoded, their listening to a new story or imagining telling a story allows the machine to generate corresponding text from brain activity alone.

“For a noninvasive method, this is a real leap forward compared to what’s been done before, which is typically single words or short sentences,” said Alex Huth, an assistant professor of neuroscience and computer science at UT Austin.

“We’re getting the model to decode continuous language for extended periods of time with complicated ideas,” he added.

The result is not a word-for-word transcript. Instead, researchers designed it to capture the gist of what is being said or thought, albeit imperfectly. About half the time, when the decoder has been trained to monitor a participant’s brain activity, the machine produces text that closely (and sometimes precisely) matches the intended meanings of the original words.

For example, in experiments, a participant listening to a speaker say: “I don’t have my driver’s licence yeta had their thoughts translated as, “She has not even started to learn to drive yet.”

The team also addressed questions about potential misuse of the technology in the study. The paper describes how decoding worked only with cooperative participants who had participated willingly in training the decoder.

Results for individuals on whom the decoder had not been trained were unintelligible, and if participants on whom the decoder had been trained later put up resistance — for example, by thinking other thoughts — results were similarly unusable.

“We take very seriously the concerns that it could be used for bad purposes and have worked to avoid that,” said Jerry Tang, a doctoral student in computer science. “We want to make sure people only use these types of technologies when they want to and that it helps them.”

In addition to having participants listen or think about stories, the researchers asked subjects to watch four short, silent videos while in the scanner. The semantic decoder was able to use their brain activity to accurately describe certain events from the videos.

The system currently is not practical for use outside of the laboratory because of its reliance on the time needed on an fMRI machine. But the researchers think this work could transfer to other, more portable brain-imaging systems, such as functional near-infrared spectroscopy (fNIRS).

ALSO READ: Musk agrees to settle defamation suit by Indian-American Sikh

Previous Story

‘Godfather of AI’ leaves Google, warns of tech’s dangers

Next Story

Navy chief visits Singapore, officiates first ASEAN-India maritime drill

Latest from Tech LITE

Uber Targets India Dominance

On the subject of travel, Khosrowshahi observed that booking processes remain outdated and ripe for disruption. “I don’t think that the travel industry has innovated that much Uber CEO Dara Khosrowshahi has

Arab League urges Bigger AI investments

A central message of the Arab AI Forum was the urgent adoption of the league’s recently endorsed ethical AI charter….reports Asian Lite News In a defining moment for the future of artificial

Japan City Limits Smartphones

The proposal comes as new figures from Japan’s Children and Families Agency show that young people in the country spend an average of more than five hours online each weekday A city

India Embraces AI Future

Upskilling is emerging as a critical focus, with 51 per cent of leaders naming it their top priority. Around 63 per cent of managers expect AI training to become a core team

UAE Wows Osaka!

The UAE Pavilion at Expo 2025 Osaka celebrates its three millionth visitor, blending culture, innovation, and hospitality in an immersive showcase of heritage, sustainability, and forward-looking global vision….reports Asian Lite News The
Go toTop

Don't Miss

Study Shows ChatGPT Can Be Used for Sensory Evaluation of Brownies

ChatGPT’s success in evaluating brownies suggests a broader potential for

ChatGPT fined for exposing personal info of 687 S. Koreans

A total of 687 users in South Korea have been