Brain Computer Interfaces: Decoding Words From Brain Signals
In a groundbreaking development, scientists at Stanford University and the University of California, San Francisco, have unveiled two remarkable brain-computer interfaces (BCI) that decode words from the unspoken but intended speech of individuals who have lost their ability to speak.
These two systems, presented in papers published in Nature, represent significant advancements in speech-decoding BCIs, offering newfound hope and possibilities for individuals who have been speechless due to various medical conditions. This article delves into the details of these cutting-edge technologies and their potential impact on communication.
Unlocking Speech With Brain Signals
Both BCIs have emerged from extensive research conducted with patients facing speech challenges. The first BCI, developed by a team led by Jaimie Henderson at Stanford University, was tested on an ALS patient called “T12” to protect her privacy.
The Stanford team implanted electrode arrays into a specific region of T12’s cortex associated with speech articulation and vocalization. These electrode recordings were then used to train a deep-learning model to associate patterns of neural activity to vocalize individual words.
The two-stage approach first mapped brain recordings to sequences of distinct phonemes, the individual sound units within words, and then combined these sounds into complete words. The result was a digital prosthesis for human speech that translated the intention to vocalize into a series of sounds and, subsequently, known words. This system achieved an average word decoding rate of 62 words per minute, surpassing the previous record of 18 words per minute.
A Potential for Faster Communication Francis Willett, a researcher at Stanford and the first author of the study, believes that T12 could communicate even faster with the device. According to Willett, the device’s algorithm is not the rate-limiting factor, leaving the question of how much faster T12 could communicate with further training.
ECoG Array for Stable Speech Decoding
The second paper, authored by researchers led by Edward Chang at UC San Francisco, presents a different approach to decoding speech from brain activity. Their participant, who lost her ability to speak after a brain-stem stroke 18 years ago, used a BCI that converted her neural activity recordings into both text and audio reconstructions of her intended speech.
Unlike the Stanford BCI, this system used electrocorticogram (ECoG) electrodes placed on the brain’s surface, targeting brain areas responsible for the movements of the vocal tract, including the lips, tongue, and jaw.
The UC San Francisco system achieved an impressive output rate of 78 words per minute, outperforming the Stanford team’s device by a significant margin. Moreover, UC San Francisco’s BCI can reconstruct speech in text and audio, enhancing the user’s communication ability.
Stability in Speech Decoding
One advantage of using ECoG signals from the brain’s surface, as highlighted by Sean Metzger, a doctoral student and the first author of the UC San Francisco paper, is its stability in speech decoding.
Unlike signals from individual neurons collected through implanted electrode arrays, ECoG signals do not require daily model retraining. This stability is a significant advantage, ensuring consistent and reliable speech decoding over extended periods.
Humanizing Communication With Facial Avatars
In an intriguing addition to their system, the UC San Francisco team collaborated with the animation firm Speech Graphics to create a facial avatar system. This avatar, representing a human face, mirrors the user’s speech, moving in response to the user’s intended articulations and facial movements.
The machine-learning model controlling the avatar recognizes specific sounds and facial movements from patterns in neural activity. The study participant expressed enthusiasm about this avatar system, suggesting it could aid in her dream of becoming a counselor by facilitating communication with clients through the BCI.
The Path Forward
While both BCIs have made significant strides in speech prosthetic capabilities, they still fall short of the average person’s speaking rate, approximately 160 words per minute. Nevertheless, these breakthroughs mark substantial progress in speech decoding BCIs, offering renewed hope for individuals with speech disabilities.
Both research teams are committed to improving performance and accuracy by exploring the use of more electrodes and enhanced hardware, to reduce word decoding errors in future iterations of their remarkable technologies.
More in Treatment
-
`
Kourtney Kardashian and Travis Barker’s “Attachment Parenting”
In the glamorous world of celebrity news, there’s nothing quite as exciting as the arrival of a new baby. Kourtney Kardashian,...
December 8, 2023 -
`
The Effect Of an Emotional Relationship on Your Well-Being
Emotional relationships are a profound and essential aspect of our lives, encompassing connections with partners, friends, family, and even ourselves. These...
November 29, 2023 -
`
Navigating Generational Differences in Healthcare Preferences
In today’s diverse workforce, catering to different generations’ healthcare needs and preferences can be quite a challenge for employers. Healthcare benefits,...
November 15, 2023 -
`
What Is ‘Sharenting’ & What Is the Psychology Behind It?
In the age of the internet, where oversharing is practically a pastime, ‘sharenting’ is a term that has emerged as a...
November 11, 2023 -
`
Self-care for PTSD
In today’s modern world, with our diverse experiences, dealing with Post-Traumatic Stress Disorder (PTSD) is not uncommon. Coping with PTSD can...
November 1, 2023 -
`
Celebrities Who Love to Gamble
Celebrities often live a life of glamour, luxury, and extravagance, and it’s no surprise that some have a penchant for high-stakes...
October 29, 2023 -
`
Fall and Winter Illnesses | How to Be Prepared
As the days grow shorter and temperatures drop, we bid farewell to the warm embrace of summer and welcome the beautiful...
October 17, 2023 -
`
5 Ways to Talk to Your Kids About Friendship
Friendship is a crucial aspect of your child’s life. It is where they learn valuable social skills, build trust, and create...
October 13, 2023 -
`
The Dark Side of Artificial Intelligence
Artificial intelligence (AI) has become an integral part of our daily lives in our rapidly advancing digital age. From voice assistants...
October 5, 2023
You must be logged in to post a comment Login