![](https://therapyjoker.com/wp-content/uploads/2023/11/Google-DeepMind.-1000x562.jpg)
Brain Computer Interfaces: Decoding Words From Brain Signals
![](https://therapyjoker.com/wp-content/uploads/2023/11/Google-DeepMind.-1000x562.jpg)
In a groundbreaking development, scientists at Stanford University and the University of California, San Francisco, have unveiled two remarkable brain-computer interfaces (BCI) that decode words from the unspoken but intended speech of individuals who have lost their ability to speak.
These two systems, presented in papers published in Nature, represent significant advancements in speech-decoding BCIs, offering newfound hope and possibilities for individuals who have been speechless due to various medical conditions. This article delves into the details of these cutting-edge technologies and their potential impact on communication.
![](https://therapyjoker.com/wp-content/uploads/2023/11/cottonbro-studio.-e1699706319591.jpg)
cottonbro studio/ Pexels | The potential for these BCIs to empower individuals like T12 and the stroke survivor is truly remarkable
Unlocking Speech With Brain Signals
Both BCIs have emerged from extensive research conducted with patients facing speech challenges. The first BCI, developed by a team led by Jaimie Henderson at Stanford University, was tested on an ALS patient called “T12” to protect her privacy.
The Stanford team implanted electrode arrays into a specific region of T12’s cortex associated with speech articulation and vocalization. These electrode recordings were then used to train a deep-learning model to associate patterns of neural activity to vocalize individual words.
The two-stage approach first mapped brain recordings to sequences of distinct phonemes, the individual sound units within words, and then combined these sounds into complete words. The result was a digital prosthesis for human speech that translated the intention to vocalize into a series of sounds and, subsequently, known words. This system achieved an average word decoding rate of 62 words per minute, surpassing the previous record of 18 words per minute.
A Potential for Faster Communication Francis Willett, a researcher at Stanford and the first author of the study, believes that T12 could communicate even faster with the device. According to Willett, the device’s algorithm is not the rate-limiting factor, leaving the question of how much faster T12 could communicate with further training.
![](https://therapyjoker.com/wp-content/uploads/2023/11/9567f277108d06ab190582aabb83a740e1165877-1412x992.jpg)
Google DeepMind/ Pexels | The stability of speech decoding through ECoG signals from the brain’s surface is a game-changer
ECoG Array for Stable Speech Decoding
The second paper, authored by researchers led by Edward Chang at UC San Francisco, presents a different approach to decoding speech from brain activity. Their participant, who lost her ability to speak after a brain-stem stroke 18 years ago, used a BCI that converted her neural activity recordings into both text and audio reconstructions of her intended speech.
Unlike the Stanford BCI, this system used electrocorticogram (ECoG) electrodes placed on the brain’s surface, targeting brain areas responsible for the movements of the vocal tract, including the lips, tongue, and jaw.
The UC San Francisco system achieved an impressive output rate of 78 words per minute, outperforming the Stanford team’s device by a significant margin. Moreover, UC San Francisco’s BCI can reconstruct speech in text and audio, enhancing the user’s communication ability.
Stability in Speech Decoding
One advantage of using ECoG signals from the brain’s surface, as highlighted by Sean Metzger, a doctoral student and the first author of the UC San Francisco paper, is its stability in speech decoding.
Unlike signals from individual neurons collected through implanted electrode arrays, ECoG signals do not require daily model retraining. This stability is a significant advantage, ensuring consistent and reliable speech decoding over extended periods.
![](https://therapyjoker.com/wp-content/uploads/2023/11/MART-PRODUCTION.jpg)
MART PRODUCTION/ Pexels | The introduction of facial avatars to enhance communication adds a deeply human dimension to these BCIs
Humanizing Communication With Facial Avatars
In an intriguing addition to their system, the UC San Francisco team collaborated with the animation firm Speech Graphics to create a facial avatar system. This avatar, representing a human face, mirrors the user’s speech, moving in response to the user’s intended articulations and facial movements.
The machine-learning model controlling the avatar recognizes specific sounds and facial movements from patterns in neural activity. The study participant expressed enthusiasm about this avatar system, suggesting it could aid in her dream of becoming a counselor by facilitating communication with clients through the BCI.
The Path Forward
While both BCIs have made significant strides in speech prosthetic capabilities, they still fall short of the average person’s speaking rate, approximately 160 words per minute. Nevertheless, these breakthroughs mark substantial progress in speech decoding BCIs, offering renewed hope for individuals with speech disabilities.
Both research teams are committed to improving performance and accuracy by exploring the use of more electrodes and enhanced hardware, to reduce word decoding errors in future iterations of their remarkable technologies.
More in Treatment
-
`
17 Road Trip Games to Play With Friends
Remember road trips before smartphones and tablets? Endless stretches of highway are punctuated only by the drone of the engine and...
April 1, 2024 -
`
Who is Jacqueline Bisset? Discover Her Journey Through Her Own Eyes
Jacqueline Bisset’s career has spanned over six decades, captivating audiences with her intelligence, vulnerability, and undeniable screen presence. From her early...
March 26, 2024 -
`
De-Stress for Success: A Practical Guide to Letting Go
Stress. It’s a four-letter word that casts a long shadow over our lives. From looming deadlines at work to juggling family...
March 20, 2024 -
`
How Kate Middleton’s Earrings Helped Raise $13k in Charity For Mental Health
Fans of British Royals know that Princess Kate’s choice of accessories often speaks volumes about causes close to her heart. On...
March 16, 2024 -
`
Top 5 Common Parenting Challenges & Solutions
Parenting is arguably one of the toughest jobs out there. It is a journey filled with highs and lows, and no...
March 9, 2024 -
`
Effective Home Remedies for Soothing Sore Throats
Are you aware that an average person swallows between 1,000 and 2,000 times a day? If you’re grappling with the discomfort...
March 1, 2024 -
`
15 DIY Backyard Games to Unleash Your Inner Child
As the sun stretches its warm fingers across the lawn, and the scent of blooming flowers fills the air, the call...
February 19, 2024 -
`
Celebrities with ADHD: Shattering Stereotypes and Inspiring Stories
ADHD, often deemed a childhood challenge, extends its reach into the lives of celebrities who navigate their way through fame, talent,...
February 12, 2024 -
`
Unequal Journey to Motherhood: Why Some Moms Need Extra Care During Birth
Giving birth is a joyous occasion, but for some mothers, it can be a more challenging journey than for others. A...
February 6, 2024
You must be logged in to post a comment Login