Single ECoG Implant Lets Paralyzed Participants Speak and Gesture Through an Avatar
A research team has used a single high-density electrocorticography (ECoG) implant, an electrode array placed on the brain's surface, to decode speech and gestures simultaneously in people with paralysis, ApplySci reported. When participants simply attempted to speak or gesture, a personalized virtual avatar spoke or moved accordingly, either both at once or separately. The researchers expected the brain signals during combined expression to be a simple sum of the two, but the data differed clearly from speech or gestures alone. Participants practiced a limited vocabulary of up to 10 gestures and 10 words or phrases.
Why it matters
Most speech-decoding work restores talking alone; reading speech and gesture from one implant moves closer to natural communication, though the non-additive signals mean decoders must be trained on combined actions. The current standard, eye tracking, is slow, restrictive and physically tiring, the report noted, so even a small vocabulary points to room for improvement.
