BCIwiki (bciwiki.com) — A single high-density electrocorticography (ECoG) implant can support simultaneous decoding of speech and gestures in people with paralysis, a research team has shown, according to ApplySci. Participants controlled a personalized virtual avatar by attempting speech and gestures together or separately.
The researchers had expected the combined signal to be the speech and gesture patterns added together. Instead, brain activity during simultaneous expression looked very different from the signals for speech or gestures alone.
Participants practiced up to 10 gestures and 10 words or phrases. ApplySci noted that eye-tracking, the current standard of care, is slow, limited in expression and physically exhausting, so even a small vocabulary points toward a better option.