/ EN
2026-09-16 00:00 South Korea Papers Foundations & Methods Translated from EN

EEG-to-Text Results Overstated as Random Noise Fools Some Decoders

Summary Translating scalp EEG directly into free-form text has long been seen as one of the most ambitious goals for non-invasive brain-computer interfaces. But when researchers fed random noise instead of real EEG into several published decoders, some models still produced fluent sentences and scored about as well as they did on real brain data, suggesting the language model was doing most of the work. The field has since made noise-baseline tests and decoding without teacher forcing standard validation practice, and has used magnetoencephalography (MEG) as a comparison to quantify how far EEG trails cleaner signals.
Why it matters The study reworks the EEG-to-text scoreboard: noise-baseline tests show that some decoders' fluent output came mostly from the language model rather than the brain signal. Earlier decoding accuracy figures therefore deserve a discount, which is why noise baselines are becoming standard for new models. A head-to-head MEG comparison puts a number on EEG's gap, though MEG's room-sized scanner means it will not replace portable, low-cost EEG any time soon.

脑电转文字被曝高估:随机噪声也能骗过部分解码器
Image: Neurotechnology

BCIwiki (bciwiki.com) — Translating scalp EEG directly into freely composed text is one of the most closely watched goals in non-invasive brain-computer interfaces, but a test of several published decoders delivered a sobering result: swap in random noise, and some models still produced fluent, plausible sentences at scores comparable to real brain data, suggesting the language model was doing most of the decoding. That finding comes from a 2025 study in Scientific Reports, reviewed by EEG hardware maker Neurotechnology (BrainAccess) on September 16, 2026.

The review flags a second long-overlooked problem: many earlier evaluations relied on teacher forcing, feeding the model the correct previous word at each step instead of letting it build a sentence unaided. One widely cited analysis found that switching to fully autonomous decoding could shrink reported translation-quality scores to roughly a third of their teacher-forced values. None of this makes EEG-to-text a dead end; it is pushing the field to make noise-baseline testing and autonomous decoding the default checks for new models.

Among the work that is genuinely advancing, the 2024 academic project EEG2TEXT tackled open-vocabulary decoding head-on, combining EEG-specific pre-training with a multi-view transformer that treats signals from different scalp regions as separate perspectives on the same sentence and aligns them with a language model's sense of meaning. On standard benchmarks it improved translation-quality scores by as much as 5 percentage points. Meta AI's Brain2Qwerty took a different angle: rather than decoding imagined or spoken words, it decodes what someone is typing on a physical keyboard from brain activity recorded during typing. Published in Nature Neuroscience, the study tested 35 volunteers using both EEG and magnetoencephalography (MEG).

MEG reads magnetic rather than electrical brain activity, needs a room-sized scanner, and returns a considerably cleaner signal, which makes it the field's honesty check. In one direct head-to-head comparison, the best individual MEG participants reached a character error rate of 18%, accurate enough to perfectly decode some sentences the model had never seen in training. A newer version, Brain2Qwerty v2, trained on 22,000 typed sentences collected across 9 participants, brought the average word error rate down to 39% using MEG alone, decoded in real time; for the best participant, half of all sentences were reconstructed with at most one word wrong. The team also found decoding accuracy kept improving log-linearly as more training data was added, with no plateau in sight, hinting that some of the remaining gap might close through more data rather than cleverer architectures alone.

Taken together, the picture is fairly clear: non-invasive EEG-to-text is real, it is improving, and it remains meaningfully behind cleaner signals such as MEG, and further still behind invasive implants placed on or in the brain. The gap is narrowing through better architectures, larger datasets, and, just as importantly, through the field holding itself to tougher standards after the memorization findings. Neurotechnology said it builds affordable, wireless, dry-electrode EEG systems to put research-grade tools into more hands, from university labs to independent BCI developers, so the next dataset and the next round of tougher validation do not have to wait on a handful of institutions.

Compiled by BCIwiki from public sources

Sources · 1
brainaccess.ai 2026-09-16
Read original ↗
Suggest a correction Revisions · none / EN
© 2026 BCIwiki.com Digest Topics Tips Subscribe Revisions About