The study reports a comparative benchmark carried out across several public datasets. Wide swings in the same algorithm’s results from one dataset to another are a long-standing comparability problem in EEG decoding research.
Same Classifier Swings From 37.50% to 60.23% Across Three Public EEG Datasets
Summary
Researchers put five machine-learning classifiers through a single preprocessing and common spatial pattern pipeline on three public EEG datasets and found the same algorithm's accuracy swinging from 37.50% to 60.23% depending on the dataset. Linear discriminant analysis reached 60.23% on the PhysioNet EEG Motor Movement/Imagery set, while random forest managed 55.36% on BCI Competition IV Dataset 2a under five-fold cross-validation. The authors attribute the spread to dataset characteristics, subject differences and evaluation parameters, and say it exposes a persistent comparability gap in BCI decoding research; the study appeared in the Journal of Computers, Mechanical and Management on August 31, 2026.
Why it matters
EEG decoding papers each report accuracy figures, but often on their own datasets and splits, which makes them incomparable. A shared benchmark across public datasets is a precondition for judging whether a method generalizes at all.
Compiled by BCIwiki from public sources
Sources · 1
doi.org 2026-08-31