Same Classifier Swings From 37.50% to 60.23% Across Three Public EEG Datasets
Researchers put five machine-learning classifiers through a single preprocessing and common spatial pattern pipeline on three public EEG datasets and found the same algorithm's accuracy swinging from 37.50% to 60.23% depending on the dataset. Linear discriminant analysis reached 60.23% on the PhysioNet EEG Motor Movement/Imagery set, while random forest managed 55.36% on BCI Competition IV Dataset 2a under five-fold cross-validation. The authors attribute the spread to dataset characteristics, subject differences and evaluation parameters, and say it exposes a persistent comparability gap in BCI decoding research; the study appeared in the Journal of Computers, Mechanical and Management on August 31, 2026.