Xidian Team Drops Transformer Encoder, MLP Decoder Holds 0.94–0.98 AUC
Researchers at Xidian University built DisCo-Former, a Transformer framework for single-trial rapid serial visual presentation (RSVP) EEG decoding with three components guided by neurophysiological priors, then found its attention consistently collapsed: attention maps went nearly uniform and value-projection weights shrank toward 0. Stripping out the Transformer encoder left DisCo-MLP, a pure multilayer perceptron that matched or beat the Transformer version across two datasets and three evaluation regimes, with within-subject mean AUCs of about 0.94 to 0.98. For RSVP-EEG, the authors argue, modeling the signal's structure matters more than architectural complexity. The study was published in the International Journal of Neural Systems on April 10, 2026.