Researchers Fuse fMRI and MEG to Decode Heard Speech Across Subjects
Researchers have proposed SICMD, a method that combines two non-invasive brain signals, functional magnetic resonance imaging (fMRI) and magnetoencephalography (MEG), to identify speech a person is hearing from brain activity with a single model that works across different people. fMRI pinpoints where activity occurs and MEG captures when, together giving fuller spatiotemporal information. In cross-subject perceived-speech decoding, the method improved Top-1, Top-10 and Rankacc by more than 10.6%, 10.1% and 1.7% over baseline methods, and cut training costs by 88.8% and 60.5% compared with multi-subject and intra-subject decoding respectively. The work is a preprint and has not been peer reviewed.
Why it matters
Speech decoders normally need a large dataset collected from each individual, which makes per-person training the main cost barrier; a subject-invariant model attacks that barrier directly, though decoding heard speech is still a step removed from decoding intended speech, and the paper is only a conference preprint submitted to ICASSP 2027.