中 / EN
2026-10-09 00:00 Papers Foundations & Methods Source language EN

Study Unifies Image and Video Reconstruction from Brain Activity

Summary Researchers introduced Neurons++, a framework for reconstructing static images and dynamic videos from functional magnetic resonance imaging recordings while examining how the outputs relate to brain signals. It uses image-fMRI pretraining followed by subject-specific fine-tuning for image and video reconstruction separately. The authors report state-of-the-art video reconstruction and competitive image reconstruction on standard benchmarks. Neural perturbation tests, cortical-feature sensitivity analyses, and brain-region-guided semantic modulation probe how outputs respond to neural signals. These model-level analyses do not establish that generated content faithfully reproduces a person's visual experience. This study is a preprint and has not been peer reviewed.
Why it matters A plausible-looking reconstruction need not accurately reflect brain activity. Beyond comparing reconstruction performance, this study changes neural inputs and examines the resulting outputs, offering a concrete way to investigate the contribution of brain signals rather than visual plausibility alone.

BCIwiki (bciwiki.com) — According to arXiv, a preprint uploaded to the platform on 2026-10-09 introduces Neurons++, a framework for reconstructing static images and dynamic videos from functional magnetic resonance imaging (fMRI) recordings. The preprint has not been peer reviewed. The study asks not only whether generated visuals look plausible, but also whether they are grounded in brain activity, a question the authors connect to understanding human perception and developing brain-computer interfaces (BCIs).

Compared with the earlier conference version, Neurons, which addressed video reconstruction only, Neurons++ extends reconstruction to both images and videos. It replaces parallel task conditioning with serial cortex-inspired decoding. Image-fMRI pretraining first establishes a spatial-semantic initialization, followed by subject-specific fine-tuning for image and video reconstruction separately. The serial design organizes fMRI-derived representations into spatial, semantic, language-level, and temporal cues.

The authors report state-of-the-art video reconstruction and competitive image reconstruction across standard benchmarks. Their neural-to-visual analyses indicate qualitative directional controllability under neural perturbation, sensitivity of the fMRI encoder read-out to stimulus-relevant cortical features, and semantic modulation guided by regions of interest (ROIs). These findings describe model responses in the reported tests rather than comprehensively establishing faithful reconstruction of visual experience. The paper states that code and model weights are publicly available.

Compiled by BCIwiki from public sources

Sources · 1
arxiv.org 2026-10-09
Read original ↗
© 2026 BCIwiki.com Digest Topics Tips Subscribe Revisions About