中 / EN
2026-09-17 00:00 Papers Foundations & Methods Source language EN

Study Compares AI Command Execution With External Gating in BCIs

Summary Researchers tested five language models as AI agents using 1,065 episodes from 47 people with amyotrophic lateral sclerosis. At matched execution coverage, providing reconstructed decoder confidence never reduced unfaithful execution below a deterministic gate; two models performed significantly worse. Apparent safety improvements mainly reflected less frequent action. A subsequent test gave ten models the same command vocabulary as a deterministic resolver. No direct agent arm improved on the resolver's risk-coverage frontier. However, a hybrid architecture that let models propose semantic corrections while an external gate controlled admission extended coverage in five of ten models without observed unfaithful executions.
Why it matters The study separately examines interpreting a command and authorizing its execution. Fewer actions can make errors appear less frequent without improving reliability at matched coverage. Some agents reduced execution through invalid tool calls rather than explicit abstention, a distinction that affects how safety metrics should be read.

BCIwiki (bciwiki.com) — According to BIDMC, a preprint examining AI agents executing commands at the brain-computer interface (BCI) was uploaded to medRxiv on 2026-09-17. It has not been peer reviewed. The study tested five language models using 1,065 episodes from 47 people with amyotrophic lateral sclerosis, examining how uncertainty in decoding affects downstream execution.

The researchers supplied agents with reconstructed decoder confidence, information about how certain a decoded result was. At matched execution coverage, this never reduced unfaithful execution below a deterministic gate; two models were significantly worse. Coverage here concerns the proportion covered by execution, not insurance coverage. Apparent safety gains of up to 22 percentage points reflected acting less often, sometimes through invalid tool calls rather than explicit abstention.

A post-hoc fair-information test gave ten models the same command vocabulary as a deterministic resolver. No direct agent arm improved on the resolver's risk-coverage frontier, the achievable risk levels across different degrees of coverage. A hybrid architecture, however, let models propose semantic corrections while an external gate retained admission authority. It extended coverage beyond the resolver in five of ten models without observed unfaithful executions.

The authors interpret these findings as supporting a separation between inference and control in agentic neurotechnology: a model can propose corrections to a command's meaning while an external mechanism decides whether execution is permitted. The hybrid result means that no unfaithful executions were observed in this test, not that errors are impossible in actual use.

Compiled by BCIwiki from public sources

Sources · 1
medrxiv.org 2026-09-17
Read original ↗
Suggest a correction Revisions · none 中 / EN
© 2026 BCIwiki.com Digest Topics Tips Subscribe Revisions About