Preprint: Hosted Jev Model Matches 7B LLMs in Speech BCI Rescoring Without a GPU
Gabriele Cinà reported in an arXiv preprint posted on September 27, 2026, that Jev, a hosted model, can replace the multi-billion-parameter language model that speech neuroprostheses use to rescore candidate sentences, the only GPU-dependent step in the system. Jev returns a probability for each candidate in one call, which is combined with the decoder's own score. On 978 held-out sentences from a participant with ALS, the published decoder alone had an 8.1% word error rate, versus 7.5% with Jev and 7.8% with both OPT-6.7b and Qwen2.5-7B; after re-tuning decoder weights, the figures were 6.9%, 7.2% and 7.4% respectively. Jev needs no GPU, costs $0.07 per thousand sentences, and has 262 ms end-to-end latency over the internet, versus 27 ms for a 7B model on a local GPU. The work is a preprint and has not been peer reviewed.