English

Unlocking Non-Invasive Brain-to-Text

Machine Learning 2025-05-20 v1

Abstract

Despite major advances in surgical brain-to-text (B2T), i.e. transcribing speech from invasive brain recordings, non-invasive alternatives have yet to surpass even chance on standard metrics. This remains a barrier to building a non-invasive brain-computer interface (BCI) capable of restoring communication in paralysed individuals without surgery. Here, we present the first non-invasive B2T result that significantly exceeds these critical baselines, raising BLEU by 1.42.6×1.4\mathrm{-}2.6\times over prior work. This result is driven by three contributions: (1) we extend recent word-classification models with LLM-based rescoring, transforming single-word predictors into closed-vocabulary B2T systems; (2) we introduce a predictive in-filling approach to handle out-of-vocabulary (OOV) words, substantially expanding the effective vocabulary; and (3) we demonstrate, for the first time, how to scale non-invasive B2T models across datasets, unlocking deep learning at scale and improving accuracy by 2.12.3×2.1\mathrm{-}2.3\times. Through these contributions, we offer new insights into the roles of data quality and vocabulary size. Together, our results remove a major obstacle to realising practical non-invasive B2T systems.

Keywords

Cite

@article{arxiv.2505.13446,
  title  = {Unlocking Non-Invasive Brain-to-Text},
  author = {Dulhan Jayalath and Gilad Landau and Oiwi Parker Jones},
  journal= {arXiv preprint arXiv:2505.13446},
  year   = {2025}
}

Comments

27 pages, 10 figures, 10 tables. Under review

R2 v1 2026-07-01T02:22:44.455Z