中文
相关论文

相关论文: DELTA: Language Diffusion-based EEG-to-Text Archit…

200 篇论文

Forecasting Electroncephalography (EEG) signals during cognitive events remains a fundamental challenge in neuroscience and Brain-Computer Interfaces (BCIs), as existing methods struggle to capture both the stochastic nature of neural…

信号处理 · 电气工程与系统科学 2026-03-19 Mehran Shabanpour , Sadaf Khademi , Konstantinos N Plataniotis , Arash Mohammadi

Neural decoding from electroencephalography (EEG) remains fundamentally limited by poor generalization to unseen subjects, driven by high inter-subject variability and the lack of large-scale datasets to model it effectively. Existing…

机器学习 · 计算机科学 2025-11-25 Mengchun Zhang , Kateryna Shapovalenko , Yucheng Shao , Eddie Guo , Parusha Pradhan

Recently, denoising diffusion probabilistic models and generative score matching have shown high potential in modelling complex data distributions while stochastic calculus has provided a unified point of view on these techniques allowing…

机器学习 · 计算机科学 2021-08-06 Vadim Popov , Ivan Vovk , Vladimir Gogoryan , Tasnima Sadekova , Mikhail Kudinov

Restoring speech communication from neural signals is a central goal of brain-computer interface research, yet EEG-based speech reconstruction remains challenging due to limited spatial resolution, susceptibility to noise, and the absence…

信号处理 · 电气工程与系统科学 2025-12-30 Hanbeot Park , Yunjeong Cho , Hunhee Kim

Vision-Language-Action (VLA) models aim to control robots for manipulation from visual observations and natural-language instructions. However, existing hierarchical and autoregressive paradigms often introduce architectural overhead,…

Diffusion Language Models (DLMs) offer a promising alternative for language modeling by enabling parallel decoding through iterative refinement. However, most DLMs rely on hard binary masking and discrete token assignments, which hinder the…

计算与语言 · 计算机科学 2026-01-19 Linhao Zhong , Linyu Wu , Bozhen Fang , Tianjian Feng , Chenchen Jing , Wen Wang , Jiaheng Zhang , Hao Chen , Chunhua Shen

Clinical electroencephalogram (EEG) reports encode domain-specific linguistic conventions that general-purpose language models (LMs) fail to capture. We introduce NeuroLex, a lightweight domain-adaptive language model trained purely on EEG…

计算与语言 · 计算机科学 2025-11-18 Kang Yin , Hye-Bin Shin

Current machine learning (ML)-based algorithms for filtering electroencephalography (EEG) time series data face challenges related to cumbersome training times, regularization, and accurate reconstruction. To address these shortcomings, we…

机器学习 · 计算机科学 2025-01-13 Benjamin J. Choi , Griffin Milsap , Clara A. Scholl , Francesco Tenore , Mattson Ogg

Multimodal generative models require a unified approach to handle both discrete data (e.g., text and code) and continuous data (e.g., image, audio, video). In this work, we propose Latent Language Modeling (LatentLM), which seamlessly…

计算与语言 · 计算机科学 2024-12-12 Yutao Sun , Hangbo Bao , Wenhui Wang , Zhiliang Peng , Li Dong , Shaohan Huang , Jianyong Wang , Furu Wei

Diffusion Transformers (DiT) trained with flow matching in a VAE latent space have unified visual generation across images and videos. A natural next step toward a single architecture for both generation (visual synthesis) and understanding…

We propose EEG2TEXT-CN, which, to the best of our knowledge, represents one of the earliest open-vocabulary EEG-to-text generation frameworks tailored for Chinese. Built on a biologically grounded EEG encoder (NICE-EEG) and a compact…

计算与语言 · 计算机科学 2025-07-09 Jacky Tai-Yu Lu , Jung Chiang , Chi-Sheng Chen , Anna Nai-Yun Tung , Hsiang Wei Hu , Yuan Chiao Cheng

The growing convergence between Large Language Models (LLMs) and electroencephalography (EEG) research is enabling new directions in neural decoding, brain-computer interfaces (BCIs), and affective computing. This survey offers a systematic…

信号处理 · 电气工程与系统科学 2025-06-11 Naseem Babu , Jimson Mathew , A. P. Vinod

Recent advances in self-supervised learning for EEG representation have largely relied on masked reconstruction, where models are trained to recover randomly masked signal segments. While effective at modeling local dependencies, such…

机器学习 · 计算机科学 2026-04-17 Shaocong Wang , Tong Liu , Yihan Li , Ming Li , Kairui Wen , Pei Yang , Wenqi Ji , Minjing Yu , Yong-Jin Liu

Automated classification of electroencephalogram (EEG) signals is complex due to their high dimensionality, non-stationarity, low signal-to-noise ratio, and variability between subjects. Deep neural networks (DNNs) have shown promising…

信号处理 · 电气工程与系统科学 2024-05-27 Gustavo H. Rodrigues , Bruno Aristimunha , Sylvain Chevallier , Raphael Y. de Camargo

Event cameras harness advantages such as low latency, high temporal resolution, and high dynamic range (HDR), compared to standard cameras. Due to the distinct imaging paradigm shift, a dominant line of research focuses on event-to-video…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Kanghao Chen , Hangyu Li , JiaZhou Zhou , Zeyu Wang , Lin Wang

Most Video-Large Language Models (Video-LLMs) adopt an encoder-decoder framework, where a vision encoder extracts frame-wise features for processing by a language model. However, this approach incurs high computational costs, introduces…

计算机视觉与模式识别 · 计算机科学 2025-11-06 Handong Li , Yiyuan Zhang , Longteng Guo , Xiangyu Yue , Jing Liu

Electroencephalogram (EEG) classification has been widely used in various medical and engineering applications, where it is important for understanding brain function, diagnosing diseases, and assessing mental health conditions. However,…

信号处理 · 电气工程与系统科学 2024-08-20 Mingzhi Chen , Yiyu Gui , Yuqi Su , Yuesheng Zhu , Guibo Luo , Yuchao Yang

Decoding linguistic information from non-invasive brain signals using EEG has gained increasing research attention due to its vast applicational potential. Recently, a number of works have adopted a generative-based framework to decode…

计算与语言 · 计算机科学 2024-08-12 Jinzhao Zhou , Yiqun Duan , Ziyi Zhao , Yu-Cheng Chang , Yu-Kai Wang , Thomas Do , Chin-Teng Lin

We introduce MUSE-VL, a Unified Vision-Language Model through Semantic discrete Encoding for multimodal understanding and generation. Recently, the research community has begun exploring unified models for visual generation and…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Rongchang Xie , Chen Du , Ping Song , Chang Liu

Large language model (LLM)-based text-to-speech (TTS) systems achieve remarkable naturalness via autoregressive (AR) decoding, but require N sequential steps to generate N speech tokens. We present LLaDA-TTS, which replaces the AR LLM with…

声音 · 计算机科学 2026-03-30 Xiaoyu Fan , Huizhi Xie , Wei Zou , Yunzhang Chen