English
Related papers

Related papers: NeuroRVQ: Multi-Scale Biosignal Tokenization for G…

200 papers

Electroencephalography (EEG) is a widely used non-invasive technique for monitoring brain activity, but low signal-to-noise ratios (SNR) due to various artifacts often compromise its utility. Conventional artifact removal methods require…

Signal Processing · Electrical Eng. & Systems 2025-11-06 Shantanu Sarkar , Piotr Nabrzyski , Saurabh Prasad , Jose Luis Contreras-Vidal

Foundation models for structured electronic health records (EHRs) are pretrained on longitudinal sequences of timestamped clinical events to learn adaptable patient representations. Tokenization -- how these timelines are converted into…

The increasing need for accurate and unified analysis of diverse biological signals, such as ECG and EEG, is paramount for comprehensive patient assessment, especially in synchronous monitoring. Despite advances in multi-sensor fusion, a…

Signal Processing · Electrical Eng. & Systems 2025-07-18 Mohammed Guhdar , Ramadhan J. Mstafa , Abdulhakeem O. Mohammed

In this study, we introduce an innovative EEG signal reconstruction sub-module designed to enhance the performance of deep learning models on EEG eye-tracking tasks. This sub-module can integrate with all Encoder-Classifier-based deep…

Human-Computer Interaction · Computer Science 2024-08-13 Weigeng Li , Neng Zhou , Xiaodong Qu

Brain computer interface (BCI) research, as well as increasing portions of the field of neuroscience, have found success deploying large-scale artificial intelligence (AI) pre-training methods in conjunction with vast public repositories of…

Neurons and Cognition · Quantitative Biology 2025-06-03 Mattson Ogg , Rahul Hingorani , Diego Luna , Griffin W. Milsap , William G. Coon , Clara A. Scholl

Foundation models trained with self-supervised objectives are increasingly applied to brain recordings, but autoregressive generation of realistic multichannel neural time series remains comparatively underexplored, particularly for…

Machine Learning · Computer Science 2026-01-29 Richard Csaky , Mats W. J. van Es , Oiwi Parker Jones , Mark Woolrich

Reconstructing visual stimuli from non-invasive electroencephalography (EEG) remains challenging due to its low spatial resolution and high noise, particularly under realistic low-density electrode configurations. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Emanuele Balloni , Emanuele Frontoni , Chiara Matti , Marina Paolanti , Roberto Pierdicca , Emiliano Santarnecchi

One of the challenges in modeling cognitive events from electroencephalogram (EEG) data is finding representations that are invariant to inter- and intra-subject differences, as well as to inherent noise associated with such data. Herein,…

Machine Learning · Computer Science 2016-03-02 Pouya Bashivan , Irina Rish , Mohammed Yeasin , Noel Codella

The Algonauts 2025 Challenge called on the community to develop encoding models that predict whole-brain fMRI responses to naturalistic multimodal movies. In this submission, we propose a sequence-to-sequence Transformer that…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Qianyi He , Yuan Chang Leong

Existing vision tokenization isolates the optimization of vision tokenizers from downstream training, implicitly assuming the visual tokens can generalize well across various tasks, e.g., image generation and visual question answering. The…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Wenxuan Wang , Fan Zhang , Yufeng Cui , Haiwen Diao , Zhuoyan Luo , Huchuan Lu , Jing Liu , Xinlong Wang

Human-machine interaction is gaining traction in rehabilitation tasks, such as controlling prosthetic hands or robotic arms. Gesture recognition exploiting surface electromyographic (sEMG) signals is one of the most promising approaches,…

Generative modeling offers a promising solution to data scarcity and privacy challenges in time series analysis. However, the structural complexity of time series, characterized by multi-scale temporal patterns and heterogeneous components,…

Machine Learning · Computer Science 2026-01-19 Xiangyu Xu , Qingsong Zhong , Jilin Hu

The reconstruction of 3D objects from brain signals has gained significant attention in brain-computer interface (BCI) research. Current research predominantly utilizes functional magnetic resonance imaging (fMRI) for 3D reconstruction…

Graphics · Computer Science 2025-05-06 Xia Deng , Shen Chen , Jiale Zhou , Lei Li

Purpose: To develop a robust deep learning framework for non-contrast-enhanced functional lung MRI, overcoming the limitations of spectral decomposition in the presence of physiological non-stationarity. Methods: We introduce VQ-Wave…

Medical Physics · Physics 2026-05-05 Grzegorz Bauman , Pavlos Panos , Philipp Latzin , Oliver Bieri

Masked Image Modeling (MIM) with Vector Quantization (VQ) has achieved great success in both self-supervised pre-training and image generation. However, most existing methods struggle to address the trade-off in shared latent space for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Siyuan Li , Luyuan Zhang , Zedong Wang , Juanxi Tian , Cheng Tan , Zicheng Liu , Chang Yu , Qingsong Xie , Haonan Lu , Haoqian Wang , Zhen Lei

Reconstructing natural images from functional magnetic resonance imaging (fMRI) data remains a core challenge in natural decoding due to the mismatch between the richness of visual stimuli and the noisy, low resolution nature of fMRI…

Image and Video Processing · Electrical Eng. & Systems 2025-09-03 Junliang Ye , Lei Wang , Md Zakir Hossain

To handle the scarcity and heterogeneity of electroencephalography (EEG) data for Brain-Computer Interface (BCI) tasks, and to harness the power of large publicly available data sets, we propose Neuro-GPT, a foundation model consisting of…

Machine Learning · Computer Science 2024-03-05 Wenhui Cui , Woojae Jeong , Philipp Thölke , Takfarinas Medani , Karim Jerbi , Anand A. Joshi , Richard M. Leahy

Blood pressure (BP) is a key indicator of cardiovascular health. As hypertension remains a global cause of morbidity and mortality, accurate, continuous, and non-invasive BP monitoring is therefore of paramount importance.…

Signal Processing · Electrical Eng. & Systems 2025-10-20 Bálint Tóth , Dominik Senti , Thorir Mar Ingolfsson , Jeffrey Zweidler , Alexandre Elsig , Luca Benini , Yawei Li

Functional magnetic resonance imaging produces high dimensional data, with a less then ideal number of labelled samples for brain decoding tasks (predicting brain states). In this study, we propose a new deep temporal convolutional neural…

Machine Learning · Computer Science 2015-01-13 Orhan Firat , Emre Aksan , Ilke Oztekin , Fatos T. Yarman Vural

How to best develop foundational models for time series forecasting remains an important open question. Tokenization is a crucial consideration in this effort: what is an effective discrete vocabulary for a real-valued sequential input? To…