English
Related papers

Related papers: Pre-trained Transformer-models using chronic invas…

200 papers

Electroencephalography (EEG) is a widely used non-invasive technique for measuring brain activity in brain-computer interface (BCI) applications. Supervised EEG decoding models often struggle to generalize across tasks, subjects, and…

Artificial Intelligence · Computer Science 2026-05-29 Ayse Betul Yuce , Sebastian Stober

Longitudinal data in electronic health records (EHRs) represent an individual`s clinical history through a sequence of codified concepts, including diagnoses, procedures, medications, and laboratory tests. Generative pre-trained…

Our ability to use deep learning approaches to decipher neural activity would likely benefit from greater scale, in terms of both model size and datasets. However, the integration of many neural recordings into one unified model is…

Foundation models for computational pathology are expected to facilitate the development of high-performing, generalisable deep learning systems. However, in addition to biologically relevant features, current foundation models also capture…

In this work, we investigate the problem of neural-based error correction decoding, and more specifically, the new so-called syndrome-based decoding technique introduced to tackle scalability in the training phase for larger code sizes. We…

Information Theory · Computer Science 2024-03-06 Gastón De Boni Rovella , Meryem Benammar

Parkinsons disease, PD, is a chronic condition that affects motor skills and includes symptoms like tremors and rigidity. The current diagnostic procedure uses patient assessments to evaluate symptoms and sometimes a magnetic resonance…

Image and Video Processing · Electrical Eng. & Systems 2022-01-14 Sabrina Zhu

Real-time decoding of neural activity is central to neuroscience and neurotechnology applications, from closed-loop experiments to brain-computer interfaces, where models are subject to strict latency constraints. Traditional methods,…

Neurons and Cognition · Quantitative Biology 2025-11-10 Avery Hee-Woon Ryoo , Nanda H. Krishna , Ximeng Mao , Mehdi Azabou , Eva L. Dyer , Matthew G. Perich , Guillaume Lajoie

Prototype-based neural networks offer interpretable predictions by comparing inputs to learned, representative signal patterns anchored in training data. While such models have shown promise in the classification of physiological data, it…

Machine Learning · Computer Science 2026-05-28 Sahil Sethi , David Chen , Michael C. Burkhart , Nipun Bhandari , Bashar Ramadan , Brett Beaulieu-Jones

Recurrent neural networks have been the dominant models for many speech and language processing tasks. However, we understand little about the behavior and the class of functions recurrent networks can realize. Moreover, the heuristics used…

Computation and Language · Computer Science 2018-11-01 Hao Tang , James Glass

At present, people usually use some methods based on convolutional neural networks (CNNs) for Electroencephalograph (EEG) decoding. However, CNNs have limitations in perceiving global dependencies, which is not adequate for common EEG…

Signal Processing · Electrical Eng. & Systems 2021-06-23 Yonghao Song , Xueyu Jia , Lie Yang , Longhan Xie

Recent work suggests that large-scale, multi-animal modeling can significantly improve neural recording analysis. However, for functional calcium traces, existing approaches remain task-specific, limiting transfer across common neuroscience…

Quantitative Methods · Quantitative Biology 2026-04-09 Xinhong Xu , Yimeng Zhang , Qichen Qian , Yuanlong Zhang

This paper proposes an end-to-end deep learning framework integrating optical motion capture with a Transformer-based model to enhance medical rehabilitation. It tackles data noise and missing data caused by occlusion and environmental…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Yeming Cai , Yang Wang , Zhenglin Li

Decomposing Electrodermal Activity (EDA) into phasic (short-term, stimulus-linked responses) and tonic (longer-term baseline) components is essential for extracting meaningful emotional and physiological biomarkers. This study presents a…

Signal Processing · Electrical Eng. & Systems 2025-06-10 Charalampos Tsirmpas , Stasinos Konstantopoulos , Dimitris Andrikopoulos , Konstantina Kyriakouli , Panagiotis Fatouros

Parkinson's disease (PD) is the second most common neurodegenerative disease worldwide and affects around 1% of the (60+ years old) elderly population in industrial nations. More than 80% of PD patients suffer from motor symptoms, which…

Vision foundation models trained on discretely sampled images achieve strong performance on classification benchmarks, yet whether their representations encode the continuous processes underlying their training data remains unclear. This…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Pritika Vig , Ren-Chin Wu , William Lotter

The application of deep learning (DL) models to the decoding of cognitive states from whole-brain functional Magnetic Resonance Imaging (fMRI) data is often hindered by the small sample size and high dimensionality of these datasets.…

Image and Video Processing · Electrical Eng. & Systems 2019-07-04 Armin W. Thomas , Klaus-Robert Müller , Wojciech Samek

Rapid development of large-scale pre-training has resulted in foundation models that can act as effective feature extractors on a variety of downstream tasks and domains. Motivated by this, we study the efficacy of pre-trained vision models…

Machine Learning · Computer Science 2022-07-05 Oleksiy Ostapenko , Timothee Lesort , Pau Rodríguez , Md Rifat Arefin , Arthur Douillard , Irina Rish , Laurent Charlin

This paper presents a preliminary analysis of the ability of Chronos foundation model to process and internally represent frequency domain information. Foundation models that process time-series data offer practitioners a unified…

Intracranial recordings have opened a unique opportunity to simultaneously measure activity across multiregional networks in the human brain. Recent works have focused on developing transformer-based neurofoundation models of such…

Machine Learning · Computer Science 2025-12-16 Lucine L. Oganesian , Saba Hashemi , Maryam M. Shanechi

Decoding brain functional states underlying different cognitive processes using multivariate pattern recognition techniques has attracted increasing interests in brain imaging studies. Promising performance has been achieved using brain…

Computer Vision and Pattern Recognition · Computer Science 2018-09-18 Hongming Li , Yong Fan