English
Related papers

Related papers: Assessing the importance of long-range correlation…

200 papers

In power grids, short-term load forecasting (STLF) is crucial as it contributes to the optimization of their reliability, emissions, and costs, while it enables the participation of energy companies in the energy market. STLF is a…

Existing studies on reinforcement learning (RL) for sepsis management have mostly followed an established problem setup, in which patient data are aggregated into 4-hour time steps. Although concerns have been raised regarding the…

Machine Learning · Computer Science 2025-11-27 Yingchuan Sun , Shengpu Tang

Linear time-invariant state space models (SSM) are a classical model from engineering and statistics, that have recently been shown to be very promising in machine learning through the Structured State Space sequence model (S4). A core…

Machine Learning · Computer Science 2022-08-08 Albert Gu , Isys Johnson , Aman Timalsina , Atri Rudra , Christopher Ré

Short fixed-length inputs are the main bottleneck of deep learning methods in long time-series forecasting tasks. Prolonging input length causes overfitting, rapidly deteriorating accuracy. Our research indicates that the overfitting is a…

Machine Learning · Computer Science 2025-09-05 Chao Ma , Yikai Hou , Xiang Li , Yinggang Sun , Haining Yu

Machine learning is playing an increasingly important role in medical image analysis, spawning new advances in the clinical application of neuroimaging. There have been some reviews on machine learning and epilepsy before, and they mainly…

Machine Learning · Computer Science 2021-11-03 Jie Yuan , Xuming Ran , Keyin Liu , Chen Yao , Yi Yao , Haiyan Wu , Quanying Liu

Accurate classification of sleep stages from less obtrusive sensor measurements such as the electrocardiogram (ECG) or photoplethysmogram (PPG) could enable important applications in sleep medicine. Existing approaches to this problem have…

Machine Learning · Computer Science 2024-11-08 Jonathan F. Carter , Lionel Tarassenko

Sleep staging is a challenging task, typically manually performed by sleep technologists based on electroencephalogram and other biosignals of patients taken during overnight sleep studies. Recent work aims to leverage automated algorithms…

Machine Learning · Computer Science 2024-11-13 Shashank Manjunath , Hau-Tieng Wu , Aarti Sathyanarayana

Sequence modeling has important applications in natural language processing and computer vision. Recently, the transformer-based models have shown strong performance on various sequence modeling tasks, which rely on attention to capture…

Computation and Language · Computer Science 2023-05-09 Zhen Qin , Xiaodong Han , Weixuan Sun , Bowen He , Dong Li , Dongxu Li , Yuchao Dai , Lingpeng Kong , Yiran Zhong

Processing long temporal sequences is a key challenge in deep learning. In recent years, Transformers have become state-of-the-art for this task, but suffer from excessive memory requirements due to the need to explicitly store the…

Machine Learning · Computer Science 2025-07-09 Sebastian Siegel , Ming-Jay Yang , John-Paul Strachan

State space models (SSMs) have shown remarkable empirical performance on many long sequence modeling tasks, but a theoretical understanding of these models is still lacking. In this work, we study the learning dynamics of linear SSMs to…

Machine Learning · Computer Science 2024-07-11 Jakub Smékal , Jimmy T. H. Smith , Michael Kleinman , Dan Biderman , Scott W. Linderman

Repeated epileptic seizures impair around 65 million people worldwide and a successful prediction of seizures could significantly help patients suffering from refractory epilepsy. For two dogs with yearlong intracranial…

Neurons and Cognition · Quantitative Biology 2022-01-13 Hongliu Yang , Matthias Eberlein , Jens Müller , Ronald Tetzlaff

A vast majority of spiking neural networks (SNNs) are trained based on inductive biases that are not necessarily a good fit for several critical tasks that require low-latency and power efficiency. Inferring brain behavior based on the…

Neural and Evolutionary Computing · Computer Science 2023-04-20 Xi Chen , Siwei Mai , Konstantinos Michmizos

Sleep posture analysis is widely used for clinical patient monitoring and sleep studies. Earlier research has revealed that sleep posture highly influences symptoms of diseases such as apnea and pressure ulcers. In this study, we propose a…

Machine Learning · Computer Science 2021-04-07 Vandad Davoodnia , Ali Etemad

While Deep Learning (DL) is often considered the state-of-the art for Artificial Intelligence-based medical decision support, it remains sparsely implemented in clinical practice and poorly trusted by clinicians due to insufficient…

Machine Learning · Computer Science 2020-12-23 Valentin Gabeff , Tomas Teijeiro , Marina Zapater , Leila Cammoun , Sylvain Rheims , Philippe Ryvlin , David Atienza

Continuous electroencephalography (EEG) is routinely used in neurocritical care to monitor seizures and other harmful brain activity, including rhythmic and periodic patterns that are clinically significant. Although deep learning methods…

Human-Computer Interaction · Computer Science 2026-01-05 Argha Kamal Samanta , Deepak Mewada , Monalisa Sarma , Debasis Samanta

Transformer-based large language models are increasingly used for long-horizon tasks; however, their attention mechanism scales poorly with context length. To handle this, we study a sleep-like consolidation mechanism in which a model…

Computation and Language · Computer Science 2026-05-28 Sangyun Lee , Sean McLeish , Tom Goldstein , Giulia Fanti

Recurrent neural networks (RNNs) trained using Equilibrium Propagation (EP), a biologically plausible training algorithm, have demonstrated strong performance in various tasks such as image classification and reinforcement learning.…

Machine Learning · Computer Science 2025-08-21 Yoshimasa Kubo , Jean Erik Delanois , Maxim Bazhenov

Spiking Neural Networks (SNNs) with their bio-inspired Leaky Integrate-and-Fire (LIF) neurons inherently capture temporal information. This makes them well-suited for sequential tasks like processing event-based data from Dynamic Vision…

Neural and Evolutionary Computing · Computer Science 2025-07-22 Prajna G. Malettira , Shubham Negi , Wachirawit Ponghiran , Kaushik Roy

Neural activity forecasting is central to understanding neural systems and enabling closed-loop control. While deep learning has recently advanced the state-of-the-art in the time series forecasting literature, its application to neural…

The adoption of advanced deep learning (DL) architecture in stuttering detection (SD) tasks is challenging due to the limited size of the available datasets. To this end, this work introduces the application of speech embeddings extracted…

Sound · Computer Science 2022-04-05 Shakeel Ahmad Sheikh , Md Sahidullah , Fabrice Hirsch , Slim Ouni