English
Related papers

Related papers: SleepTransformer: Automatic Sleep Staging with Int…

200 papers

This paper proposes a deep learning (DL) model for automatic sleep stage classification based on single-channel EEG data. The DL model features a convolutional neural network (CNN) and transformers. The model was designed to run on energy…

Signal Processing · Electrical Eng. & Systems 2022-11-24 Zongyan Yao , Xilin Liu

Most approaches for semantic segmentation use only information from color cameras to parse the scenes, yet recent advancements show that using depth data allows to further improve performances. In this work, we focus on transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Francesco Barbato , Giulia Rizzoli , Pietro Zanuttigh

Predictive business process monitoring focuses on predicting future characteristics of a running process using event logs. The foresight into process execution promises great potentials for efficient operations, better resource management,…

Machine Learning · Computer Science 2021-04-05 Zaharah A. Bukhsh , Aaqib Saeed , Remco M. Dijkman

Understanding semantic content from brain activity during sleep represents a major goal in neuroscience. While studies in rodents have shown spontaneous neural reactivation of memories during sleep, capturing the semantic content of human…

Machine Learning · Computer Science 2024-05-21 Hui Zheng , Zhong-Tao Chen , Hai-Teng Wang , Jian-Yang Zhou , Lin Zheng , Pei-Yang Lin , Yun-Zhe Liu

Electroencephalogram (EEG) is a common base signal used to monitor brain activity and diagnose sleep disorders. Manual sleep stage scoring is a time-consuming task for sleep experts and is limited by inter-rater reliability. In this paper,…

Signal Processing · Electrical Eng. & Systems 2019-06-19 Sajad Mousavi , Fatemeh Afghah , U. Rajendra Acharya

Automatic sleep staging is a critical task in healthcare due to the global prevalence of sleep disorders. This study focuses on single-channel electroencephalography (EEG), a practical and widely available signal for automatic sleep…

Machine Learning · Computer Science 2026-01-01 Amirali Vakili , Salar Jahanshiri , Armin Salimi-Badr

This study investigates the task of dwell time prediction and proposes a Transformer framework based on interaction behavior modeling. The method first represents user interaction sequences on the interface by integrating dwell duration,…

Human-Computer Interaction · Computer Science 2025-12-22 Rui Liu , Runsheng Zhang , Shixiao Wang

Transformers evaluated in a single, fixed-depth pass are provably limited in expressive power to the constant-depth circuit class TC0. Running a Transformer autoregressively removes that ceiling -- first in next-token prediction and, more…

Machine Learning · Computer Science 2025-07-21 Mrinal Mathur , Mike Doan , Barak Pearlmutter , Sergey Plis

Sleep quality impacts well-being. Therefore, healthcare providers and individuals need accessible and reliable forecasting tools for preventive interventions. This paper introduces an interpretable, individualized adaptive spatial-temporal…

Machine Learning · Computer Science 2026-02-23 Xueyi Wang , Claudine J. C. Lamoth , Elisabeth Wilhelm

Automatic sleep scoring is essential for the diagnosis and treatment of sleep disorders and enables longitudinal sleep tracking in home environments. Conventionally, learning-based automatic sleep scoring on single-channel…

Machine Learning · Computer Science 2024-08-01 Seongju Lee , Yeonguk Yu , Seunghyeok Back , Hogeon Seo , Kyoobin Lee

Accurate classification of sleep stages based on bio-signals is fundamental not only for automatic sleep stage annotation, but also for clinical health management and continuous sleep monitoring. Traditionally, this task relies on…

Machine Learning · Computer Science 2025-09-09 Jingyu Li , Tiehua Zhang , Jinze Wang , Yi Zhang , Yuhuan Li , Yifan Zhao , Zhishu Shen , Libing Wu , Jiannan Liu

Despite extensive research on the relationship between sleep and cognition, the connection between sleep microstructure and human performance across specific cognitive domains remains underexplored. This study investigates whether deep…

Artificial Intelligence · Computer Science 2025-06-03 Boshra Khajehpiri , Eric Granger , Massimiliano de Zambotti , Fiona C. Baker , Mohamad Forouzanfar

Deep learning models with attention mechanisms have achieved exceptional results for many tasks, including language tasks and recommendation systems. Whereas previous studies have emphasized allocation of phone agents, we focused on inbound…

Machine Learning · Computer Science 2020-05-28 Ta-Chun Su , Guan-Ying Chen

In this paper, we propose a Siamese sleep transformer (SST) that effectively extracts features from single-channel raw electroencephalogram signals for robust sleep stage scoring. Despite the significant advances in sleep stage scoring in…

Signal Processing · Electrical Eng. & Systems 2022-12-29 Heon-Gyu Kwak , Young-Seok Kweon , Gi-Hwan Shin

Sleep Stage Classification (SSC) is a labor-intensive task, requiring experts to examine hours of electrophysiological recordings for manual classification. This is a limiting factor when it comes to leveraging sleep stages for therapeutic…

Signal Processing · Electrical Eng. & Systems 2024-01-22 Ali Kavoosi , Morgan P. Mitchell , Raveen Kariyawasam , John E. Fleming , Penny Lewis , Heidi Johansen-Berg , Hayriye Cagnan , Timothy Denison

Epilepsy is one of the most common neurological disorders, typically observed via seizure episodes. Epileptic seizures are commonly monitored through electroencephalogram (EEG) recordings due to their routine and low expense collection. The…

Signal Processing · Electrical Eng. & Systems 2023-01-10 İlkay Yıldız Potter , George Zerveas , Carsten Eickhoff , Dominique Duncan

Sleep is essential for maintaining human health and quality of life. Analyzing physiological signals during sleep is critical in assessing sleep quality and diagnosing sleep disorders. However, manual diagnoses by clinicians are…

Signal Processing · Electrical Eng. & Systems 2025-10-02 Cheol-Hui Lee , Hakseung Kim , Byung C. Yoon , Dong-Joo Kim

Transformer architecture has shown impressive performance in multiple research domains and has become the backbone of many neural network models. However, there is limited understanding on how it works. In particular, with a simple…

Computation and Language · Computer Science 2023-10-31 Yuandong Tian , Yiping Wang , Beidi Chen , Simon Du

Transformer is a powerful tool for many natural language tasks which is based on self-attention, a mechanism that encodes the dependence of other tokens on each specific token, but the computation of self-attention is a bottleneck due to…

Machine Learning · Computer Science 2021-03-11 Madhusudan Verma

For many years now, understanding the brain mechanism has been a great research subject in many different fields. Brain signal processing and especially electroencephalogram (EEG) has recently known a growing interest both in academia and…

Neurons and Cognition · Quantitative Biology 2022-04-18 Victor Delvigne , Hazem Wannous , Jean-Philippe Vandeborre , Laurence Ris , Thierry Dutoit