English
Related papers

Related papers: Introducing Multimodal Paradigm for Learning Sleep…

200 papers

Multimodal deep learning has been used to predict clinical endpoints and diagnoses from clinical routine data. However, these models suffer from scaling issues: they have to learn pairwise interactions between each piece of information in…

While automated sleep staging has achieved expert-level accuracy, its clinical adoption is hindered by a lack of auditable reasoning. We introduce SleepVLM, a rule-grounded vision-language model (VLM) designed to stage sleep from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Guifeng Deng , Pan Wang , Jiquan Wang , Shuying Rao , Junyi Xie , Wanjun Guo , Tao Li , Haiteng Jiang

In this paper, an innovative multi-modal deep learning model is proposed to deeply integrate heterogeneous information from medical images and clinical reports. First, for medical images, convolutional neural networks were used to extract…

Machine Learning · Computer Science 2024-05-29 Ziyan Yao , Fei Lin , Sheng Chai , Weijie He , Lu Dai , Xinghui Fei

This study aims to elucidate the significance of long-range correlations for deep-learning-based sleep staging. It is centered around S4Sleep(TS), a recently proposed model for automated sleep staging. This model utilizes…

Signal Processing · Electrical Eng. & Systems 2024-02-29 Tiezhi Wang , Nils Strodthoff

Reliable sleep staging remains challenging for lightweight wearable devices such as single-channel electroencephalography (scEEG) or photoplethysmography (PPG). scEEG offers direct measurement of cortical activity and serves as the…

Signal Processing · Electrical Eng. & Systems 2026-02-18 Jiawei Wang , Liang Xu , Shuntian Zheng , Yu Guan , Kaichen Wang , Ziqing Zhang , Chen Chen , Laurence T. Yang , Sai Gu

Accurate sleep stage classification across datasets remains challenging due to variability in EEG channel montages, sampling rates, recording environments, and subject populations. Although deep learning has shown considerable promise for…

Machine Learning · Computer Science 2026-05-11 Unaza Tallal , Shruti Kshirsagar , Ankita Shukla

Obstructive sleep apnea-hypopnea syndrome (OSAHS) is a common sleep disorder caused by upper airway blockage, leading to oxygen deprivation and disrupted sleep. Traditional diagnosis using polysomnography (PSG) is expensive, time-consuming,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Yingchen Wei , Xihe Qiu , Xiaoyu Tan , Jingjing Huang , Wei Chu , Yinghui Xu , Yuan Qi

Neural networks often obtain sub-optimal representations during training, which degrade robustness as well as classification performances. This is a severe problem in applying deep learning to bio-medical domains, since models are…

Signal Processing · Electrical Eng. & Systems 2020-09-14 Taeheon Lee , Jeonghwan Hwang , Honggu Lee

In this paper, we propose a novel method and a practical approach to predicting early onsets of sleep syndromes, including restless leg syndrome, insomnia, based on an algorithm that is comprised of two modules. A Fast Fourier Transform is…

Neurons and Cognition · Quantitative Biology 2021-07-09 Tim Cvetko , Tinkara Robek

Although self-supervised learning enables us to bootstrap the training by exploiting unlabeled data, the generic self-supervised methods for natural images do not sufficiently incorporate the context. For medical images, a desirable method…

Image and Video Processing · Electrical Eng. & Systems 2022-07-08 Li Sun , Ke Yu , Kayhan Batmanghelich

This paper proposes a novel framework for automatically capturing the time-frequency nature of electroencephalogram (EEG) signals of human sleep based on the authoritative sleep medicine guidance. The framework consists of two parts: the…

Machine Learning · Computer Science 2023-01-13 Zheng Chen , Ziwei Yang , Lingwei Zhu , Wei Chen , Toshiyo Tamura , Naoaki Ono , MD Altaf-Ul-Amin , Shigehiko Kanaya , Ming Huang

This paper proposes a practical approach for automatic sleep stage classification based on a multi-level feature learning framework and Recurrent Neural Network (RNN) classifier using heart rate and wrist actigraphy derived from a wearable…

Machine Learning · Statistics 2017-11-03 Xin Zhang , Weixuan Kou , Eric I-Chao Chang , He Gao , Yubo Fan , Yan Xu

Physics-driven deep learning (PD-DL) models have proven to be a powerful approach for improved reconstruction of rapid MRI scans. In order to train these models in scenarios where fully-sampled reference data is unavailable, self-supervised…

Image and Video Processing · Electrical Eng. & Systems 2025-09-08 Yaşar Utku Alçalar , Mehmet Akçakaya

Processing and analyzing of massive clinical data are resource intensive and time consuming with traditional analytic tools. Electroencephalogram (EEG) is one of the major technologies in detecting and diagnosing various brain disorders,…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-09-05 Serife Acikalin , Suleyman Eken , Ahmet Sayar

Neural approaches have shown a significant progress on camera-based reconstruction. But they require either a fairly dense sampling of the viewing sphere, or pre-training on an existing dataset, thereby limiting their generalizability. In…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Mohammed Brahimi , Bjoern Haefner , Zhenzhang Ye , Bastian Goldluecke , Daniel Cremers

Single-subject mapping of resting-state brain functional activity to non-imaging phenotypes is a major goal of neuroimaging. The large majority of learning approaches applied today rely either on static representations or on short-term…

Machine Learning · Computer Science 2022-08-09 Ahmed El-Gazzar , Rajat Mani Thomas , Guido Van Wingen

We present SleepLM, a family of sleep-language foundation models that enable human sleep alignment, interpretation, and interaction with natural language. Despite the critical role of sleep, learning-based sleep analysis systems operate in…

Artificial Intelligence · Computer Science 2026-03-02 Zongzhe Xu , Zitao Shuai , Eideen Mozaffari , Ravi S. Aysola , Rajesh Kumar , Yuzhe Yang

Panoptic Scene Graph Generation (PSG) aims to segment objects and recognize their relations, enabling the structured understanding of an image. Previous methods focus on predicting predefined object and relation categories, hence limiting…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Zijian Zhou , Zheng Zhu , Holger Caesar , Miaojing Shi

Automatic sleep scoring is essential for the diagnosis and treatment of sleep disorders and enables longitudinal sleep tracking in home environments. Conventionally, learning-based automatic sleep scoring on single-channel…

Machine Learning · Computer Science 2024-08-01 Seongju Lee , Yeonguk Yu , Seunghyeok Back , Hogeon Seo , Kyoobin Lee

Deep learning models for medical image analysis easily suffer from distribution shifts caused by dataset artifacts bias, camera variations, differences in the imaging station, etc., leading to unreliable diagnoses in real-world clinical…

Image and Video Processing · Electrical Eng. & Systems 2024-01-09 Siyuan Yan , Chi Liu , Zhen Yu , Lie Ju , Dwarikanath Mahapatra , Brigid Betz-Stablein , Victoria Mar , Monika Janda , Peter Soyer , Zongyuan Ge