English
Related papers

Related papers: MC2SleepNet: Multi-modal Cross-masking with Contra…

200 papers

We develop a robust multi-scale structure-aware neural network for human pose estimation. This method improves the recent deep conv-deconv hourglass models with four key improvements: (1) multi-scale supervision to strengthen contextual…

Computer Vision and Pattern Recognition · Computer Science 2018-09-18 Lipeng Ke , Ming-Ching Chang , Honggang Qi , Siwei Lyu

Sleep is a fundamental physiological process that is essential for sustaining a healthy body and mind. The gold standard for clinical sleep monitoring is polysomnography(PSG), based on which sleep can be categorized into five stages,…

Machine Learning · Computer Science 2021-11-22 Bing Zhai , Yu Guan , Michael Catt , Thomas Ploetz

Background: Sleep staging is a fundamental component in the diagnosis of sleep disorders and the management of sleep health. Traditionally, this analysis is conducted in clinical settings and involves a time-consuming scoring procedure.…

Survival prediction is a crucial task in the medical field and is essential for optimizing treatment options and resource allocation. However, current methods often rely on limited data modalities, resulting in suboptimal performance. In…

Image and Video Processing · Electrical Eng. & Systems 2025-01-07 Binyu Zhang , Zhu Meng , Junhao Dong , Fei Su , Zhicheng Zhao

Understanding dark scenes based on multi-modal image data is challenging, as both the visible and auxiliary modalities provide limited semantic information for the task. Previous methods focus on fusing the two modalities but neglect the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Xiaoyu Dong , Naoto Yokoya

Multi-task learning (MTL) is an active field in deep learning in which we train a model to jointly learn multiple tasks by exploiting relationships between the tasks. It has been shown that MTL helps the model share the learned features…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Akihiro Nakano , Shi Chen , Kazuyuki Demachi

Few-shot text classification has recently been promoted by the meta-learning paradigm which aims to identify target classes with knowledge transferred from source classes with sets of small tasks named episodes. Despite their success,…

Computation and Language · Computer Science 2023-05-17 Junfan Chen , Richong Zhang , Yongyi Mao , Jie Xu

Automation of sleep analysis, including both macrostructural (sleep stages) and microstructural (e.g., sleep spindles) elements, promises to enable large-scale sleep studies and to reduce variance due to inter-rater incongruencies. While…

Signal Processing · Electrical Eng. & Systems 2026-05-26 Niklas Grieger , Siamak Mehrkanoon , Philipp Ritter , Stephan Bialonski

Existing methods of cross-modal domain adaptation for 3D semantic segmentation predict results only via 2D-3D complementarity that is obtained by cross-modal feature matching. However, as lacking supervision in the target domain, the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Boxiang Zhang , Zunran Wang , Yonggen Ling , Yuanyuan Guan , Shenghao Zhang , Wenhui Li

Brain tumor represents one of the most fatal cancers around the world, and is very common in children and the elderly. Accurate identification of the type and grade of tumor in the early stages plays an important role in choosing a precise…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Dunyuan Xu , Xi Wang , Jinyue Cai , Pheng-Ann Heng

Recently, convolutional neural networks (CNNs)-based facial landmark detection methods have achieved great success. However, most of existing CNN-based facial landmark detection methods have not attempted to activate multiple correlated…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Jun Wan , Zhihui Lai , Linlin Shen , Jie Zhou , Can Gao , Gang Xiao , Xianxu Hou

Depression is a major mental health condition that severely impacts the emotional and physical well-being of individuals. The simple nature of data collection from social media platforms has attracted significant interest in properly…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Md Rezwanul Haque , Md. Milon Islam , S M Taslim Uddin Raju , Hamdi Altaheri , Lobna Nassar , Fakhri Karray

Study Objective: Sleep is reflected not only in the electroencephalogram but also in heart rhythms and breathing patterns. Therefore, we hypothesize that it is possible to accurately stage sleep based on the electrocardiogram (ECG) and…

We used convolutional neural networks (CNNs) for automatic sleep stage scoring based on single-channel electroencephalography (EEG) to learn task-specific filters for classification without using prior domain knowledge. We used an openly…

Machine Learning · Statistics 2016-10-07 Orestis Tsinalis , Paul M. Matthews , Yike Guo , Stefanos Zafeiriou

Infrared and visible image fusion targets to provide an informative image by combining complementary information from different sensors. Existing learning-based fusion approaches attempt to construct various loss functions to preserve…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jinyuan Liu , Runjia Lin , Guanyao Wu , Risheng Liu , Zhongxuan Luo , Xin Fan

Neural networks have enabled state-of-the-art approaches to achieve incredible results on computer vision tasks such as object detection. However, such success greatly relies on costly computation resources, which hinders people with cheap…

Computer Vision and Pattern Recognition · Computer Science 2019-11-28 Chien-Yao Wang , Hong-Yuan Mark Liao , I-Hau Yeh , Yueh-Hua Wu , Ping-Yang Chen , Jun-Wei Hsieh

In the current monocular depth research, the dominant approach is to employ unsupervised training on large datasets, driven by warped photometric consistency. Such approaches lack robustness and are unable to generalize to challenging…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Jaime Spencer , Richard Bowden , Simon Hadfield

Brain disorders are a major challenge to global health, causing millions of deaths each year. Accurate diagnosis of these diseases relies heavily on advanced medical imaging techniques such as Magnetic Resonance Imaging (MRI) and Computed…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Xuran Zhu

Sleep behavior significantly impacts health and acts as an indicator of physical and mental well-being. Monitoring and predicting sleep behavior with ubiquitous sensors may therefore assist in both sleep management and tracking of related…

Machine Learning · Computer Science 2024-01-30 Maryam Khalid , Elizabeth B. Klerman , Andrew W. Mchill , Andrew J. K. Phillips , Akane Sano

Decoding neural visual representations from electroencephalogram (EEG)-based brain activity is crucial for advancing brain-machine interfaces (BMI) and has transformative potential for neural sensory rehabilitation. While multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yueyang Li , Zijian Kang , Shengyu Gong , Wenhao Dong , Weiming Zeng , Hongjie Yan , Wai Ting Siok , Nizhuan Wang