English
Related papers

Related papers: sleep2vec: Unified Cross-Modal Alignment for Heter…

200 papers

Biomedical signal processing extract meaningful information from physiological signals like electrocardiograms (ECGs), electroencephalograms (EEGs), and electromyograms (EMGs) to diagnose, monitor, and treat medical conditions and diseases…

Signal Processing · Electrical Eng. & Systems 2025-08-13 Justin London

During the diagnostic process, clinicians leverage multimodal information, such as chief complaints, medical images, and laboratory-test results. Deep-learning models for aiding diagnosis have yet to meet this requirement. Here we report a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Hong-Yu Zhou , Yizhou Yu , Chengdi Wang , Shu Zhang , Yuanxu Gao , Jia Pan , Jun Shao , Guangming Lu , Kang Zhang , Weimin Li

Labeling of multivariate biomedical time series data is a laborious and expensive process. Self-supervised contrastive learning alleviates the need for large, labeled datasets through pretraining on unlabeled data. However, for multivariate…

Machine Learning · Statistics 2023-07-21 Thea Brüsch , Mikkel N. Schmidt , Tommy S. Alstrøm

Despite extensive research on the relationship between sleep and cognition, the connection between sleep microstructure and human performance across specific cognitive domains remains underexplored. This study investigates whether deep…

Artificial Intelligence · Computer Science 2025-06-03 Boshra Khajehpiri , Eric Granger , Massimiliano de Zambotti , Fiona C. Baker , Mohamad Forouzanfar

The development of transformer-based models has resulted in significant advances in addressing various vision and NLP-based research challenges. However, the progress made in transformer-based methods has not been effectively applied to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Kamran Ali , Charles E. Hughes

Datasets for biosignals, such as electroencephalogram (EEG) and electrocardiogram (ECG), often have noisy labels and have limited number of subjects (<100). To handle these challenges, we propose a self-supervised approach based on…

Machine Learning · Computer Science 2020-07-10 Joseph Y. Cheng , Hanlin Goh , Kaan Dogrusoz , Oncel Tuzel , Erdrin Azemi

This study introduces a novel method that transforms multimodal physiological signalsphotoplethysmography (PPG), galvanic skin response (GSR), and acceleration (ACC) into 2D image matrices to enhance stress detection using convolutional…

Machine Learning · Computer Science 2025-09-18 Yasin Hasanpoor , Bahram Tarvirdizadeh , Khalil Alipour , Mohammad Ghamari

Efficiently identifying sleep stages is crucial for unraveling the intricacies of sleep in both preclinical and clinical research. The labor-intensive nature of manual sleep scoring, demanding substantial expertise, has prompted a surge of…

Machine Learning · Computer Science 2024-12-23 Shadi Sartipi , Mie Andersen , Natalie Hauglund , Celia Kjaerby , Verena Untiet , Maiken Nedergaard , Mujdat Cetin

Sleep stage classification is crucial for detecting patients' health conditions. Existing models, which mainly use Convolutional Neural Networks (CNN) for modelling Euclidean data and Graph Convolution Networks (GNN) for modelling…

Machine Learning · Computer Science 2023-09-06 Yuze Liu , Ziming Zhao , Tiehua Zhang , Kang Wang , Xin Chen , Xiaowei Huang , Jun Yin , Zhishu Shen

In practical sleep stage classification, a key challenge is the variability of EEG data across different subjects and environments. Differences in physiology, age, health status, and recording conditions can lead to domain shifts between…

Signal Processing · Electrical Eng. & Systems 2025-01-08 Siyuan Zhao , Chenyu Liu , Yi Ding , Xinliang Zhou

Multimodal manifold modeling methods extend the spectral geometry-aware data analysis to learning from several related and complementary modalities. Most of these methods work based on two major assumptions: 1) there are the same number of…

Machine Learning · Computer Science 2021-05-13 Maysam Behmanesh , Peyman Adibi , Jocelyn Chanussot , Sayyed Mohammad Saeed Ehsani

Sleep staging is critical for assessing sleep quality and diagnosing sleep disorders. However, capturing both the spatial and temporal relationships within electroencephalogram (EEG) signals during different sleep stages remains…

Signal Processing · Electrical Eng. & Systems 2023-08-09 Xinliang Zhou , Chenyu Liu , Jiaping Xiao , Yang Liu

With the increasing availability of diverse data types, particularly images and time series data from medical experiments, there is a growing demand for techniques designed to combine various modalities of data effectively. Our motivation…

Image and Video Processing · Electrical Eng. & Systems 2024-05-27 Ali Rasekh , Reza Heidari , Amir Hosein Haji Mohammad Rezaie , Parsa Sharifi Sedeh , Zahra Ahmadi , Prasenjit Mitra , Wolfgang Nejdl

Autoregressive modeling has driven major advances in multimodal AI, yet its application to medical imaging remains constrained by the absence of a unified image tokenizer that simultaneously preserves fine-grained anatomical structures and…

Image and Video Processing · Electrical Eng. & Systems 2026-04-02 Chenglong Ma , Yuanfeng Ji , Jin Ye , Zilong Li , Chenhui Wang , Junzhi Ning , Wei Li , Lihao Liu , Qiushan Guo , Tianbin Li , Junjun He , Hongming Shan

Discovering genes with similar functions across diverse biomedical contexts poses a significant challenge in gene representation learning due to data heterogeneity. In this study, we resolve this problem by introducing a novel model called…

Machine Learning · Computer Science 2023-10-05 Tianyu Liu , Yuge Wang , Rex Ying , Hongyu Zhao

Medical multi-modal pre-training has revealed promise in computer-aided diagnosis by leveraging large-scale unlabeled datasets. However, existing methods based on masked autoencoders mainly rely on data-level reconstruction tasks, but lack…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Yupei Zhang , Li Pan , Qiushi Yang , Tan Li , Zhen Chen

Automatic sleep staging typically relies on gold-standard EEG setups, which are accurate but obtrusive and impractical for everyday use outside sleep laboratories. This limits applicability in real-world settings, such as home environments,…

Machine Learning · Computer Science 2025-09-16 Philipp Lepold , Jonas Leichtle , Tobias Röddiger , Michael Beigl

EEG-based visual neural decoding aims to align neural responses with visual stimuli for tasks such as image retrieval. However, limited paired data and a fundamental mismatch between high-fidelity digital images and biological visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Jingtao Liu , Peiliang Gong , Chuhang Zheng , Yiheng Liu , Qi Zhu

Sleep is the primary mean of recovery from accumulated fatigue and thus plays a crucial role in fostering people's mental and physical well-being. Sleep quality monitoring systems are often implemented using wearables that leverage their…

Human-Computer Interaction · Computer Science 2023-08-15 Nouran Abdalazim , Leonardo Alchieri , Lidia Alecci , Silvia Santini

Recent advances in remote health monitoring systems have significantly benefited patients and played a crucial role in improving their quality of life. However, while physiological health-focused solutions have demonstrated increasing…

Machine Learning · Computer Science 2023-03-28 Shayan Fazeli , Lionel Levine , Mehrab Beikzadeh , Baharan Mirzasoleiman , Bita Zadeh , Tara Peris , Majid Sarrafzadeh