English
Related papers

Related papers: Contrastive Cross-Modal Learning for Infusing Ches…

200 papers

Electrocardiogram (ECG) analysis is foundational for cardiovascular disease diagnosis, yet the performance of deep learning models is often constrained by limited access to annotated data. Self-supervised contrastive learning has emerged as…

Machine Learning · Computer Science 2025-08-22 Yi Yuan , Joseph Van Duyn , Runze Yan , Zhuoyi Huang , Sulaiman Vesal , Sergey Plis , Xiao Hu , Gloria Hyunjung Kwak , Ran Xiao , Alex Fedorov

Chronic obstructive pulmonary disease (COPD) is one of the most common chronic illnesses in the world and the third leading cause of mortality worldwide. It is often underdiagnosed or not diagnosed until later in the disease course.…

Cardiovascular diseases (CVDs) are the leading cause of global mortality, necessitating accessible and accurate diagnostic tools. While cardiac magnetic resonance imaging (CMR) provides gold-standard insights into cardiac structure and…

Accurate prediction of cardiovascular diseases remains imperative for early diagnosis and intervention, necessitating robust and precise predictive models. Recently, there has been a growing interest in multi-modal learning for uncovering…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Francesco Girlanda , Olga Demler , Bjoern Menze , Neda Davoudi

Cardiomyopathy, a principal contributor to heart failure and sudden cardiac mortality, demands precise early screening. Cardiac Magnetic Resonance (CMR), recognized as the diagnostic 'gold standard' through multiparametric protocols, holds…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Siqing Yuan , Yulin Wang , Zirui Cao , Yueyan Wang , Zehao Weng , Hui Wang , Lei Xu , Zixian Chen , Lei Chen , Zhong Xue , Dinggang Shen

Medical image interpretation using deep learning has shown promise but often requires extensive expert-annotated datasets. To reduce this annotation burden, we develop an Image-Graph Contrastive Learning framework that pairs chest X-rays…

Image and Video Processing · Electrical Eng. & Systems 2024-05-17 Sameer Khanna , Daniel Michael , Marinka Zitnik , Pranav Rajpurkar

Emotion recognition using electroencephalography (EEG) signals has attracted increasing attention in recent years. However, existing methods often lack generalization in cross-corpus settings, where a model trained on one dataset is…

Human-Computer Interaction · Computer Science 2025-08-01 Qile Liu , Weishan Ye , Lingli Zhang , Zhen Liang

Building a highly accurate predictive model for classification and localization of abnormalities in chest X-rays usually requires a large number of manually annotated labels and pixel regions (bounding boxes) of abnormalities. However, it…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Yan Han , Chongyan Chen , Ahmed Tewfik , Benjamin Glicksberg , Ying Ding , Yifan Peng , Zhangyang Wang

Objective: Biomedical Knowledge Graphs play a pivotal role in various biomedical research domains. Concurrently, term clustering emerges as a crucial step in constructing these knowledge graphs, aiming to identify synonymous terms. Due to a…

Computation and Language · Computer Science 2023-12-14 Huaiyuan Ying , Zhengyun Zhao , Yang Zhao , Sihang Zeng , Sheng Yu

The accurate interpretation of Electrocardiogram (ECG) signals is pivotal for diagnosing cardiovascular diseases. Integrating ECG signals with accompanying textual reports further holds immense potential to enhance clinical diagnostics by…

Machine Learning · Computer Science 2025-05-08 Hung Manh Pham , Aaqib Saeed , Dong Ma

Emotion recognition is an important component of affective computing, and also human-machine interaction. Unimodal emotion recognition is convenient, but the accuracy may not be high enough; on the contrary, multi-modal emotion recognition…

Human-Computer Interaction · Computer Science 2026-02-12 Siyuan Kan , Huanyu Wu , Zhenyao Cui , Fan Huang , Xiaolong Xu , Dongrui Wu

The electrocardiogram (ECG) is a fundamental tool in cardiovascular diagnostics due to its powerful and non-invasive nature. One of the most critical usages is to determine whether more detailed examinations are necessary, with users…

Artificial Intelligence · Computer Science 2025-04-15 Junichiro Takahashi , JingChuan Guan , Masataka Sato , Kaito Baba , Kazuto Haruguchi , Daichi Nagashima , Satoshi Kodera , Norihiko Takeda

Recently, multi-modal vision-language foundation models have gained significant attention in the medical field. While these models offer great opportunities, they still face crucial challenges, such as the requirement for fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Weijian Huang , Cheng Li , Hong-Yu Zhou , Hao Yang , Jiarun Liu , Yong Liang , Hairong Zheng , Shaoting Zhang , Shanshan Wang

Electrocardiography (ECG) is a low-cost, widely used modality for diagnosing electrical abnormalities like atrial fibrillation by capturing the heart's electrical activity. However, it cannot directly measure cardiac morphological…

Machine Learning · Computer Science 2026-03-10 Michelle Espranita Liman , Özgün Turgut , Alexander Müller , Eimo Martens , Daniel Rueckert , Philip Müller

Chest X-rays or chest radiography (CXR), commonly used for medical diagnostics, typically enables limited imaging compared to computed tomography (CT) scans, which offer more detailed and accurate three-dimensional data, particularly…

Image and Video Processing · Electrical Eng. & Systems 2025-07-25 Noa Cahan , Eyal Klang , Galit Aviram , Yiftach Barash , Eli Konen , Raja Giryes , Hayit Greenspan

Despite the advancement of deep learning-based computer-aided diagnosis (CAD) methods for pneumonia from adult chest x-ray (CXR) images, the performance of CAD methods applied to pediatric images remains suboptimal, mainly due to the lack…

Image and Video Processing · Electrical Eng. & Systems 2024-04-22 Mohammad Zunaed , Anwarul Hasan , Taufiq Hasan

Cardiac Magnetic Resonance (CMR) imaging provides a comprehensive assessment of cardiac structure and function but remains constrained by high acquisition costs and reliance on expert annotations, limiting the availability of large-scale…

Image and Video Processing · Electrical Eng. & Systems 2026-02-11 Xiaocheng Fang , Zhengyao Ding , Guangkun Nie , Jieyi Cai , Yujie Xiao , Bo Liu , Jiarui Jin , Haoyu Wang , Shun Huang , Ting Chen , Hongyan Li , Shenda Hong

Chest X-rays are widely used to diagnose thoracic diseases, but the lack of detailed information about these abnormalities makes it challenging to develop accurate automated diagnosis systems, which is crucial for early detection and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 S. M. Nabil Ashraf , Md. Adyelullahil Mamun , Hasnat Md. Abdullah , Md. Golam Rabiul Alam

We propose a two-stage multimodal framework that enhances disease classification and region-aware radiology report generation from chest X-rays, leveraging the MIMIC-Eye dataset. In the first stage, we introduce a gaze-guided contrastive…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Tanjim Islam Riju , Shuchismita Anwar , Saman Sarker Joy , Farig Sadeque , Swakkhar Shatabda

Electrocardiogram (ECG) is a widely used diagnostic tool for detecting heart conditions. Rare cardiac diseases may be underdiagnosed using traditional ECG analysis, considering that no training dataset can exhaust all possible cardiac…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Aofan Jiang , Chaoqin Huang , Qing Cao , Shuang Wu , Zi Zeng , Kang Chen , Ya Zhang , Yanfeng Wang