English
Related papers

Related papers: Contrastive Cross-Modal Learning for Infusing Ches…

200 papers

Chest X-ray (CXR) is the most common X-ray examination performed in daily clinical practice for the diagnosis of various heart and lung abnormalities. The large amount of data to be read and reported, with 100+ studies per day for a single…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Sebastian Guendel , Florin C. Ghesu , Sasa Grbic , Eli Gibson , Bogdan Georgescu , Andreas Maier , Dorin Comaniciu

Cardiopulmonary exercise testing (CPET) provides a comprehensive assessment of functional capacity by measuring key physiological variables including oxygen consumption ($VO_2$), carbon dioxide production ($VCO_2$), and pulmonary…

Machine Learning · Computer Science 2025-03-19 Muhammet Alkan , Gruschen Veldtman , Fani Deligianni

Self-supervised learning has proven to be an effective way to learn representations in domains where annotated labels are scarce, such as medical imaging. A widely adopted framework for this purpose is contrastive learning and it has been…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Hugo Figueiras , Helena Aidos , Nuno Cruz Garcia

The integration of human emotions into multimedia applications shows great potential for enriching user experiences and enhancing engagement across various digital platforms. Unlike traditional methods such as questionnaires, facial…

Human-Computer Interaction · Computer Science 2024-04-16 Qile Liu , Zhihao Zhou , Jiyuan Wang , Zhen Liang

Predicting next visit diagnosis using Electronic Health Records (EHR) is an essential task in healthcare, critical for devising proactive future plans for both healthcare providers and patients. Nonetheless, many preceding studies have not…

Machine Learning · Computer Science 2024-05-02 Heejoon Koo

Cardiovascular disease has become one of the most significant threats endangering human life and health. Recently, Electrocardiogram (ECG) monitoring has been transformed into remote cardiac monitoring by Holter surveillance. However, the…

Signal Processing · Electrical Eng. & Systems 2022-01-26 Peng Wang , Zihuai Lin , Xucun Yan , Zijiao Chen , Ming Ding , Yang Song , Lu Meng

Decoding neural visual representations from electroencephalogram (EEG)-based brain activity is crucial for advancing brain-machine interfaces (BMI) and has transformative potential for neural sensory rehabilitation. While multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yueyang Li , Zijian Kang , Shengyu Gong , Wenhao Dong , Weiming Zeng , Hongjie Yan , Wai Ting Siok , Nizhuan Wang

Existing Masked Image Modeling (MIM) depends on a spatial patch-based masking-reconstruction strategy to perceive objects'features from unlabeled images, which may face two limitations when applied to chest CT: 1) inefficient feature…

Image and Video Processing · Electrical Eng. & Systems 2024-07-15 Jie Zheng , Ru Wen , Haiqin Hu , Lina Wei , Kui Su , Wei Chen , Chen Liu , Jun Wang

Chest X-ray radiography (CXR) is an essential medical imaging technique for disease diagnosis. However, as 2D projectional images, CXRs are limited by structural superposition and hence fail to capture 3D anatomies. This limitation makes…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Zefan Yang , Ge Wang , James Hendler , Mannudeep K. Kalra , Pingkun Yan

Pulmonary diseases can cause severe respiratory problems, leading to sudden death if not treated timely. Many researchers have utilized deep learning systems to diagnose pulmonary disorders using chest X-rays (CXRs). However, such systems…

Image and Video Processing · Electrical Eng. & Systems 2022-01-17 Mehreen Sirshar , Taimur Hassan , Muhammad Usman Akram , Shoab Ahmed Khan

We propose a deep learning based method for classification of commonly occurring pathologies in chest X-ray images. The vast number of publicly available chest X-ray images provides the data necessary for successfully employing deep…

Image and Video Processing · Electrical Eng. & Systems 2020-06-24 Mohammad S. Majdi , Khalil N. Salman , Michael F. Morris , Nirav C. Merchant , Jeffrey J. Rodriguez

Cardiac magnetic resonance (CMR) is used extensively in the diagnosis and management of cardiovascular disease. Deep learning methods have proven to deliver segmentation results comparable to human experts in CMR imaging, but there have…

Computer Vision and Pattern Recognition · Computer Science 2018-10-25 Gerard Snaauw , Dong Gong , Gabriel Maicas , Anton van den Hengel , Wiro J. Niessen , Johan Verjans , Gustavo Carneiro

Deep learning models have shown high accuracy in classifying electrocardiograms (ECGs), but their black box nature hinders clinical adoption due to a lack of trust and interpretability. To address this, we propose a novel three-stage…

Machine Learning · Computer Science 2025-12-09 Jose Geraldo Fernandes , Luiz Facury de Souza , Pedro Robles Dutenhefner , Gisele L. Pappa , Wagner Meira

Cross-lingual Cross-modal Retrieval (CCR) is an essential task in web search, which aims to break the barriers between modality and language simultaneously and achieves image-text retrieval in the multi-lingual scenario with a single model.…

Information Retrieval · Computer Science 2024-06-27 Zhijie Nie , Richong Zhang , Zhangchi Feng , Hailang Huang , Xudong Liu

As the volume of Electronic Health Records (EHR) sharply grows, there has been emerging interest in learning the representation of EHR for healthcare applications. Representation learning of EHR requires appropriate modeling of the two…

Computation and Language · Computer Science 2022-03-21 Sungjin Park , Seongsu Bae , Jiho Kim , Tackeun Kim , Edward Choi

COVID-19, has led to a global pandemic that strained the healthcare systems. Early and accurate detection is crucial for controlling the spread of the virus. While reverse transcription polymerase chain reaction test is the gold standard…

Image and Video Processing · Electrical Eng. & Systems 2024-10-15 Mohammed Shabo , Nazar Siddig

Electrocardiogram is a useful diagnostic signal that can detect cardiac abnormalities by measuring the electrical activity generated by the heart. Due to its rapid, non-invasive, and richly informative characteristics, ECG has many emerging…

Machine Learning · Computer Science 2025-12-09 Hanhui Deng , Xinglin Li , Jie Luo , Di Wu

Cross-modal retrieval (CMR) has been extensively applied in various domains, such as multimedia search engines and recommendation systems. Most existing CMR methods focus on image-to-text retrieval, whereas audio-to-text retrieval, a less…

Sound · Computer Science 2023-09-19 Kaiyi Luo , Xulong Zhang , Jianzong Wang , Huaxiong Li , Ning Cheng , Jing Xiao

Cardiac magnetic resonance imaging (CMR) has emerged as a valuable diagnostic tool for cardiac diseases. However, a limitation of CMR is its slow imaging speed, which causes patient discomfort and introduces artifacts in the images. There…

Integrating multi-modal clinical data, such as electronic health records (EHR) and chest X-ray images (CXR), is particularly beneficial for clinical prediction tasks. However, in a temporal setting, multi-modal data are often inherently…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Wenfang Yao , Chen Liu , Kejing Yin , William K. Cheung , Jing Qin