English
Related papers

Related papers: Knowledge-enhanced Multimodal ECG Representation L…

200 papers

Deep learning models perform best with abundant, high-quality labels, yet such conditions are rarely achievable in EEG-based emotion recognition. Electroencephalogram (EEG) signals are easily corrupted by artifacts and individual…

Machine Learning · Computer Science 2025-11-20 Hyo-Jeong Jang , Hye-Bin Shin , Kang Yin

Existing semi-supervised medical segmentation co-learning frameworks have realized that model performance can be diminished by the biases in model recognition caused by low-quality pseudo-labels. Due to the averaging nature of their…

Image and Video Processing · Electrical Eng. & Systems 2025-05-20 Yuanpeng He , Yali Bi , Lijian Li , Chi-Man Pun , Wenpin Jiao , Zhi Jin

Learning a common latent embedding by aligning the latent spaces of cross-modal autoencoders is an effective strategy for Generalized Zero-Shot Classification (GZSC). However, due to the lack of fine-grained instance-wise annotations, it…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Zhiyu Fang , Xiaobin Zhu , Chun Yang , Zheng Han , Jingyan Qin , Xu-Cheng Yin

Multimodal emotion recognition (MER) seeks to integrate various modalities to predict emotional states accurately. However, most current research focuses solely on the fusion of audio and text features, overlooking the valuable information…

Sound · Computer Science 2025-04-08 Xuechun Shao , Yinfeng Yu , Liejun Wang

Training large foundation models using self-supervised objectives on unlabeled data, followed by fine-tuning on downstream tasks, has emerged as a standard procedure. Unfortunately, the efficacy of this approach is often constrained by both…

Multimodal learning has been a popular area of research, yet integrating electroencephalogram (EEG) data poses unique challenges due to its inherent variability and limited availability. In this paper, we introduce a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Kang Yin , Hye-Bin Shin , Dan Li , Seong-Whan Lee

Biomedical Knowledge Graphs (BKGs) integrate diverse datasets to elucidate complex relationships within the biomedical field. Effective link prediction on these graphs can uncover valuable connections, such as potential novel drug-disease…

Computation and Language · Computer Science 2025-07-01 Tien Dang , Viet Thanh Duy Nguyen , Minh Tuan Le , Truong-Son Hy

While Multimodal Large Language Models (MLLMs) show promising performance in automated electrocardiogram interpretation, it remains unclear whether they genuinely perform actual step-by-step reasoning or just rely on superficial visual…

Machine Learning · Computer Science 2026-03-17 Jungwoo Oh , Hyunseung Chung , Junhee Lee , Min-Gyu Kim , Hangyul Yoon , Ki Seong Lee , Youngchae Lee , Muhan Yeo , Edward Choi

Electrocardiogram (ECG) monitoring is one of the most powerful technique of cardiovascular disease (CVD) early identification, and the introduction of intelligent wearable ECG devices has enabled daily monitoring. However, due to the need…

Signal Processing · Electrical Eng. & Systems 2024-03-08 Hongxiang Gao , Xingyao Wang , Zhenghua Chen , Min Wu , Jianqing Li , Chengyu Liu

Electrocardiograms (ECG) are widely employed as a diagnostic tool for monitoring electrical signals originating from a heart. Recent machine learning research efforts have focused on the application of screening various diseases using ECG…

Signal Processing · Electrical Eng. & Systems 2024-03-20 Yeongyeon Na , Minje Park , Yunwon Tae , Sunghoon Joo

Zero-shot learning (ZL) is crucial for tasks involving unseen categories, such as natural language processing, image classification, and cross-lingual transfer.Current applications often fail to accurately infer and handle new relations…

Artificial Intelligence · Computer Science 2025-04-08 Bingchen Liu , Jingchen Li , Yuanyuan Fang , Xin Li

Cross-lingual cross-modal retrieval (CCR) aims to retrieve visually relevant content based on non-English queries, without relying on human-labeled cross-modal data pairs during training. One popular approach involves utilizing machine…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Yabing Wang , Le Wang , Qiang Zhou , Zhibin Wang , Hao Li , Gang Hua , Wei Tang

Recent advances in deep learning and natural language generation have significantly improved image captioning, enabling automated, human-like descriptions for visual content. In this work, we apply these captioning techniques to generate…

Computation and Language · Computer Science 2024-12-06 Amnon Bleich , Antje Linnemann , Bjoern H. Diem , Tim OF Conrad

Knowledge-enhanced pre-trained language models (KEPLMs) leverage relation triples from knowledge graphs (KGs) and integrate these external data sources into language models via self-supervised learning. Previous works treat knowledge…

Computation and Language · Computer Science 2024-06-25 Dongyang Li , Taolin Zhang , Longtao Huang , Chengyu Wang , Xiaofeng He , Hui Xue

Multi-label Recognition (MLR) involves assigning multiple labels to each data instance in an image, offering advantages over single-label classification in complex scenarios. However, it faces the challenge of annotating all relevant…

Machine Learning · Computer Science 2025-06-03 Ruhui Zhang , Hezhe Qiao , Pengcheng Xu , Mingsheng Shang , Lin Chen

Electrocardiogram (ECG) is a widely used reliable, non-invasive approach for cardiovascular disease diagnosis. With the rapid growth of ECG examinations and the insufficiency of cardiologists, accurate and automatic diagnosis of ECG signals…

Machine Learning · Computer Science 2020-10-21 Dongdong Zhang , Xiaohui Yuan , Ping Zhang

Cardiovascular diseases are a leading cause of death and disability worldwide. Electrocardiogram (ECG) is critical for diagnosing and monitoring cardiac health, but obtaining large-scale annotated ECG datasets is labor-intensive and…

Signal Processing · Electrical Eng. & Systems 2025-09-22 Mingsheng Cai , Jiuming Jiang , Wenhao Huang , Che Liu , Rossella Arcucci

Self-supervised learning is crucial for clinical imaging applications, given the lack of explicit labels in healthcare. However, conventional approaches that rely on precise vision-language alignment are not always feasible in complex…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Jielin Qiu , Peide Huang , Makiya Nakashima , Jaehyun Lee , Jiacheng Zhu , Wilson Tang , Pohao Chen , Christopher Nguyen , Byung-Hak Kim , Debbie Kwon , Douglas Weber , Ding Zhao , David Chen

Vision-Language Models (VLMs), such as CLIP, have demonstrated remarkable zero-shot capabilities in various computer vision tasks. However, their application to medical imaging remains challenging due to the high variability and complexity…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Xusheng Liang , Lihua Zhou , Nianxin Li , Miao Xu , Ziyang Song , Dong Yi , Jinlin Wu , Jiawei Ma , Hongbin Liu , Zhen Lei , Jiebo Luo

Electrocardiogram (ECG) interpretation is essential for cardiovascular disease diagnosis, but current automated systems often struggle with transparency and generalization to unseen conditions. To address this, we introduce ZETA, a…

Machine Learning · Computer Science 2025-10-27 Jialu Tang , Hung Manh Pham , Ignace De Lathauwer , Henk S. Schipper , Yuan Lu , Dong Ma , Aaqib Saeed