English
Related papers

Related papers: Fine-grained Contrastive Learning for ECG-Report A…

200 papers

Despite that deep learning (DL) methods have presented tremendous potential in many medical image analysis tasks, the practical applications of medical DL models are limited due to the lack of enough data samples with manual annotations. By…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Zhiyang Liu , Dong Yang , Minghao Zhang , Hanyu Sun , Hong Wu , Huiying Wang , Wen Shen , Chao Chai , Shuang Xia

Clinical 12-lead electrocardiography (ECG) is one of the most widely encountered kinds of biosignals. Despite the increased availability of public ECG datasets, label scarcity remains a central challenge in the field. Self-supervised…

Signal Processing · Electrical Eng. & Systems 2022-01-05 Temesgen Mehari , Nils Strodthoff

Deep learning-based electrocardiogram (ECG) classification has shown impressive performance but clinical adoption has been slowed by the lack of transparent and faithful explanations. Post hoc methods such as saliency maps may fail to…

Transesophageal echocardiography (TEE) plays a pivotal role in cardiology for diagnostic and interventional procedures. However, using it effectively requires extensive training due to the intricate nature of image acquisition and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Abdoul Aziz Amadou , Vivek Singh , Florin C. Ghesu , Young-Ho Kim , Laura Stanciulescu , Harshitha P. Sai , Puneet Sharma , Alistair Young , Ronak Rajani , Kawal Rhode

Contrastive vision-language models continue to be the dominant approach for image and text retrieval. Contrastive Language-Image Pre-training (CLIP) trains two neural networks in contrastive manner to align their image and text embeddings…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Kwun Ho Ngan , Saman Sadeghi Afgeh , Joe Townsend , Artur d'Avila Garcez

Graph Contrastive Learning (GCL) is a potent paradigm for self-supervised graph learning that has attracted attention across various application scenarios. However, GCL for learning on Text-Attributed Graphs (TAGs) has yet to be explored.…

Social and Information Networks · Computer Science 2024-09-04 Haoran Yang , Xiangyu Zhao , Sirui Huang , Qing Li , Guandong Xu

The differences in distributional patterns between benchmark data and real-world data have been one of the main challenges of using electroencephalogram (EEG) signals for eye-tracking (ET) classification. Therefore, increasing the…

Signal Processing · Electrical Eng. & Systems 2022-09-09 Brian Xiang , Abdelrahman Abdelmonsef

Contrastive Learning (CL) has emerged as a dominant technique for unsupervised representation learning which embeds augmented versions of the anchor close to each other (positive samples) and pushes the embeddings of other samples…

Artificial Intelligence · Computer Science 2022-06-15 Jun Xia , Lirong Wu , Ge Wang , Jintao Chen , Stan Z. Li

With the advancement of science and technology, the importance of emotion research has become increasingly evident. Electroencephalography (EEG)-based emotion recognition has emerged as an active research area in recent years, owing to its…

Human-Computer Interaction · Computer Science 2026-05-22 Ying Xie , Yi Zheng , Zehui Xiao , Wenkai Lu , Mengting Liu

Electrocardiogram (ECG) abnormalities are linked to cardiovascular diseases, but may also occur in other non-cardiovascular conditions such as mental, neurological, metabolic and infectious conditions. However, most of the recent success of…

Signal Processing · Electrical Eng. & Systems 2022-10-13 Weijie Sun , Sunil Vasu Kalmady , Amir Salimi , Nariman Sepehrvand , Eric Ly , Abram Hindle , Russell Greiner , Padma Kaul

Background:The electrocardiogram (ECG) is one of the most commonly used diagnostic tools in medicine and healthcare. Deep learning methods have achieved promising results on predictive healthcare tasks using ECG signals. Objective:This…

Signal Processing · Electrical Eng. & Systems 2020-05-04 Shenda Hong , Yuxi Zhou , Junyuan Shang , Cao Xiao , Jimeng Sun

Conventional machine learning models, particularly tree-based approaches, have demonstrated promising performance across various clinical prediction tasks using electronic health record (EHR) data. Despite their strengths, these models…

Computation and Language · Computer Science 2025-05-26 Sara Ketabi , Dhanesh Ramachandram

Large Multimodal Models (LMMs) typically build on ViTs (e.g., CLIP), yet their training with simple random in-batch negatives limits the ability to capture fine-grained visual differences, particularly in geometric scenarios. To address…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Kai Sun , Yushi Bai , Zhen Yang , Jiajie Zhang , Ji Qi , Lei Hou , Juanzi Li

An electrocardiogram (ECG) captures the heart's electrical signal to assess various heart conditions. In practice, ECG data is stored as either digitized signals or printed images. Despite the emergence of numerous deep learning models for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Ju-Hyeon Nam , Seo-Hyung Park , Su Jung Kim , Sang-Chul Lee

3D medical vision-language (VL) pretraining has shown potential in radiology by leveraging large-scale multimodal datasets with CT-report pairs. However, existing methods primarily rely on a global VL alignment directly adapted from 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Jingyang Lin , Yingda Xia , Jianpeng Zhang , Ke Yan , Kai Cao , Le Lu , Jiebo Luo , Ling Zhang

Graph Contrastive Learning (GCL) excels at managing noise and fluctuations in input data, making it popular in various fields (e.g., social networks, and knowledge graphs). Our study finds that the difference in high-frequency information…

Machine Learning · Computer Science 2024-10-15 Yuntao Shou , Xiangyong Cao , Deyu Meng

Representation learning on text-attributed graphs (TAGs), where nodes are represented by textual descriptions, is crucial for textual and relational knowledge systems and recommendation systems. Currently, state-of-the-art embedding methods…

Computation and Language · Computer Science 2024-12-24 Yi Fang , Dongzhe Fan , Sirui Ding , Ninghao Liu , Qiaoyu Tan

Text-guided medical segmentation enhances segmentation accuracy by utilizing clinical reports as auxiliary information. However, existing methods typically rely on unaligned image and text encoders, which necessitate complex interaction…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Gaoren Lin , Huangxuan Zhao , Yuan Xiong , Lefei Zhang , Bo Du , Wentao Zhu

The integration of human emotions into multimedia applications shows great potential for enriching user experiences and enhancing engagement across various digital platforms. Unlike traditional methods such as questionnaires, facial…

Human-Computer Interaction · Computer Science 2024-04-16 Qile Liu , Zhihao Zhou , Jiyuan Wang , Zhen Liang

We propose the use of parameter-efficient fine-tuning (PEFT) of foundation models for cleft lip and palate (CLP) detection and severity classification. In CLP, nasalization increases with severity due to the abnormal passage between the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-22 Susmita Bhattacharjee , Jagabandhu Mishra , H. S. Shekhawat , S. R. Mahadeva Prasanna