English
Related papers

Related papers: CG-DMER: Hybrid Contrastive-Generative Framework f…

200 papers

Recent years have seen a surge of interest in anomaly detection for tackling industrial defect detection, event detection, etc. However, existing unsupervised anomaly detectors, particularly those for the vision modality, face significant…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Dong Chen , Kaihang Pan , Guoming Wang , Yueting Zhuang , Siliang Tang

In the medical field, current ECG signal analysis approaches rely on supervised deep neural networks trained for specific tasks that require substantial amounts of labeled data. However, our paper introduces ECGBERT, a self-supervised…

Signal Processing · Electrical Eng. & Systems 2023-06-13 Seokmin Choi , Sajad Mousavi , Phillip Si , Haben G. Yhdego , Fatemeh Khadem , Fatemeh Afghah

Recent ECG--language pretraining methods enable zero-shot diagnosis by aligning cardiac signals with clinical text, but they do not explicitly model robustness to partial observation and are typically studied under fully observed ECG…

Multimedia · Computer Science 2026-04-03 Hongjun Liu , Rujun Han , Leyu Zhou , Chao Yao

Real-life medical data is often multimodal and incomplete, fueling the growing need for advanced deep learning models capable of integrating them efficiently. The use of diverse modalities, including histopathology slides, MRI, and genetic…

Artificial Intelligence · Computer Science 2024-10-02 Lucas Robinet , Ahmad Berjaoui , Ziad Kheil , Elizabeth Cohen-Jonathan Moyal

It has been a hot research topic to enable machines to understand human emotions in multimodal contexts under dialogue scenarios, which is tasked with multimodal emotion analysis in conversation (MM-ERC). MM-ERC has received consistent…

Computation and Language · Computer Science 2023-08-15 Bobo Li , Hao Fei , Lizi Liao , Yu Zhao , Chong Teng , Tat-Seng Chua , Donghong Ji , Fei Li

Foundation models for electroencephalography (EEG) signals have recently demonstrated success in learning generalized representations of EEGs, outperforming specialized models in various downstream tasks. However, many of these models lack…

Multi-modal MRIs are widely used in neuroimaging applications since different MR sequences provide complementary information about brain structures. Recent works have suggested that multi-modal deep learning analysis can benefit from…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Jiahong Ouyang , Ehsan Adeli , Kilian M. Pohl , Qingyu Zhao , Greg Zaharchuk

Recommender systems are widely used in various real-world applications, but they often encounter the persistent challenge of the user cold-start problem. Cross-domain recommendation (CDR), which leverages user interactions from one domain…

Information Retrieval · Computer Science 2025-02-13 Hourun Li , Yifan Wang , Zhiping Xiao , Jia Yang , Changling Zhou , Ming Zhang , Wei Ju

This paper presents a novel approach towards creating a foundational model for aligning neural data and visual stimuli across multimodal representationsof brain activity by leveraging contrastive learning. We used electroencephalography…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Matteo Ferrante , Tommaso Boccato , Grigorii Rashkov , Nicola Toschi

We present a novel multimodal deep learning framework for cardiac resynchronisation therapy (CRT) response prediction from 2D echocardiography and cardiac magnetic resonance (CMR) data. The proposed method first uses the `nnU-Net'…

Image and Video Processing · Electrical Eng. & Systems 2021-07-23 Esther Puyol-Antón , Baldeep S. Sidhu , Justin Gould , Bradley Porter , Mark K. Elliott , Vishal Mehta , Christopher A. Rinaldi , Andrew P. King

In the field of automatic Electrocardiogram (ECG) diagnosis, due to the relatively limited amount of labeled data, how to build a robust ECG pretrained model based on unlabeled data is a key area of focus for researchers. Recent…

Signal Processing · Electrical Eng. & Systems 2025-06-10 Xiaoyu Sun , Yang Yang , Xunde Dong

This study introduces a novel Supervised Info-enhanced Contrastive Learning framework for EEG based Emotion Recognition (SICLEER). SI-CLEER employs multi-granularity contrastive learning to create robust EEG contextual representations,…

Machine Learning · Computer Science 2024-05-14 Xiang Li , Jian Song , Zhigang Zhao , Chunxiao Wang , Dawei Song , Bin Hu

Background: Conventional electrocardiogram (ECG) analysis faces a persistent dichotomy: expert-driven features ensure interpretability but lack sensitivity to latent patterns, while deep learning offers high accuracy but functions as a…

Quantitative Methods · Quantitative Biology 2026-01-23 Deyun Zhang , Jun Li , Shijia Geng , Yue Wang , Shijie Chen , Sumei Fan , Qinghao Zha , Shenda Hong

An energy-based model (EBM) is a popular generative framework that offers both explicit density and architectural flexibility, but training them is difficult since it is often unstable and time-consuming. In recent years, various training…

Machine Learning · Computer Science 2023-03-07 Hankook Lee , Jongheon Jeong , Sejun Park , Jinwoo Shin

The classification of electrocardiogram (ECG) plays a crucial role in the development of an automatic cardiovascular diagnostic system. However, considerable variances in ECG signals between individuals is a significant challenge. Changes…

Signal Processing · Electrical Eng. & Systems 2023-06-08 Md Niaz Imtiaz , Naimul Khan

Electrocardiogram (ECG) interpretation is essential for cardiovascular disease diagnosis, but current automated systems often struggle with transparency and generalization to unseen conditions. To address this, we introduce ZETA, a…

Machine Learning · Computer Science 2025-10-27 Jialu Tang , Hung Manh Pham , Ignace De Lathauwer , Henk S. Schipper , Yuan Lu , Dong Ma , Aaqib Saeed

Accelerated Cardiovascular Magnetic Resonance (CMR) image reconstruction remains a critical challenge due to the trade-off between scan time and image quality, particularly when generalizing across diverse acquisition settings. We propose…

Image and Video Processing · Electrical Eng. & Systems 2025-10-30 Kian Anvari Hamedani , Narges Razizadeh , Shahabedin Nabavi , Mohsen Ebrahimi Moghaddam

Recently, generative graph models have shown promising results in learning graph representations through self-supervised methods. However, most existing generative graph representation learning (GRL) approaches rely on random masking across…

Machine Learning · Computer Science 2026-05-08 Xinyue Hu , Zhibin Duan , Xinyang Liu , Yuxin Li , Bo Chen , Chaojie Wang , Yilin He , Hongwei Liu , Mingyuan Zhou

In the domain of moment retrieval, accurately identifying temporal segments within videos based on natural language queries remains challenging. Traditional methods often employ pre-trained models that struggle with fine-grained information…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Haojian Huang , Kaijing Ma , Jin Chen , Haodong Chen , Zhou Wu , Xianghao Zang , Han Fang , Chao Ban , Hao Sun , Mulin Chen , Zhongjiang He

Objectives: With the technological advancements in the field of tele-health monitoring, it is now possible to gather huge amounts of electro-physiological signals such as electrocardiogram (ECG). It is therefore necessary to develop…

Machine Learning · Computer Science 2020-05-19 Abdolrahman Peimankar , Sadasivan Puthusserypady