English
Related papers

Related papers: Information-theoretic Multimodal Representation Le…

200 papers

Deep learning has achieved expert-level performance in automated electrocardiogram (ECG) diagnosis, yet the "black-box" nature of these models hinders their clinical deployment. Trust in medical AI requires not just high accuracy but also…

Machine Learning · Computer Science 2026-02-11 Vajira Thambawita , Jonas L. Isaksen , Jørgen K. Kanters , Hugo L. Hammer , Pål Halvorsen

The rapidly increasing volume of electronic health record (EHR) data underscores a pressing need to unlock biomedical knowledge from unstructured clinical texts to support advancements in data-driven clinical systems, including patient…

Computation and Language · Computer Science 2025-10-21 Manuela Daniela Danu , George Marica , Constantin Suciu , Lucian Mihai Itu , Oladimeji Farri

Chest X-ray (CXR) radiology report generation (RRG) models have shown rapid progress on automated metrics, yet their clinical utility remains uncertain due to limited qualitative evaluation by radiologists. We present CXRMate-2, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Aaron Nicolson , Elizabeth J. Cooper , Hwan-Jin Yoon , Claire McCafferty , Ramya Krishnan , Michelle Craigie , Nivene Saad , Jason Dowling , Ian A. Scott , Bevan Koopman

With the widespread application of electroencephalography (EEG) in neuroscience and clinical practice, efficiently retrieving and semantically interpreting large-scale, multi-source, heterogeneous EEG data has become a pressing challenge.…

Computation and Language · Computer Science 2025-10-14 Yi Wang , Haoran Luo , Lu Meng , Ziyu Jia , Xinliang Zhou , Qingsong Wen

Electroencephalography (EEG) interpretation using multimodal large language models (MLLMs) offers a novel approach for analyzing brain signals. However, the complex nature of brain activity introduces critical challenges: EEG signals…

Signal Processing · Electrical Eng. & Systems 2025-10-02 Ziyi Zeng , Zhenyang Cai , Yixi Cai , Xidong Wang , Junying Chen , Rongsheng Wang , Yipeng Liu , Siqi Cai , Benyou Wang , Zhiguo Zhang , Haizhou Li

Ensuring timely and accurate diagnosis of medical conditions is paramount for effective patient care. Electrocardiogram (ECG) signals are fundamental for evaluating a patient's cardiac health and are readily available. Despite this, little…

Signal Processing · Electrical Eng. & Systems 2025-11-21 Juan Miguel Lopez Alcaraz , Nils Strodthoff

Knowledge graph (KG) embedding has been used to benefit the diagnosis of animal diseases by analyzing electronic medical records (EMRs), such as notes and veterinary records. However, learning representations to capture entities and…

Artificial Intelligence · Computer Science 2023-09-08 Van Thuy Hoang , Sang Thanh Nguyen , Sangmyeong Lee , Jooho Lee , Luong Vuong Nguyen , O-Joun Lee

Machine learning (ML) and deep learning (DL) techniques have been widely applied to analyze electroencephalography (EEG) signals for disease diagnosis and brain-computer interfaces (BCI). The integration of multimodal data has been shown to…

Signal Processing · Electrical Eng. & Systems 2025-01-16 Siqi Zhao , Wangyang Li , Xiru Wang , Stevie Foglia , Hongzhao Tan , Bohan Zhang , Ameer Hamoodi , Aimee Nelson , Zhen Gao

Objective: A novel structure based on channel-wise attention mechanism is presented in this paper. Embedding with the proposed structure, an efficient classification model that accepts multi-lead electrocardiogram (ECG) as input is…

Signal Processing · Electrical Eng. & Systems 2020-03-27 Hao Tung , Chao Zheng , Xinsheng Mao , Dahong Qian

Electroencephalography (EEG) is a neuroimaging technique that records brain neural activity with high temporal resolution. Unlike other methods, EEG does not require prohibitively expensive equipment and can be easily set up using…

Human-Computer Interaction · Computer Science 2024-10-01 Arash Akbarinia

Early detection of cardiovascular diseases is crucial for effective treatment and an electrocardiogram (ECG) is pivotal for diagnosis. The accuracy of Deep Learning based methods for ECG signal classification has progressed in recent years…

Signal Processing · Electrical Eng. & Systems 2022-04-12 Likith Reddy , Vivek Talwar , Shanmukh Alle , Raju. S. Bapi , U. Deva Priyakumar

In the evolving landscape of ECG signal analysis, the challenge of limited transparency in machine learning models remains a significant barrier to their effective integration into clinical practice. This study addresses this issue by…

Signal Processing · Electrical Eng. & Systems 2024-12-09 Toygar Tanyel , Sezgin Atmaca , Kaan Gökçe , M. Yiğit Balık , Arda Güler , Emre Aslanger , İlkay Öksüz

Electrocardiogram (ECG) arrhythmia classification remains challenging due to signal variability, noise, limited labeled data, and the difficulty in achieving both accuracy and efficiency in models. While self-supervised learning reduces…

Machine Learning · Computer Science 2026-05-14 Mahsa Gazeran , Sayvan Soleymanbaigi , Fatemeh Daneshfar , Amjad Seyedi , Fardin Akhlaghian Tab

As two important textual modalities in electronic health records (EHR), both structured data (clinical codes) and unstructured data (clinical narratives) have recently been increasingly applied to the healthcare domain. Most existing…

Computation and Language · Computer Science 2022-11-01 Sicen Liu , Xiaolong Wang , Yongshuai Hou , Ge Li , Hui Wang , Hui Xu , Yang Xiang , Buzhou Tang

Medical text learning has recently emerged as a promising area to improve healthcare due to the wide adoption of electronic health record (EHR) systems. The complexity of the medical text such as diverse length, mixed text types, and full…

Computation and Language · Computer Science 2022-10-11 Yong He , Cheng Wang , Shun Zhang , Nan Li , Zhaorong Li , Zhenyu Zeng

Radiology reports contain a diverse and rich set of clinical abnormalities documented by radiologists during their interpretation of the images. Comprehensive semantic representations of radiological findings would enable a wide range of…

Computation and Language · Computer Science 2021-12-28 Wilson Lau , Kevin Lybarger , Martin L. Gunn , Meliha Yetisgen

Conventional machine learning models, particularly tree-based approaches, have demonstrated promising performance across various clinical prediction tasks using electronic health record (EHR) data. Despite their strengths, these models…

Computation and Language · Computer Science 2025-05-26 Sara Ketabi , Dhanesh Ramachandram

Recently a number of studies demonstrated impressive performance on diverse vision-language multi-modal tasks such as image captioning and visual question answering by extending the BERT architecture with multi-modal pre-training…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Jong Hak Moon , Hyungyung Lee , Woncheol Shin , Young-Hak Kim , Edward Choi

Multimodal learning has shown promise in medical imaging, combining complementary modalities like images and text. Vision-language models (VLMs) capture rich diagnostic cues but often require large paired datasets and prompt- or text-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Banafsheh Karimian , Giulia Avanzato , Soufian Belharbi , Alexis Guichemerre , Luke McCaffrey , Mohammadhadi Shateri , Eric Granger

Although deep learning has advanced automated electrocardiogram (ECG) diagnosis, prevalent supervised methods typically treat recordings as undifferentiated one-dimensional (1D) signals or two-dimensional (2D) images. This formulation…

Machine Learning · Computer Science 2026-01-13 Runze Ma , Caizhi Liao