English
Related papers

Related papers: Constraint-Based Model in Multimodal Learning to I…

200 papers

Left ventricular ejection fraction (LVEF) is the most important clinical parameter of cardiovascular function. The accuracy in estimating this parameter is highly dependent upon the precise segmentation of the left ventricle (LV) structure…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Narjes Benameur , Ramzi Mahmoudi , Mohamed Deriche , Amira fayouka , Imene Masmoudi , Nessrine Zoghlami

Many strides have been made in semantic segmentation of multiple classes within an image. This has been largely due to advancements in deep learning and convolutional neural networks (CNNs). Features within a CNN are automatically learned…

Image and Video Processing · Electrical Eng. & Systems 2019-09-17 Erik Gaasedelen , Alex Deakyne , Paul Iaizzo

This study proposed a hybrid model of a convolutional neural network (CNN) and a Transformer to predict and diagnose heart disease. Based on CNN's strength in detecting local features and the Transformer's high capacity in sensing global…

Machine Learning · Computer Science 2025-03-05 Ran Hao , Yanlin Xiang , Junliang Du , Qingyuan He , Jiacheng Hu , Ting Xu

Many types of ventricular and atrial cardiac arrhythmias have been discovered in clinical practice in the past 100 years, and these arrhythmias are a major contributor to sudden cardiac death. Ventricular tachycardia, ventricular…

Machine Learning · Computer Science 2022-06-13 Ashkan Parsi

Multimodal analysis has recently drawn much interest in affective computing, since it can improve the overall accuracy of emotion recognition over isolated uni-modal approaches. The most effective techniques for multimodal emotion…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 R. Gnana Praveen , Eric Granger , Patrick Cardinal

Recent advancements in non-invasive detection of cardiac hemodynamic instability (CHDI) primarily focus on applying machine learning techniques to a single data modality, e.g. cardiac magnetic resonance imaging (MRI). Despite their…

Predicting stroke risk is a complex challenge that can be enhanced by integrating diverse clinically available data modalities. This study introduces a self-supervised multimodal framework that combines 3D brain imaging, clinical data, and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Camille Delgrange , Olga Demler , Samia Mora , Bjoern Menze , Ezequiel de la Rosa , Neda Davoudi

Electrocardiography (ECG) signal is a highly applied measurement for individual heart condition, and much effort have been endeavored towards automatic heart arrhythmia diagnosis based on machine learning. However, traditional machine…

Signal Processing · Electrical Eng. & Systems 2021-11-01 Ziyu Liu , Xiang Zhang

Leveraging multimodal information from Magnetic Resonance Imaging (MRI) plays a vital role in lesion segmentation, especially for brain tumors. However, in clinical practice, multimodal MRI data are often incomplete, making it challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Yulong Zou , Bo Liu , Cun-Jing Zheng , Yuan-ming Geng , Siyue Li , Qiankun Zuo , Shuihua Wang , Yudong Zhang , Jin Hong

This paper introduces an innovative multi-modal fusion deep learning approach to overcome the drawbacks of traditional single-modal recognition techniques. These drawbacks include incomplete information and limited diagnostic accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Xiaoyi Liu , Hongjie Qiu , Muqing Li , Zhou Yu , Yutian Yang , Yafeng Yan

In recent years, the task of weakly supervised audio-visual violence detection has gained considerable attention. The goal of this task is to identify violent segments within multimodal data based on video-level labels. Despite advances in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Xiaogang Peng , Hao Wen , Yikai Luo , Xiao Zhou , Keyang Yu , Ping Yang , Zizhao Wu

Cardiac Magnetic Resonance Imaging (MRI) plays an important role in the analysis of cardiac function. However, the acquisition is often accompanied by motion artefacts because of the difficulty of breath-hold, especially for acute symptoms…

Image and Video Processing · Electrical Eng. & Systems 2022-10-17 Ruizhe Li , Xin Chen

Multimodal emotion recognition has recently gained much attention since it can leverage diverse and complementary relationships over multiple modalities (e.g., audio, visual, biosignals, etc.), and can provide some robustness to noisy…

Accurate segmentation of the heart is an important step towards evaluating cardiac function. In this paper, we present a fully automated framework for segmentation of the left (LV) and right (RV) ventricular cavities and the myocardium…

Computer Vision and Pattern Recognition · Computer Science 2017-10-11 Christian F. Baumgartner , Lisa M. Koch , Marc Pollefeys , Ender Konukoglu

Stroke is a common disabling neurological condition that affects about one-quarter of the adult population over age 25; more than half of patients still have poor outcomes, such as permanent functional dependence or even death, after the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Chia-Ling Tsai , Hui-Yun Su , Shen-Feng Sung , Wei-Yang Lin , Ying-Ying Su , Tzu-Hsien Yang , Man-Lin Mai

The segmentation and classification of cardiac magnetic resonance imaging are critical for diagnosing heart conditions, yet current approaches face challenges in accuracy and generalizability. In this study, we aim to further advance the…

Image and Video Processing · Electrical Eng. & Systems 2024-12-13 Vitalii Slobodzian , Pavlo Radiuk , Oleksander Barmak , Iurii Krak

Vision Transformer (ViT) models, utilizing self-attention mechanisms, have demonstrated robust generalization capabilities across various vision tasks, including image classification. However, these models, typically pretrained on general…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Yuli Wang , Hyewon Jung , Dongshen Peng , Yuwei Dai , Jing Wu , Haoyue Guan , Yoko Kato , Zhicheng Jiao , Yu Sun , Ihab Kamel , Joao Lima , Cheng Ting Lin , Harrison Bai

Myocardial Infarction (MI) has the highest mortality of all cardiovascular diseases (CVDs). Detection of MI and information regarding its occurrence-time in particular, would enable timely interventions that may improve patient outcomes,…

Signal Processing · Electrical Eng. & Systems 2021-04-06 Girmaw Abebe Tadesse , Hamza Javed , Yong Liu , Jin Liu , Jiyan Chen , Komminist Weldemariam , Tingting Zhu

Cardiovascular disease (CVD) remains the leading cause of mortality worldwide, underscoring the need for reliable and efficient predictive tools that support early intervention. Traditional diagnostic approaches rely on handcrafted features…

Machine Learning · Computer Science 2025-12-17 Tejaswani Dash , Gautam Datla , Anudeep Vurity , Tazeem Ahmad , Mohd Adnan , Saima Rafi , Saisha Patro , Saina Patro

Cardiac left ventricular (LV) segmentation from short-axis MRI acquired 10 minutes after the injection of a contrast agent (LGE-MRI) is a necessary step in the processing allowing the identification and diagnosis of cardiac diseases such as…

Image and Video Processing · Electrical Eng. & Systems 2020-06-02 Abdul Qayyum , Alain Lalande , Thomas Decourselle , Thibaut Pommier , Alexandre Cochet , Fabrice Meriaudeau