English
Related papers

Related papers: Constraint-Based Model in Multimodal Learning to I…

200 papers

Hyper-trabeculation or non-compaction in the left ventricle of the myocardium (LVNC) is a recently classified form of cardiomyopathy. Several methods have been proposed to quantify the trabeculae accurately in the left ventricle, but there…

Image and Video Processing · Electrical Eng. & Systems 2024-02-13 Gregorio Bernabé , Pilar González-Férez , José M. García , Guillem Casas , Josefa González-Carrillo

Automatic segmentation of left ventricle (LV) myocardium in cardiac short-axis cine MR images acquired on subjects with myocardial infarction is a challenging task, mainly because of the various types of image inhomogeneity caused by the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Dongqing Zhang , Ilknur Icke , Belma Dogdas , Sarayu Parimal , Smita Sampath , Joseph Forbes , Ansuman Bagchi , Chih-Liang Chin , Antong Chen

Accurate segmentation of the ventricles from cardiac magnetic resonance images (CMRIs) is crucial for enhancing the diagnosis and analysis of heart conditions. Deep learning-based segmentation methods have recently garnered significant…

Image and Video Processing · Electrical Eng. & Systems 2025-03-26 Hong Zheng , Yucheng Chen , Nan Mu , Xiaoning Li

This paper presents our method for the estimation of valence-arousal (VA) in the 8th Affective Behavior Analysis in-the-Wild (ABAW) competition. Our approach integrates visual and audio information through a multimodal framework. The visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Jun Yu , Yongqi Wang , Lei Wang , Yang Zheng , Shengfan Xu

Medical vision foundation models remain limited in downstream tasks, particularly volumetric medical image segmentation. While fine-tuning on labeled target-domain data improves performance, existing approaches typically rely on randomly…

Image and Video Processing · Electrical Eng. & Systems 2026-05-07 Jin Yang , Daniel S. Marcus , Aristeidis Sotiras

Due to the imbalanced and limited data, semi-supervised medical image segmentation methods often fail to produce superior performance for some specific tailed classes. Inadequate training for those particular classes could introduce more…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Hritam Basak , Sagnik Ghosal , Ram Sarkar

This study proposes a novel perspective on multimodal deep learning for biomedical signal classification, systematically analyzing how complementary feature domains impact model performance. While fusing multiple domains often presumes…

Machine Learning · Computer Science 2025-08-05 Timothy Oladunni , Alex Wong

Accurate classification of medical device risk levels is essential for regulatory oversight and clinical safety. We present a Transformer-based multimodal framework that integrates textual descriptions and visual information to predict…

Machine Learning · Computer Science 2025-05-02 Yu Han , Aaron Ceross , Jeroen H. M. Bergmann

Cardiovascular diseases (CVD) can be diagnosed using various diagnostic modalities. The electrocardiogram (ECG) is a cost-effective and widely available diagnostic aid that provides functional information of the heart. However, its ability…

Signal Processing · Electrical Eng. & Systems 2025-01-09 Özgün Turgut , Philip Müller , Paul Hager , Suprosanna Shit , Sophie Starck , Martin J. Menten , Eimo Martens , Daniel Rueckert

Left ventricular ejection fraction (LVEF) is a key indicator of cardiac function and plays a central role in the diagnosis and management of cardiovascular disease. Echocardiography, as a readily accessible and non-invasive imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Shravan Saranyan , Pramit Saha

Chest X-ray imaging is a critical diagnostic tool for identifying pulmonary diseases. However, manual interpretation of these images is time-consuming and error-prone. Automated systems utilizing convolutional neural networks (CNNs) have…

Image and Video Processing · Electrical Eng. & Systems 2025-11-25 Saurabh Agarwal , K. V. Arya , Yogesh Kumar Meena

Semantic segmentation using convolutional neural networks (CNNs) is the state-of-the-art for many medical segmentation tasks including left ventricle (LV) segmentation in cardiac MR images. However, a drawback is that these CNNs lack…

Image and Video Processing · Electrical Eng. & Systems 2022-08-18 Sofie Tilborghs , Tom Dresselaers , Piet Claus , Jan Bogaert , Frederik Maes

Cardiac resynchronization therapy (CRT) has been established as an important therapy for heart failure. Mechanical dyssynchrony has the potential to predict responders to CRT. The aim of this study was to report the development and the…

Imbalanced electrocardiogram (ECG) data hampers the efficacy and resilience of algorithms in the automated processing and interpretation of cardiovascular diagnostic information, which in turn impedes deep learning-based ECG classification.…

Machine Learning · Computer Science 2026-01-15 Haijian Shao , Wei Liu , Xing Deng , Daze Lu

Background: The assessment of left ventricular (LV) function by myocardial perfusion SPECT (MPS) relies on accurate myocardial segmentation. The purpose of this paper is to develop and validate a new method incorporating deep learning with…

Image and Video Processing · Electrical Eng. & Systems 2023-12-22 Fubao Zhu , Jinyu Zhao , Chen Zhao , Shaojie Tang , Jiaofen Nan , Yanting Li , Zhongqiang Zhao , Jianzhou Shi , Zenghong Chen , Zhixin Jiang , Weihua Zhou

An accurate assessment of the cardiovascular system and prediction of cardiovascular diseases (CVDs) are crucial. Measured cardiac blood flow data provide insights about patient-specific hemodynamics, where many specialized techniques have…

Foundational models are trained on extensive datasets to capture the general trends of a domain. However, in medical imaging, the scarcity of data makes pre-training for every domain, modality, or task challenging. Instead of building…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Mohammad Areeb Qazi , Munachiso S Nwadike , Ibrahim Almakky , Mohammad Yaqub , Numan Saeed

Multimodal learning has been lacking principled ways of combining information from different modalities and learning a low-dimensional manifold of meaningful representations. We study multimodal learning and sensor fusion from a latent…

Machine Learning · Computer Science 2019-04-24 Lijiang Guo

Chest X-ray classification suffers from severe class imbalance where gradient updates bias toward majority classes, causing feature drift and poor performance on rare but critical pathologies. We propose a Momentum-Anchored Multi-Scale…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Duy Hoang Khuong , Duy Nguyen Huu , Ngu Huynh Cong Viet

Recent advancements in multimodal fusion have witnessed the remarkable success of vision-language (VL) models, which excel in various multimodal applications such as image captioning and visual question answering. However, building VL…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Zhiwei Hao , Jianyuan Guo , Li Shen , Yong Luo , Han Hu , Yonggang Wen