English
Related papers

Related papers: Multi-Modality Cardiac Image Computing: A Survey

200 papers

Medical imaging provides essential visual insights for diagnosis, and multimodal large language models (MLLMs) are increasingly utilized for its analysis due to their strong generalization capabilities; however, the underlying factors…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Zhenyang Cai , Junying Chen , Rongsheng Wang , Weihong Wang , Yonglin Deng , Dingjie Song , Yize Chen , Zixu Zhang , Benyou Wang

Purpose High dimensional, multimodal data can nowadays be analyzed by huge deep neural networks with little effort. Several fusion methods for bringing together different modalities have been developed. Given the prevalence of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Christian Gapp , Elias Tappeiner , Martin Welk , Karl Fritscher , Elke Ruth Gizewski , Rainer Schubert

The analysis of multi-modality positron emission tomography and computed tomography (PET-CT) images for computer aided diagnosis applications requires combining the sensitivity of PET to detect abnormal regions with anatomical localization…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Ashnil Kumar , Michael Fulham , Dagan Feng , Jinman Kim

Cone-beam computed tomography (CBCT) is an important tool facilitating computer aided interventions, despite often suffering from artifacts that pose challenges for accurate interpretation. While the degraded image quality can affect…

Image and Video Processing · Electrical Eng. & Systems 2024-07-02 Maximilian E. Tschuchnig , Philipp Steininger , Michael Gadermayr

Cross-modality image synthesis is an active research topic with multiple medical clinically relevant applications. Recently, methods allowing training with paired but misaligned data have started to emerge. However, no robust and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Joel Honkamaa , Umair Khan , Sonja Koivukoski , Mira Valkonen , Leena Latonen , Pekka Ruusuvuori , Pekka Marttinen

This paper investigates the MM dynamics approach proposed by Han et al. (2022) for multi-modal fusion in biomedical classification tasks. The MM dynamics algorithm integrates feature-level and modality-level informativeness to dynamically…

Machine Learning · Computer Science 2024-11-04 Laura Wenderoth

Cardiac substructure delineation is emerging in treatment planning to minimize the risk of radiation-induced heart disease. Deep learning offers efficient methods to reduce contouring burden but currently lacks generalizability across…

Multi-modal learning has shown exceptional performance in various tasks, especially in medical applications, where it integrates diverse medical information for comprehensive diagnostic evidence. However, there still are several challenges…

Machine Learning · Computer Science 2024-11-19 Lin Fan , Yafei Ou , Cenyang Zheng , Pengyu Dai , Tamotsu Kamishima , Masayuki Ikebe , Kenji Suzuki , Xun Gong

Multimodal machine learning (MML) is rapidly reshaping the way mental-health disorders are detected, characterized, and longitudinally monitored. Whereas early studies relied on isolated data streams -- such as speech, text, or wearable…

Machine Learning · Computer Science 2025-06-25 Zahraa Al Sahili , Ioannis Patras , Matthew Purver

With the rapid development of Internet and multimedia services in the past decade, a huge amount of user-generated and service provider-generated multimedia data become available. These data are heterogeneous and multi-modal in nature,…

Multimedia · Computer Science 2020-01-07 Wenwu Zhu , Xin Wang , Hongzhi Li

Recent advances in types and extent of medical imaging technologies has led to proliferation of multimodal quantitative imaging data in cancer. Quantitative medical imaging data refer to numerical representations derived from medical…

With the increasing availability of diverse data types, particularly images and time series data from medical experiments, there is a growing demand for techniques designed to combine various modalities of data effectively. Our motivation…

Image and Video Processing · Electrical Eng. & Systems 2024-05-27 Ali Rasekh , Reza Heidari , Amir Hosein Haji Mohammad Rezaie , Parsa Sharifi Sedeh , Zahra Ahmadi , Prasenjit Mitra , Wolfgang Nejdl

As machine learning and artificial intelligence are more frequently being leveraged to tackle problems in the health sector, there has been increased interest in utilizing them in clinical decision-support. This has historically been the…

Machine Learning · Computer Science 2022-04-12 Adrienne Kline , Hanyin Wang , Yikuan Li , Saya Dennis , Meghan Hutch , Zhenxing Xu , Fei Wang , Feixiong Cheng , Yuan Luo

Advances in computing power, deep learning architectures, and expert labelled datasets have spurred the development of medical imaging artificial intelligence systems that rival clinical experts in a variety of scenarios. The National…

Image and Video Processing · Electrical Eng. & Systems 2021-11-18 Rohan Shad , John P. Cunningham , Euan A. Ashley , Curtis P. Langlotz , William Hiesinger

Intracardiac flow patterns are shaped by the coupled motion of the cardiac chambers and heart valves and provide important information about cardiac function. However, clinical flow imaging remains limited by exam times, noise, resolution,…

Image and Video Processing · Electrical Eng. & Systems 2026-05-12 Fanwei Kong , Aaron Brown , Michael Loecher , Perry S. Choi , Lei Shi , Michael Ma , Daniel B. Ennis , Alison Marsden

Accurate disease diagnosis depends on effective collaboration between medical specialties, yet departments often use distinct data systems and proprietary formats. This heterogeneity hinders joint analysis and integration of complementary…

Electrical and elasticity imaging are promising modalities for a suite of different applications including medical tomography, non-destructive testing, and structural health monitoring. These emerging modalities are capable of providing…

Medical Physics · Physics 2021-05-18 Andreas Hauptmann , Danny Smyl

Carotid artery plaques can cause arterial vascular diseases such as stroke and myocardial infarction, posing a severe threat to human life. However, the current clinical examination mainly relies on a direct assessment by physicians of…

Human-Computer Interaction · Computer Science 2023-08-15 Chaoqing Xu , Zhentao Zheng , Yiting Fu , Baofeng Chang , Legao Chen , Minghui Wu , Mingli Song , Jinsong Jiang

Cardiovascular disease affects millions of people worldwide and its social and economic cost clearly motivates scientific research. Computer simulation can lead to a better understanding of cardiac physiology, and for pathology presents…

Biological Physics · Physics 2023-02-27 Toby Simpson

The essence of precision oncology lies in its commitment to tailor targeted treatments and care measures to each patient based on the individual characteristics of the tumor. The inherent heterogeneity of tumors necessitates gathering…

Quantitative Methods · Quantitative Biology 2024-07-01 Huajun Zhou , Fengtao Zhou , Chenyu Zhao , Yingxue Xu , Luyang Luo , Hao Chen