English
Related papers

Related papers: Modality-AGnostic Image Cascade (MAGIC) for Multi-…

200 papers

Real-time cine magnetic resonance imaging (MRI) plays an increasingly important role in various cardiac interventions. In order to enable fast and accurate visual assistance, the temporal frames need to be segmented on-the-fly. However,…

Image and Video Processing · Electrical Eng. & Systems 2020-07-21 Tianchen Wang , Xiaowei Xu , Jinjun Xiong , Qianjun Jia , Haiyun Yuan , Meiping Huang , Jian Zhuang , Yiyu Shi

Cardiovascular magnetic resonance (CMR) imaging is the gold standard for diagnosing several heart diseases due to its non-invasive nature and proper contrast. MR imaging is time-consuming because of signal acquisition and image formation…

Image and Video Processing · Electrical Eng. & Systems 2025-04-29 Kian Anvari Hamedani , Narges Razizadeh , Shahabedin Nabavi , Mohsen Ebrahimi Moghaddam

Accurate and robust whole heart substructure segmentation is crucial in developing clinical applications, such as computer-aided diagnosis and computer-aided surgery. However, segmentation of different heart substructures is challenging…

Image and Video Processing · Electrical Eng. & Systems 2021-02-04 Tarun Kanti Ghosh , Md. Kamrul Hasan , Shidhartho Roy , Md. Ashraful Alam , Eklas Hossain , Mohiuddin Ahmad

Motivation: Multi-omics integration can improve cancer subtyping, but modality informativeness and noise vary across cancer types and patients. Existing graph-based methods optimize modality weights jointly with the classification objective…

Machine Learning · Computer Science 2026-04-28 Boyang Fan , Hengchuang Yin , Siyu Yi , Yifan Wang , Zhicheng Li , Leijiyu Zhou , Jiancheng Lv , Wei Ju

Establishing dense anatomical correspondence across distinct imaging modalities is a foundational yet challenging procedure for numerous medical image analysis studies and image-guided radiotherapy. Existing multi-modality image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Tony C. W. Mok , Zi Li , Yunhao Bai , Jianpeng Zhang , Wei Liu , Yan-Jie Zhou , Ke Yan , Dakai Jin , Yu Shi , Xiaoli Yin , Le Lu , Ling Zhang

Unsupervised domain adaptation (UDA) for cross-modality medical image segmentation has shown great progress by domain-invariant feature learning or image appearance translation. Adapted feature learning usually cannot detect domain shifts…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Guodong Zeng , Till D. Lerch , Florian Schmaranzer , Guoyan Zheng , Juergen Burger , Kate Gerber , Moritz Tannast , Klaus Siebenrock , Nicolas Gerber

Due to the imbalanced and limited data, semi-supervised medical image segmentation methods often fail to produce superior performance for some specific tailed classes. Inadequate training for those particular classes could introduce more…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Hritam Basak , Sagnik Ghosal , Ram Sarkar

Efficient medical image segmentation aims to provide accurate pixel-wise predictions for medical images with a lightweight implementation framework. However, lightweight frameworks generally fail to achieve superior performance and suffer…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Xingqun Qi , Zhuojie Wu , Min Ren , Muyi Sun , Caifeng Shan , Zhenan Sun

Few-shot image classification remains a critical challenge in the field of computer vision, particularly in data-scarce environments. Existing methods typically rely on pre-trained visual-language models, such as CLIP. However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Xi Yang , Pai Peng , Wulin Xie , Xiaohuan Lu , Jie Wen

Multi-modal learning is typically performed with network architectures containing modality-specific layers and shared layers, utilizing co-registered images of different modalities. We propose a novel learning scheme for unpaired…

Computer Vision and Pattern Recognition · Computer Science 2020-01-10 Qi Dou , Quande Liu , Pheng Ann Heng , Ben Glocker

The standard non-invasive imaging technique used to assess the severity and extent of Coronary Artery Disease (CAD) is Coronary Computed Tomography Angiography (CCTA). However, manual grading of each patient's CCTA according to the…

The analysis of multi-modality positron emission tomography and computed tomography (PET-CT) images for computer aided diagnosis applications requires combining the sensitivity of PET to detect abnormal regions with anatomical localization…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Ashnil Kumar , Michael Fulham , Dagan Feng , Jinman Kim

Typically, a medical image offers spatial information on the anatomy (and pathology) modulated by imaging specific characteristics. Many imaging modalities including Magnetic Resonance Imaging (MRI) and Computed Tomography (CT) can be…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Agisilaos Chartsias , Thomas Joyce , Giorgos Papanastasiou , Michelle Williams , David Newby , Rohan Dharmakumar , Sotirios A. Tsaftaris

Multimodal learning leverages complementary information derived from different modalities, thereby enhancing performance in medical image segmentation. However, prevailing multimodal learning methods heavily rely on extensive well-annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Xiaogen Zhou , Yiyou Sun , Min Deng , Winnie Chiu Wing Chu , Qi Dou

Multimodal deep learning holds promise for improving clinical prediction by integrating diverse patient data, including text, imaging, time-series, and structured demographics. Contrastive learning facilitates this integration by producing…

Machine Learning · Computer Science 2025-07-08 Michal Golovanevsky , Pranav Mahableshwarkar , Carsten Eickhoff , Ritambhara Singh

With large-scale well-labeled datasets, deep learning has shown significant success in medical image segmentation. However, it is challenging to acquire abundant annotations in clinical practice due to extensive expertise requirements and…

Image and Video Processing · Electrical Eng. & Systems 2022-10-20 Ziyuan Zhao , Jinxuan Hu , Zeng Zeng , Xulei Yang , Peisheng Qian , Bharadwaj Veeravalli , Cuntai Guan

Despite the remarkable developments of recent large models in Embodied Artificial Intelligence (E-AI), their integration into robotics is hampered by their excessive parameter sizes and computational demands. Towards the Vision-and-Language…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Liuyi Wang , Zongtao He , Mengjiao Shen , Jingwei Yang , Chengju Liu , Qijun Chen

Multimodal fusion leverages information across modalities to learn better feature representations with the goal of improving performance in fusion-based tasks. However, multimodal datasets, especially in medical settings, are typically…

Machine Learning · Computer Science 2025-02-05 Alejandro Guerra-Manzanares , Farah E. Shamout

Lung tumors, especially those located close to or surrounded by soft tissues like the mediastinum, are difficult to segment due to the low soft tissue contrast on computed tomography images. Magnetic resonance images contain superior…

Image and Video Processing · Electrical Eng. & Systems 2019-09-11 Jue Jiang , Jason Hu , Neelam Tyagi , Andreas Rimner , Sean L. Berry , Joseph O. Deasy , Harini Veeraraghavan

Perfusion imaging is extensively utilized to assess hemodynamic status and tissue perfusion in various organs. Computed tomography perfusion (CTP) imaging plays a key role in the early assessment and planning of stroke treatment. While CTP…