English
Related papers

Related papers: Mono-Modalizing Extremely Heterogeneous Multi-Moda…

200 papers

In the diverse field of medical imaging, automatic segmentation has numerous applications and must handle a wide variety of input domains, such as different types of Computed Tomography (CT) scans and Magnetic Resonance (MR) images. This…

Image and Video Processing · Electrical Eng. & Systems 2024-11-26 Chengyin Li , Hui Zhu , Rafi Ibn Sultan , Hassan Bagher Ebadian , Prashant Khanduri , Chetty Indrin , Kundan Thind , Dongxiao Zhu

Diffeomorphic image registration is crucial for various medical imaging applications because it can preserve the topology of the transformation. This study introduces DCCNN-LSTM-Reg, a learning framework that evolves dynamically and learns…

Image and Video Processing · Electrical Eng. & Systems 2024-11-06 Jinqiu Deng , Ke Chen , Mingke Li , Daoping Zhang , Chong Chen , Alejandro F. Frangi , Jianping Zhang

Proton therapy offers superior organ-at-risk sparing but is highly sensitive to anatomical changes, making accurate deformable image registration (DIR) across longitudinal CT scans essential. Conventional DIR methods are often too slow for…

Medical image registration drives quantitative analysis across organs, modalities, and patient populations. Recent deep learning methods often combine low-level "trend-driven" computational blocks from computer vision, such as large-kernel…

Image and Video Processing · Electrical Eng. & Systems 2025-12-02 Bailiang Jian , Jiazhen Pan , Rohit Jena , Morteza Ghahremani , Hongwei Bran Li , Daniel Rueckert , Christian Wachinger , Benedikt Wiestler

Establishing dense anatomical correspondence across distinct imaging modalities is a foundational yet challenging procedure for numerous medical image analysis studies and image-guided radiotherapy. Existing multi-modality image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Tony C. W. Mok , Zi Li , Yunhao Bai , Jianpeng Zhang , Wei Liu , Yan-Jie Zhou , Ke Yan , Dakai Jin , Yu Shi , Xiaoli Yin , Le Lu , Ling Zhang

Learning-based medical image registration has matched the accuracy of conventional methods while offering superior computational efficiency. However, existing approaches suffer from poor generalization across diverse clinical scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Zi Li , Jianpeng Zhang , Tai Ma , Tony C. W. Mok , Yan-Jie Zhou , Zeli Chen , Xianghua Ye , Le Lu , Cheng Chen , Dakai Jin

Synthesizing missing modalities in multi-modal magnetic resonance imaging (MRI) is vital for ensuring diagnostic completeness, particularly when full acquisitions are infeasible due to time constraints, motion artifacts, and patient…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yue Zhang , Zhizheng Zhuo , Siyao Xu , Shan Lv , Zhaoxi Liu , Jun Qiu , Qiuli Wang , Yaou Liu , S. Kevin Zhou

Capturing voxel-wise spatial correspondence across distinct modalities is crucial for medical image analysis. However, current registration approaches are not practical enough in terms of registration accuracy and clinical applicability. In…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Tao Guo , Yinuo Wang , Shihao Shu , Weimin Yuan , Diansheng Chen , Zhouping Tang , Cai Meng , Xiangzhi Bai

Multi-contrast magnetic resonance (MR) image registration is useful in the clinic to achieve fast and accurate imaging-based disease diagnosis and treatment planning. Nevertheless, the efficiency and performance of the existing registration…

Image and Video Processing · Electrical Eng. & Systems 2021-02-17 Weijian Huang , Hao Yang , Xinfeng Liu , Cheng Li , Ian Zhang , Rongpin Wang , Hairong Zheng , Shanshan Wang

Deformable registration consists of finding the best dense correspondence between two different images. Many algorithms have been published, but the clinical application was made difficult by the high calculation time needed to solve the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Théo Estienne , Maria Vakalopoulou , Enzo Battistella , Theophraste Henry , Marvin Lerousseau , Amaury Leroy , Nikos Paragios , Eric Deutsch

Multi-modality imaging is widely used in clinical practice and biomedical research to gain a comprehensive understanding of an imaging subject. Currently, multi-modality imaging is accomplished by post hoc fusion of independently…

Image and Video Processing · Electrical Eng. & Systems 2024-10-01 Lingting Zhu , Yizheng Chen , Lianli Liu , Lei Xing , Lequan Yu

Current artificial intelligence models for medical imaging are predominantly single modality and single disease. Attempts to create multimodal and multi-disease models have resulted in inconsistent clinical accuracy. Furthermore, training…

Multi-modality (or multi-channel) imaging is becoming increasingly important and more widely available, e.g. hyperspectral imaging in remote sensing, spectral CT in material sciences as well as multi-contrast MRI and PET-MR in medicine.…

Image and Video Processing · Electrical Eng. & Systems 2020-12-25 Leon Bungert , Matthias J. Ehrhardt

Microscopy images obtained from multiple camera lenses or sensors in biological experiments provide a comprehensive understanding of objects from diverse perspectives. However, using multiple microscope setups increases the risk of…

Image and Video Processing · Electrical Eng. & Systems 2024-07-18 Ruixiong Wang , Stephen Cross , Alin Achim

Deformable image registration between Computed Tomography (CT) images and Magnetic Resonance (MR) imaging is essential for many image-guided therapies. In this paper, we propose a novel translation-based unsupervised deformable image…

Image and Video Processing · Electrical Eng. & Systems 2020-09-22 Zhe Xu , Jie Luo , Jiangpeng Yan , Ritvik Pulya , Xiu Li , William Wells , Jayender Jagadeesan

Multi-modal medical imaging enables comprehensive diagnostics, yet current foundation models process 2D (e.g. X-ray) and 3D (e.g. CT) data with separate, dimensionality-specific architectures. We present MultiMedVision, a unified framework…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Frank Li , Bardia Khosravi , Mohammadreza Chavoshi , Young Seok Jeon , Theo Dapamede , Hari Trivedi , Janice Newsome , Judy Gichoya

Magnetic Resonance Imaging (MRI) typically recruits multiple sequences (defined here as "modalities"). As each modality is designed to offer different anatomical and functional clinical information, there are evident disparities in the…

Image and Video Processing · Electrical Eng. & Systems 2022-03-09 Chengjia Wang , Guang Yang , Giorgos Papanastasiou

Vision foundation models like DINOv2 demonstrate remarkable potential in medical imaging despite their origin in natural image domains. However, their design inherently works best for uni-modal image analysis, limiting their effectiveness…

Image and Video Processing · Electrical Eng. & Systems 2025-09-09 Daniel Scholz , Ayhan Can Erdur , Viktoria Ehm , Anke Meyer-Baese , Jan C. Peeken , Daniel Rueckert , Benedikt Wiestler

Image registration is the process of bringing different images into a common coordinate system - a technique widely used in various applications of computer vision, such as remote sensing, image retrieval, and, most commonly, medical…

Deformable medical image registration is a fundamental task in medical image analysis with applications in disease diagnosis, treatment planning, and image-guided interventions. Despite significant advances in deep learning based…

Machine Learning · Computer Science 2026-02-10 Muhammad Zafar Iqbal , Ghazanfar Farooq Siddiqui , Anwar Ul Haq , Imran Razzak