English
Related papers

Related papers: Mono-Modalizing Extremely Heterogeneous Multi-Moda…

200 papers

Image registration techniques usually assume that the images to be registered are of a certain type (e.g. single- vs. multi-modal, 2D vs. 3D, rigid vs. deformable) and there lacks a general method that can work for data under all…

Image and Video Processing · Electrical Eng. & Systems 2025-01-28 Quang Luong Nhat Nguyen , Ruiming Cao , Laura Waller

Purpose: Deformable image registration (DIR) is critical in adaptive radiation therapy (ART) to account for anatomical changes. Conventional intensity-based DIR methods often fail when image intensities differ. This study evaluates a hybrid…

Medical Physics · Physics 2024-11-27 Keyur D. Shah , James A. Shackleford , Nagarajan Kandasamy , Gregory C. Sharp

Art technological investigations of historical panel paintings rely on acquiring multi-modal image data, including visual light photography, infrared reflectography, ultraviolet fluorescence photography, x-radiography, and macro…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Aline Sindel , Andreas Maier , Vincent Christlein

Multimodal Magnetic Resonance Imaging (MRI) provides essential complementary information for analyzing brain tumor subregions. While methods using four common MRI modalities for automatic segmentation have shown success, they often face…

Image and Video Processing · Electrical Eng. & Systems 2024-11-14 Runze Cheng , Zhongao Sun , Ye Zhang , Chun Li

In the field of medical image analysis, image registration is a crucial technique. Despite the numerous registration models that have been proposed, existing methods still fall short in terms of accuracy and interpretability. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Jiaofen Nan , Gaodeng Fan , Kaifan Zhang , Chen Zhao , Fubao Zhu , Weihua Zhou

Objective: In medical imaging, it is often crucial to accurately assess and correct movement during image-guided therapy. Deformable image registration (DIR) consists in estimating the required spatial transformation to align a moving image…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Eloïse Inacio , Luc Lafitte , Laurent Facq , Clair Poignard , Baudouin Denis de Senneville

Image registration plays an important role in medical image analysis. Conventional optimization based methods provide an accurate estimation due to the iterative process at the cost of expensive computation. Deep learning methods such as…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Junshen Xu , Eric Z. Chen , Xiao Chen , Terrence Chen , Shanhui Sun

Medical image segmentation plays a crucial role in AI-assisted diagnostics, surgical planning, and treatment monitoring. Accurate and robust segmentation models are essential for enabling reliable, data-driven clinical decision making…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Sachin Dudda Nagaraju , Ashkan Moradi , Bendik Skarre Abrahamsen , Mattijs Elschot

Multimodal medical image fusion (MMIF) aims to integrate images from different modalities to produce a comprehensive image that enhances medical diagnosis by accurately depicting organ structures, tissue textures, and metabolic information.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Tao Luo , Weihua Xu

Image registration is fundamental in medical imaging, enabling precise alignment of anatomical structures for diagnosis, treatment planning, image-guided interventions, and longitudinal monitoring. This work introduces IMPACT (Image Metric…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Valentin Boussot , Cédric Hémon , Jean-Claude Nunes , Jason Dowling , Simon Rouzé , Caroline Lafond , Anaïs Barateau , Jean-Louis Dillenseger

We propose a fluid-based registration framework of medical images based on implicit neural representation. By integrating implicit neural representation and Large Deformable Diffeomorphic Metric Mapping (LDDMM), we employ a Multilayer…

Image and Video Processing · Electrical Eng. & Systems 2023-11-28 Chulong Zhang , Xiaokun Liang

Multispectral and multimodal images are of important usage in the field of multi-source visual information fusion. Due to the alternation or movement of image devices, the acquired multispectral and multimodal images are usually misaligned,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Si-Yuan Cao , Beinan Yu , Lun Luo , Shu-Jie Chen , Chunguang Li , Hui-Liang Shen

Existing medical image registration algorithms rely on either dataset specific training or local texture-based features to align images. The former cannot be reliably implemented without large modality-specific training datasets, while the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Xinrui Song , Xuanang Xu , Pingkun Yan

Longitudinal image registration is challenging and has not yet benefited from major performance improvements thanks to deep-learning. Inspired by Deep Image Prior, this paper introduces a different use of deep architectures as regularizers…

Deploying multimodal models in real-world scenarios requires generalization to new environments where recording conditions differ from training, a challenge known as multimodal domain generalization (MMDG). Standard architectures employ…

Machine Learning · Computer Science 2026-05-05 Yavuz Yarici , Ghassan AlRegib

Recent years have witnessed a surge of interest in integrating high-dimensional data captured by multisource sensors, driven by the impressive success of neural networks in the integration of multimodal data. However, the integration of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Morteza Ghahremani , Christian Wachinger

Image registration is fundamental in medical imaging applications, such as disease progression analysis or radiation therapy planning. The primary objective of image registration is to precisely capture the deformation between two or more…

Image and Video Processing · Electrical Eng. & Systems 2024-12-23 Anna Reithmeir , Veronika Spieker , Vasiliki Sideri-Lampretsa , Daniel Rueckert , Julia A. Schnabel , Veronika A. Zimmer

Whole-body Positron Emission Tomography (PET) registration is essential for multi-parametric tumor characterization and assessment of metastatic disease progression. In deep learning-based deformable registration, the dense displacement…

Image and Video Processing · Electrical Eng. & Systems 2026-04-28 Xiangcen Wu , Ruohua Chen , Sichun Li , Qianye Yang , Sheng Liu , Jianjun Liu , Zhaoheng Xie

Image registration is an essential step in many medical image analysis tasks. Traditional methods for image registration are primarily optimization-driven, finding the optimal deformations that maximize the similarity between two images.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Shanlin Sun , Kun Han , Chenyu You , Hao Tang , Deying Kong , Junayed Naushad , Xiangyi Yan , Haoyu Ma , Pooya Khosravi , James S. Duncan , Xiaohui Xie

We introduce a deep encoder-decoder architecture for image deformation prediction from multimodal images. Specifically, we design an image-patch-based deep network that jointly (i) learns an image similarity measure and (ii) the…

Computer Vision and Pattern Recognition · Computer Science 2017-04-03 Xiao Yang , Roland Kwitt , Martin Styner , Marc Niethammer