English
Related papers

Related papers: FIRE: Unsupervised bi-directional inter-modality r…

200 papers

Clinical decision making from magnetic resonance imaging (MRI) combines complementary information from multiple MRI sequences (defined as 'modalities'). MRI image registration aims to geometrically 'pair' diagnoses from different…

Image and Video Processing · Electrical Eng. & Systems 2023-08-07 Chengjia Wang , Giorgos Papanastasiou

We introduce an end-to-end deep-learning framework for 3D medical image registration. In contrast to existing approaches, our framework combines two registration methods: an affine registration and a vector momentum-parameterized stationary…

Computer Vision and Pattern Recognition · Computer Science 2019-03-22 Zhengyang Shen , Xu Han , Zhenlin Xu , Marc Niethammer

We present an approach to learning regular spatial transformations between image pairs in the context of medical image registration. Contrary to optimization-based registration techniques and many modern learning-based methods, we do not…

Magnetic resonance imaging (MRI) is a widely used neuroimaging technique that can provide images of different contrasts (i.e., modalities). Fusing this multi-modal data has proven particularly effective for boosting model performance in…

Computer Vision and Pattern Recognition · Computer Science 2020-02-13 Tao Zhou , Huazhu Fu , Geng Chen , Jianbing Shen , Ling Shao

Image registration is a fundamental building block for various applications in medical image analysis. To better explore the correlation between the fixed and moving images and improve registration performance, we propose a novel deep…

Image and Video Processing · Electrical Eng. & Systems 2021-06-15 Xiang Chen , Yan Xia , Nishant Ravikumar , Alejandro F Frangi

In brain tumor resection, accurate removal of cancerous tissues while preserving eloquent regions is crucial to the safety and outcomes of the treatment. However, intra-operative tissue deformation (called brain shift) can move the surgical…

Image and Video Processing · Electrical Eng. & Systems 2023-07-28 Soorena Salari , Amirhossein Rasoulian , Hassan Rivaz , Yiming Xiao

In a scenario where multi-modal cameras are operating together, the problem of working with non-aligned images cannot be avoided. Yet, existing image fusion algorithms rely heavily on strictly registered input image pairs to produce more…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zeyang Zhang , Hui Li , Tianyang Xu , Xiaojun Wu , Josef Kittler

Deep neural networks have become a foundational tool for addressing imaging inverse problems. They are typically trained for a specific task, with a supervised loss to learn a mapping from the observations to the image to recover. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Matthieu Terris , Thomas Moreau

Multi-fidelity (MF) regression often operates in regimes of extreme data imbalance, where the commonly-used Gaussian-process (GP) surrogates struggle with cubic scaling costs and overfit to sparse high-fidelity observations, limiting…

Machine Learning · Computer Science 2026-02-02 Rosen Ting-Ying Yu , Nicholas Sung , Faez Ahmed

We present in this paper a novel approach for 3D/2D intraoperative registration during neurosurgery via cross-modal inverse neural rendering. Our approach separates implicit neural representation into two components, handling anatomical…

In this paper, we propose a deep learning approach for image registration by predicting deformation from image appearance. Since obtaining ground-truth deformation fields for training can be challenging, we design a fully convolutional…

Computer Vision and Pattern Recognition · Computer Science 2018-02-14 Jingfan Fan , Xiaohuan Cao , Pew-Thian Yap , Dinggang Shen

A novel non-rigid image registration algorithm is built upon fully convolutional networks (FCNs) to optimize and learn spatial transformations between pairs of images to be registered in a self-supervised learning framework. Different from…

Computer Vision and Pattern Recognition · Computer Science 2018-01-15 Hongming Li , Yong Fan

Deformable image registration is a key task in medical image analysis. The Brain Tumor Sequence Registration challenge (BraTS-Reg) aims at establishing correspondences between pre-operative and follow-up scans of the same patient diagnosed…

Image and Video Processing · Electrical Eng. & Systems 2022-12-12 Javid Abderezaei , Aymeric Pionteck , Agamdeep Chopra , Mehmet Kurt

We present a new unsupervised learning algorithm, "FAIM", for 3D medical image registration. With a different architecture than the popular "U-net", the network takes a pair of full image volumes and predicts the displacement fields needed…

Computer Vision and Pattern Recognition · Computer Science 2019-07-02 Dongyang Kuang , Tanya Schmah

Combining the respective advantages of cross-modality images can compensate for the lack of information in the single modality, which has attracted increasing attention of researchers into multi-modal image matching tasks. Meanwhile, due to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shasha Mei

Deep learning-based image fusion approaches have obtained wide attention in recent years, achieving promising performance in terms of visual perception. However, the fusion module in the current deep learning-based methods suffers from two…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Dongyu Rao , Xiao-Jun Wu , Tianyang Xu , Guoyang Chen

Image registration techniques usually assume that the images to be registered are of a certain type (e.g. single- vs. multi-modal, 2D vs. 3D, rigid vs. deformable) and there lacks a general method that can work for data under all…

Image and Video Processing · Electrical Eng. & Systems 2025-01-28 Quang Luong Nhat Nguyen , Ruiming Cao , Laura Waller

Deformable image registration plays a fundamental role in medical image analysis by enabling spatial alignment of anatomical structures across subjects. While recent deep learning-based approaches have significantly improved computational…

Image and Video Processing · Electrical Eng. & Systems 2026-03-24 Jiaqi Shang , Haojin Wu , Yinyi Lai , Zongyu Li , Chenghao Zhang , Jia Guo

Imaging inverse problems can be solved in an unsupervised manner using pre-trained diffusion models, but doing so requires approximating the gradient of the measurement-conditional score function in the diffusion reverse process. We show…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Matt C. Bendel , Saurav K. Shastri , Rizwan Ahmad , Philip Schniter

Robust and accurate alignment of multimodal medical images is a very challenging task, which however is very useful for many clinical applications. For example, magnetic resonance (MR) and transrectal ultrasound (TRUS) image registration is…

Computer Vision and Pattern Recognition · Computer Science 2018-10-03 Pingkun Yan , Sheng Xu , Ardeshir R. Rastinehad , Brad J. Wood