English
Related papers

Related papers: DRMIME: Differentiable Mutual Information and Matr…

200 papers

We propose a fluid-based registration framework of medical images based on implicit neural representation. By integrating implicit neural representation and Large Deformable Diffeomorphic Metric Mapping (LDDMM), we employ a Multilayer…

Image and Video Processing · Electrical Eng. & Systems 2023-11-28 Chulong Zhang , Xiaokun Liang

Modulo-Imaging (MI) offers a promising alternative for expanding the dynamic range of images by resetting the signal intensity when it reaches the saturation level. Subsequently, high-dynamic range (HDR) modulo imaging requires a recovery…

Image and Video Processing · Electrical Eng. & Systems 2026-02-02 Brayan Monroy , Jorge Bacca

This paper introduces MutualNeRF, a framework enhancing Neural Radiance Field (NeRF) performance under limited samples using Mutual Information Theory. While NeRF excels in 3D scene synthesis, challenges arise with limited data and existing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Zifan Wang , Jingwei Li , Yitang Li , Yunze Liu

To effectively leverage user-specific data, retrieval augmented generation (RAG) is employed in multimodal large language model (MLLM) applications. However, conventional retrieval approaches often suffer from limited retrieval accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Maoliang Li , Ke Li , Yaoyang Liu , Jiayu Chen , Zihao Zheng , Yinjun Wu , Chenchen Liu , Xiang Chen

Image registration is a fundamental requirement for medical image analysis. Deep registration methods based on deep learning have been widely recognized for their capabilities to perform fast end-to-end registration. Many deep registration…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Mingyuan Meng , Lei Bi , Michael Fulham , Dagan Feng , Jinman Kim

This paper presents an approach to fast image registration through probabilistic pixel sampling. We propose a practical scheme to leverage the benefits of two state-of-the-art pixel sampling approaches: gradient magnitude based pixel…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Boris N. Oreshkin , Tal Arbel

Image registration is a key technique in medical image analysis to estimate deformations between image pairs. A good deformation model is important for high-quality estimates. However, most existing approaches use ad-hoc deformation models…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Marc Niethammer , Roland Kwitt , Francois-Xavier Vialard

Conventional approaches to image registration consist of time consuming iterative methods. Most current deep learning (DL) based registration methods extract deep features to use in an iterative setting. We propose an end-to-end DL method…

Computer Vision and Pattern Recognition · Computer Science 2019-09-11 Dwarikanath Mahapatra

Non-rigid inter-modality registration can facilitate accurate information fusion from different modalities, but it is challenging due to the very different image appearances across modalities. In this paper, we propose to train a non-rigid…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Xiaohuan Cao , Jianhua Yang , Li Wang , Zhong Xue , Qian Wang , Dinggang Shen

Deep metrics have been shown effective as similarity measures in multi-modal image registration; however, the metrics are currently constructed from aligned image pairs in the training data. In this paper, we propose a strategy for learning…

Computer Vision and Pattern Recognition · Computer Science 2018-04-06 Alireza Sedghi , Jie Luo , Alireza Mehrtash , Steve Pieper , Clare M. Tempany , Tina Kapur , Parvin Mousavi , William M. Wells

Morphological analysis of longitudinal MR images plays a key role in monitoring disease progression for prostate cancer patients, who are placed under an active surveillance program. In this paper, we describe a learning-based image…

Image and Video Processing · Electrical Eng. & Systems 2020-11-05 Qianye Yang , Yunguan Fu , Francesco Giganti , Nooshin Ghavami , Qingchao Chen , J. Alison Noble , Tom Vercauteren , Dean Barratt , Yipeng Hu

We present REMM, a rotation-equivariant framework for end-to-end multimodal image matching, which fully encodes rotational differences of descriptors in the whole matching pipeline. Previous learning-based methods mainly focus on extracting…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Han Nie , Bin Luo , Jun Liu , Zhitao Fu , Weixing Liu , Xin Su

We point out a limitation of the mutual information neural estimation (MINE) where the network fails to learn at the initial training phase, leading to slow convergence in the number of training iterations. To solve this problem, we propose…

Information Theory · Computer Science 2019-06-03 Chung Chan , Ali Al-Bashabsheh , Hing Pang Huang , Michael Lim , Da Sun Handason Tam , Chao Zhao

Multi-modal magnetic resonance imaging (MRI) is essential in clinics for comprehensive diagnosis and surgical planning. Nevertheless, the segmentation of multi-modal MR images tends to be time-consuming and challenging. Convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2019-08-07 Cheng Li , Hui Sun , Zaiyi Liu , Meiyun Wang , Hairong Zheng , Shanshan Wang

We propose a deformable registration algorithm based on unsupervised learning of a low-dimensional probabilistic parameterization of deformations. We model registration in a probabilistic and generative fashion, by applying a conditional…

Computer Vision and Pattern Recognition · Computer Science 2018-07-23 Julian Krebs , Tommaso Mansi , Boris Mailhé , Nicholas Ayache , Hervé Delingette

Optical and Synthetic Aperture Radar (SAR) image registration is crucial for multi-modal image fusion and applications. However, several challenges limit the performance of existing deep learning-based methods in cross-modal image…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Wei Wang , Dou Quan , Ning Huyan , Chonghua Lv , Shuang Wang , Yunan Li , Licheng Jiao

We present an effective method for the matching of multimodal images. Accurate image matching is the basis of various applications, such as image registration and structure from motion. Conventional matching methods fail when handling noisy…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Zhongli Fan , Li Zhang , Yuxuan Liu

Image registration is a fundamental task for medical imaging. Resampling of the intensity values is required during registration and better spatial resolution with finer and sharper structures can improve the resampling performance and…

Image and Video Processing · Electrical Eng. & Systems 2022-01-03 Kaicong Sun , Sven Simon

Multimodal image alignment is the process of finding spatial correspondences between images formed by different imaging techniques or under different conditions, to facilitate heterogeneous data fusion and correlative analysis. The…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Johan Öfverstedt , Joakim Lindblad , Nataša Sladoje

We are assisting at a growing interest in the development of learning architectures with application to digital communication systems. Herein, we consider the detection/decoding problem. We aim at developing an optimal neural architecture…

Information Theory · Computer Science 2022-09-02 Andrea M. Tonello , Nunzio A. Letizia