English
Related papers

Related papers: Learning Generalized Non-Rigid Multimodal Biomedic…

200 papers

We describe a diffeomorphic registration algorithm that allows groups of images to be accurately aligned to a common space, which we intend to incorporate into the SPM software. The idea is to perform inference in a probabilistic graphical…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Mikael Brudfors , Yaël Balbastre , Guillaume Flandin , Parashkev Nachev , John Ashburner

Machine learning approaches for fringe projection profilometry (FPP) are hindered by the lack of large, diverse datasets and standardized benchmarking protocols. This paper introduces the first open-source, photorealistic synthetic dataset…

Image and Video Processing · Electrical Eng. & Systems 2026-02-04 Anush Lakshman S , Adam Haroon , Beiwen Li

Soft-tissue deformation remains a major limitation in image-guided neurosurgery, where intra-operative anatomy can deviate substantially from pre-operative imaging due to brain shift, compromising navigation accuracy and surgical safety.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Eashrat Jahan Muniya , Gernot Kronreif , Ander Biguri , Wolfgang Birkfellner , Sepideh Hatamikia

Given new pairs of source and target point sets, standard point set registration methods often repeatedly conduct the independent iterative search of desired geometric transformation to align the source point set with the target one. This…

Graphics · Computer Science 2019-07-30 Lingjing Wang , Xiang Li , Jianchun Chen , Yi Fang

Nonuniform Fourier data are routinely collected in applications such as magnetic resonance imaging, synthetic aperture radar, and synthetic imaging in radio astronomy. To acquire a fast reconstruction that does not require an online inverse…

Numerical Analysis · Mathematics 2016-10-05 Anne Gelb , Guohui Song

Medical image registration is critical for aligning anatomical structures across imaging modalities such as computed tomography (CT), magnetic resonance imaging (MRI), and ultrasound. Among existing techniques, non-rigid registration (NRR)…

Image and Video Processing · Electrical Eng. & Systems 2025-12-17 Sneha Sree C. , Dattesh Shanbhag , Sudhanya Chatterjee

We introduce RetinaRegNet, a zero-shot image registration model designed to register retinal images with minimal overlap, large deformations, and varying image quality. RetinaRegNet addresses these challenges and achieves robust and…

Neural networks rely on convolutions to aggregate spatial information. However, spatial convolutions are expensive in terms of model size and computation, both of which grow quadratically with respect to kernel size. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Bichen Wu , Alvin Wan , Xiangyu Yue , Peter Jin , Sicheng Zhao , Noah Golmant , Amir Gholaminejad , Joseph Gonzalez , Kurt Keutzer

In this paper, we propose a transformer-based procedure for the efficient registration of non-rigid 3D point clouds. The proposed approach is data-driven and adopts for the first time the transformer architecture in the registration task.…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Giovanni Trappolini , Luca Cosmo , Luca Moschella , Riccardo Marin , Simone Melzi , Emanuele Rodolà

Deformable image registration (DIR) is essential for many image-guided therapies. Recently, deep learning approaches have gained substantial popularity and success in DIR. Most deep learning approaches use the so-called mono-stream…

Image and Video Processing · Electrical Eng. & Systems 2020-12-08 Zhe Xu , Jie Luo , Jiangpeng Yan , Xiu Li , Jagadeesan Jayender

Test-time prompt tuning (TPT) has emerged as a promising technique for enhancing the adaptability of vision-language models by optimizing textual prompts using unlabeled test data. However, prior studies have observed that TPT often…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Hyeonseo Jang , Jaebyeong Jeon , Joong-Won Hwang , Kibok Lee

Learning non-rigid registration in an end-to-end manner is challenging due to the inherent high degrees of freedom and the lack of labeled training data. In this paper, we resolve these two challenges simultaneously. First, we propose to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Wanquan Feng , Juyong Zhang , Hongrui Cai , Haofei Xu , Junhui Hou , Hujun Bao

Nonlinear image registration continues to be a fundamentally important tool in medical image analysis. Diagnostic tasks, image-guided surgery and radiotherapy as well as motion analysis all rely heavily on accurate intra-patient alignment.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-26 Mattias P. Heinrich

We propose a self-supervised method for partial point set registration. While recent proposed learning-based methods have achieved impressive registration performance on the full shape observations, these methods mostly suffer from…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Xiang Li , Lingjing Wang , Yi Fang

Recently, the diffusion model has emerged as a superior generative model that can produce high quality and realistic images. However, for medical image translation, the existing diffusion models are deficient in accurately retaining…

Image and Video Processing · Electrical Eng. & Systems 2023-10-31 Yunxiang Li , Hua-Chieh Shao , Xiao Liang , Liyuan Chen , Ruiqi Li , Steve Jiang , Jing Wang , You Zhang

Multimodal instruction tuning has proven to be an effective strategy for achieving zero-shot generalization by fine-tuning pre-trained Large Multimodal Models (LMMs) with instruction-following data. However, as the scale of LMMs continues…

The Normalized Transformer, or nGPT (arXiv:2410.01131) achieves impressive training speedups and does not require weight decay or learning rate warmup. However, despite having hyperparameters that explicitly scale with model size, we…

Machine Learning · Computer Science 2026-05-04 Boris Shigida , Boris Hanin , Andrey Gromov

Benefiting from prompt tuning, recent years have witnessed the promising performance of pre-trained vision-language models, e.g., CLIP, on versatile downstream tasks. In this paper, we focus on a particular setting of learning adaptive…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Chun-Mei Feng , Kai Yu , Yong Liu , Salman Khan , Wangmeng Zuo

We present a fast learning-based algorithm for deformable, pairwise 3D medical image registration. Current registration methods optimize an objective function independently for each pair of images, which can be time-consuming for large…

Computer Vision and Pattern Recognition · Computer Science 2019-03-14 Guha Balakrishnan , Amy Zhao , Mert R. Sabuncu , John Guttag , Adrian V. Dalca

The ability to build maps is a key functionality for the majority of mobile robots. A central ingredient to most mapping systems is the registration or alignment of the recorded sensor data. In this paper, we present a general methodology…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Bartolomeo Della Corte , Igor Bogoslavskyi , Cyrill Stachniss , Giorgio Grisetti