English
Related papers

Related papers: Fast Predictive Multimodal Image Registration

200 papers

Ultrasound imaging is a cost-effective and radiation-free modality for visualizing anatomical structures in real-time, making it ideal for guiding surgical interventions. However, its limited field-of-view, speckle noise, and imaging…

Image and Video Processing · Electrical Eng. & Systems 2024-04-26 Remi Delaunay , Ruisi Zhang , Filipe C. Pedrosa , Navid Feizi , Dianne Sacco , Rajni Patel , Jayender Jagadeesan

Registration of images with pathologies is challenging due to tissue appearance changes and missing correspondences caused by the pathologies. Moreover, mass effects as observed for brain tumors may displace tissue, creating larger…

Image and Video Processing · Electrical Eng. & Systems 2020-08-19 Xu Han , Zhengyang Shen , Zhenlin Xu , Spyridon Bakas , Hamed Akbari , Michel Bilello , Christos Davatzikos , Marc Niethammer

Feature matching plays a fundamental role in many computer vision tasks, yet existing methods heavily rely on scarce and clean multi-view image collections, which constrains their generalization to diverse and challenging scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Yingping Liang , Yutao Hu , Wenqi Shao , Ying Fu

Modeling of large-scale research facilities is extremely challenging due to complex physical processes and engineering problems. Here, we adopt a data-driven approach to model the longitudinal phase-space diagnostic beamline at the…

Machine Learning · Computer Science 2021-08-11 Jun Zhu , Ye Chen , Frank Brinker , Winfried Decking , Sergey Tomin , Holger Schlarb

Transformer has achieved great success in computer vision, while how to split patches in an image remains a problem. Existing methods usually use a fixed-size patch embedding which might destroy the semantics of objects. To address this…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Zhiyang Chen , Yousong Zhu , Chaoyang Zhao , Guosheng Hu , Wei Zeng , Jinqiao Wang , Ming Tang

This paper presents NeurEPDiff, a novel network to fast predict the geodesics in deformation spaces generated by a well known Euler-Poincar\'e differential equation (EPDiff). To achieve this, we develop a neural operator that for the first…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Nian Wu , Miaomiao Zhang

We present three multi-scale similarity learning architectures, or DeepSim networks. These models learn pixel-level matching with a contrastive loss and are agnostic to the geometry of the considered scene. We establish a middle ground…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Mohamed Ali Chebbi , Ewelina Rupnik , Marc Pierrot-Deseilligny , Paul Lopes

Deep Matching (DM) is a popular high-quality method for quasi-dense image matching. Despite its name, however, the original DM formulation does not yield a deep neural network that can be trained end-to-end via backpropagation. In this…

Computer Vision and Pattern Recognition · Computer Science 2016-09-13 James Thewlis , Shuai Zheng , Philip H. S. Torr , Andrea Vedaldi

Matching of images and analysis of shape differences is traditionally pursued by energy minimization of paths of deformations acting to match the shape objects. In the Large Deformation Diffeomorphic Metric Mapping (LDDMM) framework,…

Computer Vision and Pattern Recognition · Computer Science 2018-10-23 Alexis Arnaudon , Darryl Holm , Stefan Sommer

Deformable image registration is a fundamental task in medical imaging. Due to the large computational complexity of deformable registration of volumetric images, conventional iterative methods usually face the tradeoff between the…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Kaicong Sun , Sven Simon

We propose a deformable registration algorithm based on unsupervised learning of a low-dimensional probabilistic parameterization of deformations. We model registration in a probabilistic and generative fashion, by applying a conditional…

Computer Vision and Pattern Recognition · Computer Science 2018-07-23 Julian Krebs , Tommaso Mansi , Boris Mailhé , Nicholas Ayache , Hervé Delingette

Image registration is an essential but challenging task in medical image computing, especially for echocardiography, where the anatomical structures are relatively noisy compared to other imaging modalities. Traditional (non-learning)…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Zihao Wang , Yingyu Yang , Maxime Sermesant , Herve Delingette

We introduce an end-to-end deep-learning framework for 3D medical image registration. In contrast to existing approaches, our framework combines two registration methods: an affine registration and a vector momentum-parameterized stationary…

Computer Vision and Pattern Recognition · Computer Science 2019-03-22 Zhengyang Shen , Xu Han , Zhenlin Xu , Marc Niethammer

We present a minimalistic but effective neural network that computes dense facial correspondences in highly unconstrained RGB images. Our network learns a per-pixel flow and a matchability mask between 2D input photographs of a person and…

Computer Vision and Pattern Recognition · Computer Science 2017-09-05 Ronald Yu , Shunsuke Saito , Haoxiang Li , Duygu Ceylan , Hao Li

We present a new deep learning approach for matching deformable shapes by introducing {\it Shape Deformation Networks} which jointly encode 3D shapes and correspondences. This is achieved by factoring the surface representation into (i) a…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Thibault Groueix , Matthew Fisher , Vladimir G. Kim , Bryan C. Russell , Mathieu Aubry

Unsupervised learning strategy is widely adopted by the deformable registration models due to the lack of ground truth of deformation fields. These models typically depend on the intensity-based similarity loss to obtain the learning…

Image and Video Processing · Electrical Eng. & Systems 2021-12-21 Luyi Han , Haoran Dou , Yunzhi Huang , Pew-Thian Yap

Registration of pre-operative and post-recurrence brain images is often needed to evaluate the effectiveness of brain gliomas treatment. While recent deep learning-based deformable registration methods have achieved remarkable success with…

Image and Video Processing · Electrical Eng. & Systems 2022-06-09 Tony C. W. Mok , Albert C. S. Chung

Deformable image registration plays a fundamental role in medical image analysis by enabling spatial alignment of anatomical structures across subjects. While recent deep learning-based approaches have significantly improved computational…

Image and Video Processing · Electrical Eng. & Systems 2026-03-24 Jiaqi Shang , Haojin Wu , Yinyi Lai , Zongyu Li , Chenghao Zhang , Jia Guo

Joint image registration and segmentation has long been an active area of research in medical imaging. Here, we reformulate this problem in a deep learning setting using adversarial learning. We consider the case in which fixed and moving…

Image and Video Processing · Electrical Eng. & Systems 2019-07-01 Mohamed S. Elmahdy , Jelmer M. Wolterink , Hessam Sokooti , Ivana Išgum , Marius Staring

Intraoperative 2D/3D registration aligns preoperative 3D volumes with real-time 2D radiographs, enabling accurate localization of instruments and implants. A recent fully differentiable similarity learning framework approximates geodesic…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Minheng Chen , Youyong Kong