English
Related papers

Related papers: A Deep Metric for Multimodal Registration

200 papers

In image registration, many efforts have been devoted to the development of alternatives to the popular normalized mutual information criterion. Concurrently to these efforts, an increasing number of works have demonstrated that substantial…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Vincent Jaouen , Pierre-Henri Conze , Guillaume Dardenne , Julien Bert , Dimitris Visvikis

Visual Similarity plays an important role in many computer vision applications. Deep metric learning (DML) is a powerful framework for learning such similarities which not only generalize from training data to identically distributed test…

Computer Vision and Pattern Recognition · Computer Science 2020-09-11 Timo Milbich , Karsten Roth , Homanga Bharadhwaj , Samarth Sinha , Yoshua Bengio , Björn Ommer , Joseph Paul Cohen

Multi-modal learning is a fast growing area in artificial intelligence. It tries to help machines understand complex things by combining information from different sources, like images, text, and audio. By using the strengths of each…

Machine Learning · Computer Science 2025-12-22 Qihang Jin , Enze Ge , Yuhang Xie , Hongying Luo , Junhao Song , Ziqian Bi , Chia Xin Liang , Jibin Guan , Joe Yeong , Xinyuan Song , Junfeng Hao

In this paper, we introduce a novel deep-learning method to align cross-spectral images. Our approach relies on a learned descriptor which is invariant to different spectra. Multi-modal images of the same scene capture different signals and…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Nati Ofir , Shai Silberstein , Hila Levi , Dani Rozenbaum , Yosi Keller , Sharon Duvdevani Bar

In this work, we conducted a survey on different registration algorithms and investigated their suitability for hyperspectral historical image registration applications. After the evaluation of different algorithms, we choose an intensity…

Computer Vision and Pattern Recognition · Computer Science 2017-12-14 AmirAbbas Davari , Tobias Lindenberger , Armin Häberle , Vincent Christlein , Andreas Maier , Christian Riess

Diffeomorphic image registration is crucial for various medical imaging applications because it can preserve the topology of the transformation. This study introduces DCCNN-LSTM-Reg, a learning framework that evolves dynamically and learns…

Image and Video Processing · Electrical Eng. & Systems 2024-11-06 Jinqiu Deng , Ke Chen , Mingke Li , Daoping Zhang , Chong Chen , Alejandro F. Frangi , Jianping Zhang

Deformable image registration (DIR), aiming to find spatial correspondence between images, is one of the most critical problems in the domain of medical image analysis. In this paper, we present a novel, generic, and accurate diffeomorphic…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Yifan Wu , Tom Z. Jiahao , Jiancong Wang , Paul A. Yushkevich , M. Ani Hsieh , James C. Gee

Multi-modal image registration is a challenging problem that is also an important clinical task for many real applications and scenarios. As a first step in analysis, deformable registration among different image modalities is often…

Image and Video Processing · Electrical Eng. & Systems 2020-07-21 Fengze Liu , Jinzheng Cai , Yuankai Huo , Chi-Tung Cheng , Ashwin Raju , Dakai Jin , Jing Xiao , Alan Yuille , Le Lu , ChienHung Liao , Adam P Harrison

Image matching, which aims to identify corresponding pixel locations between images, is crucial in a wide range of scientific disciplines, aiding in image registration, fusion, and analysis. In recent years, deep learning-based image…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Xingyi He , Hao Yu , Sida Peng , Dongli Tan , Zehong Shen , Hujun Bao , Xiaowei Zhou

In many applications involving multi-media data, the definition of similarity between items is integral to several key tasks, e.g., nearest-neighbor retrieval, classification, and recommendation. Data in such regimes typically exhibits…

Artificial Intelligence · Computer Science 2010-09-01 Brian McFee , Gert Lanckriet

In the last decade, convolutional neural networks (ConvNets) have been a major focus of research in medical image analysis. However, the performances of ConvNets may be limited by a lack of explicit consideration of the long-range spatial…

Image and Video Processing · Electrical Eng. & Systems 2022-10-18 Junyu Chen , Eric C. Frey , Yufan He , William P. Segars , Ye Li , Yong Du

Establishing dense anatomical correspondence across distinct imaging modalities is a foundational yet challenging procedure for numerous medical image analysis studies and image-guided radiotherapy. Existing multi-modality image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Tony C. W. Mok , Zi Li , Yunhao Bai , Jianpeng Zhang , Wei Liu , Yan-Jie Zhou , Ke Yan , Dakai Jin , Yu Shi , Xiaoli Yin , Le Lu , Ling Zhang

Surgical navigation based on multimodal image registration has played a significant role in providing intraoperative guidance to surgeons by showing the relative position of the target area to critical anatomical structures during surgery.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Jiazheng Wang , Zeyu Liu , Min Liu , Xiang Chen , Xinyao Yu , Yaonan Wang , Hang Zhang

Image-text multimodal representation learning aligns data across modalities and enables important medical applications, e.g., image classification, visual grounding, and cross-modal retrieval. In this work, we establish a connection between…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Peiqi Wang , William M. Wells , Seth Berkowitz , Steven Horng , Polina Golland

Cortical surface registration is a fundamental tool for neuroimaging analysis that has been shown to improve the alignment of functional regions relative to volumetric approaches. Classically, image registration is performed by optimizing a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Mohamed A. Suliman , Logan Z. J. Williams , Abdulah Fawaz , Emma C. Robinson

Despite current advancement in the field of biomedical image processing, propelled by the deep learning revolution, multimodal image registration, due to its several challenges, is still often performed manually by specialists. The recent…

Image and Video Processing · Electrical Eng. & Systems 2022-11-30 Jiahao Lu , Johan Öfverstedt , Joakim Lindblad , Nataša Sladoje

Recent advances in deep learning-based medical image registration have shown that training deep neural networks~(DNNs) does not necessarily require medical images. Previous work showed that DNNs trained on randomly generated images with…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Junyu Chen , Shuwen Wei , Yihao Liu , Aaron Carass , Yong Du

In medical imaging it is common practice to acquire a wide range of modalities (MRI, CT, PET, etc.), to highlight different structures or pathologies. As patient movement between scans or scanning session is unavoidable, registration is…

Image and Video Processing · Electrical Eng. & Systems 2021-05-10 Mikael Brudfors , Yaël Balbastre , John Ashburner

Deep learning-based methods have recently demonstrated promising results in deformable image registration for a wide range of medical image analysis tasks. However, existing deep learning-based methods are usually limited to small…

Image and Video Processing · Electrical Eng. & Systems 2020-07-01 Tony C. W. Mok , Albert C. S. Chung

We propose a coercive approach to simultaneously register and segment multi-modal images which share similar spatial structure. Registration is done at the region level to facilitate data fusion while avoiding the need for interpolation.…

Computer Vision and Pattern Recognition · Computer Science 2015-11-19 Yu-Hui Chen , Dennis Wei , Gregory Newstadt , Jeffrey Simmons , Alfred Hero