English
Related papers

Related papers: Unsupervised Multi-Modal Image Registration via Ge…

200 papers

Most invariance-based self-supervised methods rely on single object-centric images (e.g., ImageNet images) for pretraining, learning features that invariant to geometric transformation. However, when images are not object-centric, the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Taeho Kim , Jong-Min Lee

Image translation is a burgeoning field in computer vision where the goal is to learn the mapping between an input image and an output image. However, most recent methods require multiple generators for modeling different domain mappings,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Xiaoming Yu , Xing Cai , Zhenqiang Ying , Thomas Li , Ge Li

Multi-modal brain images from MRI scans are widely used in clinical diagnosis to provide complementary information from different modalities. However, obtaining fully paired multi-modal images in practice is challenging due to various…

Image and Video Processing · Electrical Eng. & Systems 2024-04-25 Chuan Huang , Jia Wei , Rui Li

Cross-domain mapping has been a very active topic in recent years. Given one image, its main purpose is to translate it to the desired target domain, or multiple domains in the case of multiple labels. This problem is highly challenging due…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Andrés Romero , Pablo Arbeláez , Luc Van Gool , Radu Timofte

Multi-modality image fusion is a technique that combines information from different sensors or modalities, enabling the fused image to retain complementary features from each modality, such as functional highlights and texture details.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Zixiang Zhao , Haowen Bai , Jiangshe Zhang , Yulun Zhang , Kai Zhang , Shuang Xu , Dongdong Chen , Radu Timofte , Luc Van Gool

Person re-identification (re-ID) models trained on one domain often fail to generalize well to another. In our attempt, we present a "learning via translation" framework. In the baseline, we translate the labeled images from source to…

Computer Vision and Pattern Recognition · Computer Science 2018-05-16 Weijian Deng , Liang Zheng , Qixiang Ye , Guoliang Kang , Yi Yang , Jianbin Jiao

Deep learning-based image fusion approaches have obtained wide attention in recent years, achieving promising performance in terms of visual perception. However, the fusion module in the current deep learning-based methods suffers from two…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Dongyu Rao , Xiao-Jun Wu , Tianyang Xu , Guoyang Chen

In this work, we propose a self-supervised learning method for affine image registration on 3D medical images. Unlike optimisation-based methods, our affine image registration network (AIRNet) is designed to directly estimate the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Evelyn Chee , Zhenzhou Wu

Every recent image-to-image translation model inherently requires either image-level (i.e. input-output pairs) or set-level (i.e. domain labels) supervision. However, even set-level supervision can be a severe bottleneck for data collection…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Kyungjune Baek , Yunjey Choi , Youngjung Uh , Jaejun Yoo , Hyunjung Shim

When it comes to clinical images, automatic segmentation has a wide variety of applications and a considerable diversity of input domains, such as different types of Magnetic Resonance Images (MRIs) and Computerized Tomography (CT) scans.…

Image and Video Processing · Electrical Eng. & Systems 2024-02-28 Matteo Bastico , David Ryckelynck , Laurent Corté , Yannick Tillier , Etienne Decencière

Image translation across different domains has attracted much attention in both machine learning and computer vision communities. Taking the translation from source domain $\mathcal{D}_s$ to target domain $\mathcal{D}_t$ as an example,…

Computer Vision and Pattern Recognition · Computer Science 2019-05-30 Jianxin Lin , Yingce Xia , Yijun Wang , Tao Qin , Zhibo Chen

Multimodal image registration is a challenging but essential step for numerous image-guided procedures. Most registration algorithms rely on the computation of complex, frequently non-differentiable similarity metrics to deal with the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Matteo Ronchetti , Wolfgang Wein , Nassir Navab , Oliver Zettinig , Raphael Prevost

We present a fast learning-based algorithm for deformable, pairwise 3D medical image registration. Current registration methods optimize an objective function independently for each pair of images, which can be time-consuming for large…

Computer Vision and Pattern Recognition · Computer Science 2019-03-14 Guha Balakrishnan , Amy Zhao , Mert R. Sabuncu , John Guttag , Adrian V. Dalca

We propose contrastive coding to learn shared, dense image representations, referred to as CoMIRs (Contrastive Multimodal Image Representations). CoMIRs enable the registration of multimodal images where existing registration methods often…

Computer Vision and Pattern Recognition · Computer Science 2021-01-14 Nicolas Pielawski , Elisabeth Wetzer , Johan Öfverstedt , Jiahao Lu , Carolina Wählby , Joakim Lindblad , Nataša Sladoje

Unsupervised learning strategy is widely adopted by the deformable registration models due to the lack of ground truth of deformation fields. These models typically depend on the intensity-based similarity loss to obtain the learning…

Image and Video Processing · Electrical Eng. & Systems 2021-12-21 Luyi Han , Haoran Dou , Yunzhi Huang , Pew-Thian Yap

Multi-modal learning has emerged as an increasingly promising avenue in vision recognition, driving innovations across diverse domains ranging from media and education to healthcare and transportation. Despite its success, the robustness of…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Tiantian Feng , Daniel Yang , Digbalay Bose , Shrikanth Narayanan

Learning non-rigid registration in an end-to-end manner is challenging due to the inherent high degrees of freedom and the lack of labeled training data. In this paper, we resolve these two challenges simultaneously. First, we propose to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Wanquan Feng , Juyong Zhang , Hongrui Cai , Haofei Xu , Junhui Hou , Hujun Bao

Multi-modal image registration spatially aligns two images with different distributions. One of its major challenges is that images acquired from different imaging machines have different imaging distributions, making it difficult to focus…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Lingke Kong , X. Sharon Qi , Qijin Shen , Jiacheng Wang , Jingyi Zhang , Yanle Hu , Qichao Zhou

State-of-the-art deep neural network models have reached near perfect face recognition accuracy rates on controlled high-resolution face images. However, their performance is drastically degraded when they are tested with very…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Vahid Reza Khazaie , Nicky Bayat , Yalda Mohsenzadeh

Image-to-image translation (I2I) is a fundamental task in computer vision, focused on mapping an input image from a source domain to a corresponding image in a target domain while preserving domain-invariant features and adapting…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Feiyu Tan , Heran Yang , Qihong Duan , Kai Ye , Qi Xie , Deyu Meng