English
Related papers

Related papers: OSDM-MReg: Multimodal Image Registration based One…

200 papers

Multi-modal object tracking integrates auxiliary modalities such as depth, thermal infrared, event flow, and language to provide additional information beyond RGB images, showing great potential in improving tracking stabilization in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Shiyu Xuan , Zechao Li , Jinhui Tang

Image anomaly detection plays a vital role in applications such as industrial quality inspection and medical imaging, where it directly contributes to improving product quality and system reliability. However, existing methods often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Zekang Weng , Jinjin Shi , Jinwei Wang , Zeming Han

Diffeomorphic image registration is crucial for various medical imaging applications because it can preserve the topology of the transformation. This study introduces DCCNN-LSTM-Reg, a learning framework that evolves dynamically and learns…

Image and Video Processing · Electrical Eng. & Systems 2024-11-06 Jinqiu Deng , Ke Chen , Mingke Li , Daoping Zhang , Chong Chen , Alejandro F. Frangi , Jianping Zhang

Significant achievements in personalization of diffusion models have been witnessed. Conventional tuning-free methods mostly encode multiple reference images by averaging their image embeddings as the injection condition, but such an…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Zhuofan Zong , Dongzhi Jiang , Bingqi Ma , Guanglu Song , Hao Shao , Dazhong Shen , Yu Liu , Hongsheng Li

This paper contributes to the "BraTS 2024 Brain MR Image Synthesis Challenge" and presents a conditional Wavelet Diffusion Model (cWDM) for directly solving a paired image-to-image translation task on high-resolution volumes. While deep…

Image and Video Processing · Electrical Eng. & Systems 2024-11-27 Paul Friedrich , Alicia Durrer , Julia Wolleb , Philippe C. Cattin

Cross-modal data registration has long been a critical task in computer vision, with extensive applications in autonomous driving and robotics. Accurate and robust registration methods are essential for aligning data from different…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Yuanchao Yue , Hui Yuan , Qinglong Miao , Xiaolong Mao , Raouf Hamzaoui , Peter Eisert

Registration of optical and synthetic aperture radar (SAR) remote sensing images serves as a critical foundation for image fusion and visual navigation tasks. This task is particularly challenging because of their modal discrepancy,…

Image and Video Processing · Electrical Eng. & Systems 2025-11-04 Zixuan Sun , Shuaifeng Zhi , Ruize Li , Jingyuan Xia , Yongxiang Liu , Weidong Jiang

Current deep-learning-based registration algorithms often exploit intensity-based similarity measures as the loss function, where dense correspondence between a pair of moving and fixed images is optimized through backpropagation during…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Xinzhe Luo , Xiahai Zhuang

Nonrigid registration is vital to medical image analysis but remains challenging for diffusion MRI (dMRI) due to its high-dimensional, orientation-dependent nature. While classical methods are accurate, they are computationally demanding,…

Image and Video Processing · Electrical Eng. & Systems 2025-01-13 Gianfranco Cortes , Xiaoda Qu , Baba C. Vemuri

Although diffusion models have achieved remarkable progress in multi-modal magnetic resonance imaging (MRI) translation tasks, existing methods still tend to suffer from anatomical inconsistencies or degraded texture details when handling…

Image and Video Processing · Electrical Eng. & Systems 2026-03-16 Jianqiang Lin , Zhiqiang Shen , Peng Cao , Jinzhu Yang , Osmar R. Zaiane , Xiaoli Liu

While image registration has been studied in remote sensing community for decades, registering multimodal data [e.g., optical, LiDAR, SAR, and map] remains a challenging problem because of significant nonlinear intensity differences between…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Yuanxin Ye , Lorenzo Bruzzone , Jie Shan , Francesca Bovolo , Qing Zhu

Annotation variability remains a substantial challenge in medical image segmentation, stemming from ambiguous imaging boundaries and diverse clinical expertise. Traditional deep learning methods producing single deterministic segmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Han Zhang , Xiangde Luo , Yong Chen , Kang Li

Despite their success, unsupervised domain adaptation methods for semantic segmentation primarily focus on adaptation between image domains and do not utilize other abundant visual modalities like depth, infrared and event. This limitation…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Ruihao Xia , Yu Liang , Peng-Tao Jiang , Hao Zhang , Bo Li , Yang Tang , Pan Zhou

Multi-turn compositional image generation (M-CIG) is a challenging task that aims to iteratively manipulate a reference image given a modification text. While most of the existing methods for M-CIG are based on generative adversarial…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Chao Wang

Existing vision-language model (VLM)-based methods for out-of-distribution (OOD) detection typically rely on similarity scores between input images and in-distribution (ID) text prototypes. However, the modality gap between image and text…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yimu Wang , Evelien Riddell , Adrian Chow , Sean Sedwards , Krzysztof Czarnecki

Deformable image registration remains a central challenge in medical image analysis, particularly under multi-modal scenarios where intensity distributions vary significantly across scans. While deep learning methods provide efficient…

Image and Video Processing · Electrical Eng. & Systems 2026-03-30 Yi Zhang , Yidong Zhao , Qian Tao

Multi-modal sensor data fusion takes advantage of complementary or reinforcing information from each sensor and can boost overall performance in applications such as scene classification and target detection. This paper presents a new…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Hersh Vakharia , Xiaoxiao Du

It is highly challenging to register large-scale, heterogeneous SAR and optical images, particularly across platforms, due to significant geometric, radiometric, and temporal differences, which most existing methods struggle to address. To…

Image and Video Processing · Electrical Eng. & Systems 2025-09-04 Xiaochen Wei , Weiwei Guo , Zenghui Zhang , Wenxian Yu

Cross-modality image segmentation aims to segment the target modalities using a method designed in the source modality. Deep generative models can translate the target modality images into the source modality, thus enabling cross-modality…

Image and Video Processing · Electrical Eng. & Systems 2024-04-11 Zihao Wang , Yingyu Yang , Yuzhou Chen , Tingting Yuan , Maxime Sermesant , Herve Delingette , Ona Wu

It is well known that many open-released foundational diffusion models have difficulty in generating images that substantially depart from average brightness, despite such images being present in the training data. This is due to an…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Minghui Hu , Jianbin Zheng , Chuanxia Zheng , Chaoyue Wang , Dacheng Tao , Tat-Jen Cham