English
Related papers

Related papers: Mono-Modalizing Extremely Heterogeneous Multi-Moda…

200 papers

We present a cross-modality generation framework that learns to generate translated modalities from given modalities in MR images without real acquisition. Our proposed method performs NeuroImage-to-NeuroImage translation (abbreviated as…

Computer Vision and Pattern Recognition · Computer Science 2018-09-12 Qianye Yang , Nannan Li , Zixu Zhao , Xingyu Fan , Eric I-Chao Chang , Yan Xu

Medical multimodal representation learning aims to integrate heterogeneous data into unified patient representations to support clinical outcome prediction. However, real-world medical datasets commonly contain systematic biases from…

Machine Learning · Computer Science 2026-05-19 Xiaoguang Zhu , Linxiao Gong , Lianlong Sun , Yang Liu , Haoyu Wang , Jing Liu

Image registration is a critical component in the applications of various medical image analyses. In recent years, there has been a tremendous surge in the development of deep learning (DL)-based medical image registration models. This…

Image and Video Processing · Electrical Eng. & Systems 2022-04-26 Subrato Bharati , M. Rubaiyat Hossain Mondal , Prajoy Podder , V. B. Surya Prasath

Medical image challenges have played a transformative role in advancing the field, catalyzing innovation and establishing new performance benchmarks. Image registration, a foundational task in neuroimaging, has similarly advanced through…

Conventional medical image registration approaches directly optimize over the parameters of a transformation model. These approaches have been highly successful and are used generically for registrations of different anatomical regions.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Lin Tian , Hastings Greer , Roland Kwitt , Francois-Xavier Vialard , Raul San Jose Estepar , Sylvain Bouix , Richard Rushmore , Marc Niethammer

Image registration is a fundamental issue in multispectral image processing. In filter wheel based multispectral imaging systems, the non-coplanar placement of the filters always causes the misalignment of multiple channel images. The…

Computer Vision and Pattern Recognition · Computer Science 2018-02-14 Shu-Jie Chen , Hui-Liang Shen

We present an implementation of a new approach to diffeomorphic non-rigid registration of medical images. The method is based on optical flow and warps images via gradient flow with the standard $L^2$ inner product. To compute the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-25 Daniel Grzech , Loïc le Folgoc , Mattias P. Heinrich , Bishesh Khanal , Jakub Moll , Julia A. Schnabel , Ben Glocker , Bernhard Kainz

Multi-modal image registration is a challenging problem that is also an important clinical task for many real applications and scenarios. As a first step in analysis, deformable registration among different image modalities is often…

Image and Video Processing · Electrical Eng. & Systems 2020-07-21 Fengze Liu , Jinzheng Cai , Yuankai Huo , Chi-Tung Cheng , Ashwin Raju , Dakai Jin , Jing Xiao , Alan Yuille , Le Lu , ChienHung Liao , Adam P Harrison

Deformable image registration (alignment) is highly sought after in numerous clinical applications, such as computer aided diagnosis and disease progression analysis. Deep Convolutional Neural Network (DCNN)-based image registration methods…

Image and Video Processing · Electrical Eng. & Systems 2024-05-17 Ruizhe Li , Grazziela Figueredo , Dorothee Auer , Christian Wagner , Xin Chen

Deep learning has emerged as a promising approach for learning the nonlinear mapping between diffusion-weighted MR images and tissue parameters, which enables automatic and deep understanding of the brain microstructures. However, the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Wenxin Fan , Jian Cheng , Qiyuan Tian , Ruoyou Wu , Juan Zou , Zan Chen , Shanshan Wang

Magnetic resonance imaging (MRI) is a widely used neuroimaging technique that can provide images of different contrasts (i.e., modalities). Fusing this multi-modal data has proven particularly effective for boosting model performance in…

Computer Vision and Pattern Recognition · Computer Science 2020-02-13 Tao Zhou , Huazhu Fu , Geng Chen , Jianbing Shen , Ling Shao

With the rapid advancement of remote sensing technology, high-resolution multi-modal imagery is now more widely accessible. Conventional Object detection models are trained on a single dataset, often restricted to a specific imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Yuxuan Li , Xiang Li , Yunheng Li , Yicheng Zhang , Yimian Dai , Qibin Hou , Ming-Ming Cheng , Jian Yang

Multi-modal medical images provide complementary soft-tissue characteristics that aid in the screening and diagnosis of diseases. However, limited scanning time, image corruption and various imaging protocols often result in incomplete…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Yue Zhang , Chengtao Peng , Qiuli Wang , Dan Song , Kaiyan Li , S. Kevin Zhou

Multimodal medical analysis combining image and tabular data has gained increasing attention. However, effective fusion remains challenging due to cross-modal discrepancies in feature dimensions and modality contributions, as well as the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Congjing Yu , Jing Ye , Yang Liu , Xiaodong Zhang , Zhiyong Zhang

Despite current advancement in the field of biomedical image processing, propelled by the deep learning revolution, multimodal image registration, due to its several challenges, is still often performed manually by specialists. The recent…

Image and Video Processing · Electrical Eng. & Systems 2022-11-30 Jiahao Lu , Johan Öfverstedt , Joakim Lindblad , Nataša Sladoje

Accurate intraoperative image guidance is critical for achieving maximal safe resection in brain tumor surgery, yet neuronavigation systems based on preoperative MRI lose accuracy during the procedure due to brain shift. Aligning…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Reuben Dorent , Laura Rigolo , Colin P. Galvin , Junyu Chen , Mattias P. Heinrich , Aaron Carass , Olivier Colliot , Demian Wassermann , Alexandra Golby , Tina Kapur , William Wells

Current approaches for deformable medical image registration often struggle to fulfill all of the following criteria: versatile applicability, small computation or training times, and the being able to estimate large deformations.…

Image and Video Processing · Electrical Eng. & Systems 2021-12-07 Hanna Siebert , Lasse Hansen , Mattias P. Heinrich

Non-rigid registration is a necessary but challenging task in medical imaging studies. Recently, unsupervised registration models have shown good performance, but they often require a large-scale training dataset and long training times.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Heejung Park , Gyeong Min Lee , Soopil Kim , Ga Hyung Ryu , Areum Jeong , Sang Hyun Park , Min Sagong

Positron emission tomography (PET) combined with computed tomography (CT) imaging is routinely used in cancer diagnosis and prognosis by providing complementary information. Automatically segmenting tumors in PET/CT images can significantly…

Image and Video Processing · Electrical Eng. & Systems 2024-03-29 Jinpeng Lu , Jingyun Chen , Linghan Cai , Songhan Jiang , Yongbing Zhang

Deformable image registration plays an essential role in various medical image tasks. Existing deep learning-based deformable registration frameworks primarily utilize convolutional neural networks (CNNs) or Transformers to learn features…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Jiong Wu , Kuang Gong