English
Related papers

Related papers: Brain Image Synthesis with Unsupervised Multivaria…

200 papers

Multimodal change detection (MMCD) identifies changed areas in multimodal remote sensing (RS) data, demonstrating significant application value in land use monitoring, disaster assessment, and urban sustainable development. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Xuanguang Liu , Lei Ding , Yujie Li , Chenguang Dai , Zhenchao Zhang , Mengmeng Li , Ziyi Yang , Yifan Sun , Yongqi Sun , Hanyun Wang

Unsupervised domain adaptation (UDA) for cross-modality medical image segmentation has shown great progress by domain-invariant feature learning or image appearance translation. Adapted feature learning usually cannot detect domain shifts…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Guodong Zeng , Till D. Lerch , Florian Schmaranzer , Guoyan Zheng , Juergen Burger , Kate Gerber , Moritz Tannast , Klaus Siebenrock , Nicolas Gerber

Image classification models often demonstrate unstable performance in real-world applications due to variations in image information, driven by differing visual perspectives of subject objects and lighting discrepancies. To mitigate these…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Yuze Zheng , Zixuan Li , Xiangxian Li , Jinxing Liu , Yuqing Wang , Xiangxu Meng , Lei Meng

Retinal diseases spanning a broad spectrum can be effectively identified and diagnosed using complementary signals from multimodal data. However, multimodal diagnosis in ophthalmic practice is typically challenged in terms of data…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Lu Zhang , Huizhen Yu , Zuowei Wang , Fu Gui , Yatu Guo , Wei Zhang , Mengyu Jia

Multimodal Magnetic Resonance (MR) Imaging plays a crucial role in disease diagnosis due to its ability to provide complementary information by analyzing a relationship between multimodal images on the same subject. Acquiring all MR…

Image and Video Processing · Electrical Eng. & Systems 2024-02-02 Jihoon Cho , Xiaofeng Liu , Fangxu Xing , Jinsong Ouyang , Georges El Fakhri , Jinah Park , Jonghye Woo

When it comes to clinical images, automatic segmentation has a wide variety of applications and a considerable diversity of input domains, such as different types of Magnetic Resonance Images (MRIs) and Computerized Tomography (CT) scans.…

Image and Video Processing · Electrical Eng. & Systems 2024-02-28 Matteo Bastico , David Ryckelynck , Laurent Corté , Yannick Tillier , Etienne Decencière

Precision medicine in the quantitative management of chronic diseases and oncology would be greatly improved if the Computed Tomography (CT) scan of any patient could be segmented, parsed and analyzed in a precise and detailed way. However,…

In this technical note, we address an unresolved challenge in neuroimaging statistics: how to determine which of several datasets is the best for inferring neuronal responses. Comparisons of this kind are important for experimenters when…

The task of medical image segmentation commonly involves an image reconstruction step to convert acquired raw data to images before any analysis. However, noises, artifacts and loss of information due to the reconstruction process are…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Qiaoying Huang , Xiao Chen , Dimitris Metaxas , Mariappan S. Nadar

State-of-the-art deep learning algorithms generally require large amounts of data for model training. Lack thereof can severely deteriorate the performance, particularly in scenarios with fine-grained boundaries between categories. To this…

Computer Vision and Pattern Recognition · Computer Science 2018-06-15 Frederik Pahde , Patrick Jähnichen , Tassilo Klein , Moin Nabi

In medical imaging, image synthesis is the estimation process of one image (sequence, modality) from another image (sequence, modality). Since images with different modalities provide diverse biomarkers and capture various features,…

Image and Video Processing · Electrical Eng. & Systems 2023-05-26 Firoozeh Shomal Zadeh , Sevda Molani , Maysam Orouskhani , Marziyeh Rezaei , Mehrzad Shafiei , Hossein Abbasi

Multimodal spatiotemporal learning on real-world experimental data is constrained by two challenges: within-modality measurements are sparse, irregular, and noisy (QA/QC artifacts) but cross-modally correlated; the set of available…

Machine Learning · Computer Science 2025-11-05 Kevin Valencia , Thilina Balasooriya , Xihaier Luo , Shinjae Yoo , David Keetae Park

Deciphering brain function through non-invasive recordings requires synthesizing complementary high-frequency electromagnetic (EEG/MEG) and low-frequency metabolic (fMRI) signals. However, despite their shared neural origins, extreme…

Neurons and Cognition · Quantitative Biology 2026-02-26 Changli Tang , Shurui Li , Junliang Wang , Qinfan Xiao , Zhonghao Zhai , Lei Bai , Yu Qiao , Bowen Zhou , Wen Wu , Yuanning Li , Chao Zhang

This study aims to address the problem of incomplete information in unimodal images for semantic segmentation and object detection tasks. Existing multimodal fusion methods suffer from limited capability in discriminative modeling of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Yuchan Jie , Yushen Xu , Xiaosong Li , Huafeng Li , Haishu Tan , Feiping Nie

With the increasing availability of diverse data types, particularly images and time series data from medical experiments, there is a growing demand for techniques designed to combine various modalities of data effectively. Our motivation…

Image and Video Processing · Electrical Eng. & Systems 2024-05-27 Ali Rasekh , Reza Heidari , Amir Hosein Haji Mohammad Rezaie , Parsa Sharifi Sedeh , Zahra Ahmadi , Prasenjit Mitra , Wolfgang Nejdl

Brain tumor segmentation based on multi-modal magnetic resonance imaging (MRI) plays a pivotal role in assisting brain cancer diagnosis, treatment, and postoperative evaluations. Despite the achieved inspiring performance by existing…

Image and Video Processing · Electrical Eng. & Systems 2022-11-16 Haoran Li , Cheng Li , Weijian Huang , Xiawu Zheng , Yan Xi , Shanshan Wang

Medical imaging plays a significant role in clinical practice of medical diagnosis, where the text reports of the images are essential in understanding them and facilitating later treatments. By generating the reports automatically, it is…

Computation and Language · Computer Science 2022-04-29 Zhihong Chen , Yaling Shen , Yan Song , Xiang Wan

In this paper we propose cross-modal convolutional neural networks (X-CNNs), a novel biologically inspired type of CNN architectures, treating gradient descent-specialised CNNs as individual units of processing in a larger-scale network…

Machine Learning · Statistics 2017-09-26 Petar Veličković , Duo Wang , Nicholas D. Lane , Pietro Liò

Multimodal image fusion (MMIF) integrates information from different modalities to obtain a comprehensive image, aiding downstream tasks. However, existing research focuses on complementary information fusion and training strategies,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Dan He , Guofen Wang , Weisheng Li , Yucheng Shu , Wenbo Li , Lijian Yang , Yuping Huang , Feiyan Li

Medical image fusion integrates the complementary diagnostic information of the source image modalities for improved visualization and analysis of underlying anomalies. Recently, deep learning-based models have excelled the conventional…

Image and Video Processing · Electrical Eng. & Systems 2023-10-19 Manisha Das , Deep Gupta , Petia Radeva , Ashwini M Bakde