English
Related papers

Related papers: Multi-modal Medical Neurological Image Fusion usin…

200 papers

Gigapixel medical images provide massive data, both morphological textures and spatial information, to be mined. Due to the large data scale in histology, deep learning methods play an increasingly significant role as feature extractors.…

Image and Video Processing · Electrical Eng. & Systems 2022-06-16 Yiqing Shen , Bingxin Zhou , Xinye Xiong , Ruitian Gao , Yu Guang Wang

With the increasing use of surgical robots in clinical practice, enhancing their ability to process multimodal medical images has become a key research challenge. Although traditional medical image fusion methods have made progress in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Qinhua Xie , Hao Tang

While CNN-based methods have been the cornerstone of medical image segmentation due to their promising performance and robustness, they suffer from limitations in capturing long-range dependencies. Transformer-based approaches are currently…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Reza Azad , Yiwei Jia , Ehsan Khodapanah Aghdam , Julien Cohen-Adad , Dorit Merhof

The aim of multispectral image fusion is to combine object or scene features of images with different spectral characteristics to increase the perceptual quality. In this paper, we present a novel learning-based solution to image fusion…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Ferhat Can Ataman , Gözde Bozdaği Akar

Polyps segmentation poses a significant challenge in medical imaging due to the flat surface of polyps and their texture similarity to surrounding tissues. This similarity gives rise to difficulties in establishing a clear boundary between…

Image and Video Processing · Electrical Eng. & Systems 2023-11-29 Juntong Fan , Debesh Jha , Tieyong Zeng , Dayang Wang

In this work, we propose a novel Convolutional Neural Network (CNN) architecture for the joint detection and matching of feature points in images acquired by different sensors using a single forward pass. The resulting feature detector is…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Elad Ben Baruch , Yosi Keller

The precise subtype classification of myeloproliferative neoplasms (MPNs) based on multimodal information, which assists clinicians in diagnosis and long-term treatment plans, is of great clinical significance. However, it remains a great…

Image and Video Processing · Electrical Eng. & Systems 2024-07-12 Yuan Zhang , Yaolei Qi , Xiaoming Qi , Yongyue Wei , Guanyu Yang

Cross-modality magnetic resonance (MR) image synthesis can be used to generate missing modalities from given ones. Existing (supervised learning) methods often require a large number of paired multi-modal data to train an effective…

Image and Video Processing · Electrical Eng. & Systems 2023-06-21 Yonghao Li , Tao Zhou , Kelei He , Yi Zhou , Dinggang Shen

Point clouds are a very efficient way to represent volumetric data in medical imaging. First, they do not occupy resources for empty spaces and therefore can avoid trade-offs between resolution and field-of-view for voxel-based 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Mattias Paul Heinrich

This study introduces a novel method that transforms multimodal physiological signalsphotoplethysmography (PPG), galvanic skin response (GSR), and acceleration (ACC) into 2D image matrices to enhance stress detection using convolutional…

Machine Learning · Computer Science 2025-09-18 Yasin Hasanpoor , Bahram Tarvirdizadeh , Khalil Alipour , Mohammad Ghamari

Deep convolutional neural networks have significantly boosted the performance of fundus image segmentation when test datasets have the same distribution as the training datasets. However, in clinical practice, medical images often exhibit…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Shujun Wang , Lequan Yu , Kang Li , Xin Yang , Chi-Wing Fu , Pheng-Ann Heng

This paper proposes a novel multimodal fusion approach, aiming to produce best possible decisions by integrating information coming from multiple media. While most of the past multimodal approaches either work by projecting the features of…

Artificial Intelligence · Computer Science 2018-08-23 Valentin Vielzeuf , Alexis Lechervy , Stéphane Pateux , Frédéric Jurie

Instance segmentation is an important task for biomedical and biological image analysis. Due to the complicated background components, the high variability of object appearances, numerous overlapping objects, and ambiguous object…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Dongnan Liu , Donghao Zhang , Yang Song , Heng Huang , Weidong Cai

Multimodal image fusion (MMIF) integrates information from different modalities to obtain a comprehensive image, aiding downstream tasks. However, existing research focuses on complementary information fusion and training strategies,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Dan He , Guofen Wang , Weisheng Li , Yucheng Shu , Wenbo Li , Lijian Yang , Yuping Huang , Feiyan Li

Multimodal MRIs play a crucial role in clinical diagnosis and treatment. Feature disentanglement (FD)-based methods, aiming at learning superior feature representations for multimodal data analysis, have achieved significant success in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Tianling Liu , Hongying Liu , Fanhua Shang , Lequan Yu , Tong Han , Liang Wan

In clinical practice, tri-modal medical image fusion, compared to the existing dual-modal technique, can provide a more comprehensive view of the lesions, aiding physicians in evaluating the disease's shape, location, and biological…

Image and Video Processing · Electrical Eng. & Systems 2024-10-16 Yushen Xu , Xiaosong Li , Yuchan Jie , Haishu Tan

This study focuses on the classification of cancerous and healthy slices from multimodal lung images. The data used in the research comprises Computed Tomography (CT) and Positron Emission Tomography (PET) images. The proposed strategy…

Image and Video Processing · Electrical Eng. & Systems 2025-02-04 Surochita Pal , Sushmita Mitra

We address the multi-focus image fusion problem, where multiple images captured with different focal settings are to be fused into an all-in-focus image of higher quality. Algorithms for this problem necessarily admit the source image…

Computer Vision and Pattern Recognition · Computer Science 2019-05-06 Farshad G. Veshki , Sergiy A. Vorobyov

The use of multimodal imaging has led to significant improvements in the diagnosis and treatment of many diseases. Similar to clinical practice, some works have demonstrated the benefits of multimodal fusion for automatic segmentation and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 José Morano , Guilherme Aresta , Christoph Grechenig , Ursula Schmidt-Erfurth , Hrvoje Bogunović

The development of medical image segmentation using deep learning can significantly support doctors' diagnoses. Deep learning needs large amounts of data for training, which also requires data augmentation to extend diversity for preventing…

Image and Video Processing · Electrical Eng. & Systems 2023-04-27 Xiaoqing Liu , Kenji Ono , Ryoma Bise