English
Related papers

Related papers: Small Lesions-aware Bidirectional Multimodal Multi…

200 papers

Recent studies show that deep learning models achieve good performance on medical imaging tasks such as diagnosis prediction. Among the models, multimodality has been an emerging trend, integrating different forms of data such as chest…

Machine Learning · Computer Science 2022-02-10 Haodi Zhang , Chenyu Xu , Peirou Liang , Ke Duan , Hao Ren , Weibin Cheng , Kaishun Wu

Multimodal medical imaging plays a pivotal role in clinical diagnosis and research, as it combines information from various imaging modalities to provide a more comprehensive understanding of the underlying pathology. Recently, deep…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Yihao Li , Mostafa El Habib Daho , Pierre-Henri Conze , Rachid Zeghlache , Hugo Le Boité , Ramin Tadayoni , Béatrice Cochener , Mathieu Lamard , Gwenolé Quellec

Gaining insights into the structural and functional mechanisms of the brain has been a longstanding focus in neuroscience research, particularly in the context of understanding and treating neuropsychiatric disorders such as Schizophrenia…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Badhan Mazumder , Lei Wu , Vince D. Calhoun , Dong Hye Ye

Accurate segmentation of organs-at-risk (OARs) is vital for safe and precise radiotherapy and surgery. Most existing studies segment only a limited set of organs or regions, lacking a systematic treatment of OARs segmentation. We present a…

Image and Video Processing · Electrical Eng. & Systems 2025-11-13 Rui Hao , Dayu Tan , Qiankun Li , Chunhou Zheng , Weimin Zhong , Zhigang Zeng

Medical image segmentation is essential for clinical applications such as disease diagnosis, treatment planning, and disease development monitoring because it provides precise morphological and spatial information on anatomical structures…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Moin Safdar , Shahzaib Iqbal , Mubeen Ghafoor , Tariq M. Khan , Imran Razzak , Thantrira Porntaveetus , Hamid Alinejad-Rokny

Multimodal medical image fusion is a crucial task that combines complementary information from different imaging modalities into a unified representation, thereby enhancing diagnostic accuracy and treatment planning. While deep learning…

Image and Video Processing · Electrical Eng. & Systems 2024-11-19 Meng Zhou , Yuxuan Zhang , Xiaolan Xu , Jiayi Wang , Farzad Khalvati

Multimodal neuroimaging provides complementary structural and functional insights into both human brain organization and disease-related dynamics. Recent studies demonstrate enhanced diagnostic sensitivity for Alzheimer's disease (AD)…

Multimedia · Computer Science 2025-04-24 Yuxiang Wei , Yanteng Zhang , Xi Xiao , Tianyang Wang , Xiao Wang , Vince D. Calhoun

Accurately segmenting blood vessels in retinal fundus images is crucial in the early screening, diagnosing, and evaluating some ocular diseases, yet it poses a nontrivial uncertainty for the segmentation task due to various factors such as…

Image and Video Processing · Electrical Eng. & Systems 2023-06-29 Yuanyuan Peng , Pengpeng Luan , Zixu Zhang

Deformable medical image registration is a crucial aspect of medical image analysis. In recent years, researchers have begun leveraging auxiliary tasks (such as supervised segmentation) to provide anatomical structure information for the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Hongchao Zhou , Shunbo Hu

Multimodal medical imaging provides complementary information that is crucial for accurate delineation of pathology, but the development of deep learning models is limited by the scarcity of large datasets in which different modalities are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Arunkumar V , Firos V M , Senthilkumar S , Gangadharan G R

Multimodal learning mimics the reasoning process of the human multi-sensory system, which is used to perceive the surrounding world. While making a prediction, the human brain tends to relate crucial cues from multiple sources of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Lang Su , Chuqing Hu , Guofa Li , Dongpu Cao

A precise assessment of the risk of breast lesions can greatly lower it and assist physicians in choosing the best course of action. To categorise breast lesions, the majority of current computer-aided systems only use characteristics from…

Image and Video Processing · Electrical Eng. & Systems 2025-08-25 Muhaisin Tiyumba Nantogmah , Abdul-Barik Alhassan , Salamudeen Alhassan

Retinal diseases can cause irreversible vision loss in both eyes if not diagnosed and treated early. Since retinal diseases are so complicated, retinal imaging is likely to show two or more abnormalities. Current deep learning techniques…

Image and Video Processing · Electrical Eng. & Systems 2024-07-04 Tariq M Khan , Shahzaib Iqbal , Syed S. Naqvi , Imran Razzak , Erik Meijering

Clinically, automated polyp segmentation techniques have the potential to significantly improve the efficiency and accuracy of medical diagnosis, thereby reducing the risk of colorectal cancer in patients. Unfortunately, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Junzhuo Liu , Qiaosong Chen , Ye Zhang , Zhixiang Wang , Deng Xin , Jin Wang

Multimodal medical image fusion (MMIF) aims to integrate images from different modalities to produce a comprehensive image that enhances medical diagnosis by accurately depicting organ structures, tissue textures, and metabolic information.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Tao Luo , Weihua Xu

Accurate medical image segmentation allows for the precise delineation of anatomical structures and pathological regions, which is essential for treatment planning, surgical navigation, and disease monitoring. Both CNN-based and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Libin Lan , Yanxin Li , Xiaojuan Liu , Juan Zhou , Jianxun Zhang , Nannan Huang , Yudong Zhang

In recent years, deep learning has shown near-expert performance in segmenting complex medical tissues and tumors. However, existing models are often task-specific, with performance varying across modalities and anatomical regions.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 T-Mai Bui , Fares Bougourzi , Fadi Dornaika , Vinh Truong Hoang

The UNet architecture, based on Convolutional Neural Networks (CNN), has demonstrated its remarkable performance in medical image analysis. However, it faces challenges in capturing long-range dependencies due to the limited receptive…

Image and Video Processing · Electrical Eng. & Systems 2023-07-28 Liang Xu , Mingxiao Chen , Yi Cheng , Pengfei Shao , Shuwei Shen , Peng Yao , Ronald X. Xu

Medical image segmentation, a critical application of semantic segmentation in healthcare, has seen significant advancements through specialized computer vision techniques. While deep learning-based medical image segmentation is essential…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Fuchen Zheng , Quanjun Li , Weixuan Li , Xuhang Chen , Yihang Dong , Guoheng Huang , Chi-Man Pun , Shoujun Zhou

In this paper, an innovative multi-modal deep learning model is proposed to deeply integrate heterogeneous information from medical images and clinical reports. First, for medical images, convolutional neural networks were used to extract…

Machine Learning · Computer Science 2024-05-29 Ziyan Yao , Fei Lin , Sheng Chai , Weijie He , Lu Dai , Xinghui Fei