English
Related papers

Related papers: Deep Multimodal Guidance for Medical Image Classif…

200 papers

Cancer is a complex disease that provides various types of information depending on the scale of observation. While most tumor diagnostics are performed by observing histopathological slides, radiology images should yield additional…

Image and Video Processing · Electrical Eng. & Systems 2020-10-07 Marvin Lerousseau , Eric Deutsh , Nikos Paragios

Deep learning has received extensive research interest in developing new medical image processing algorithms, and deep learning based models have been remarkably successful in a variety of medical imaging tasks to support disease detection…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Xuxin Chen , Ximin Wang , Ke Zhang , Kar-Ming Fung , Theresa C. Thai , Kathleen Moore , Robert S. Mannel , Hong Liu , Bin Zheng , Yuchen Qiu

Medical image classification is crucial for diagnosis and treatment, benefiting significantly from advancements in artificial intelligence. The paper reviews recent progress in the field, focusing on three levels of solutions: basic,…

Image and Video Processing · Electrical Eng. & Systems 2025-06-06 Loan Dao , Ngoc Quoc Ly

We consider machine-learning-based malignancy prediction and lesion identification from clinical dermatological images, which can be indistinctly acquired via smartphone or dermoscopy capture. Additionally, we do not assume that images…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Meng Xia , Meenal K. Kheterpal , Samantha C. Wong , Christine Park , William Ratliff , Lawrence Carin , Ricardo Henao

In recent advancement towards computer based diagnostics system, the classification of brain tumor images is a challenging task. This paper mainly focuses on elevating the classification accuracy of brain tumor images with transfer learning…

Image and Video Processing · Electrical Eng. & Systems 2022-06-20 Pramit Dutta , Khaleda Akhter Sathi , Md. Saiful Islam

Medical imaging is an essential tool in many areas of medical applications, used for both diagnosis and treatment. However, reading medical images and making diagnosis or treatment recommendations require specially trained medical…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Wentao Zhu

In the past ten years, with the help of deep learning, especially the rapid development of deep neural networks, medical image analysis has made remarkable progress. However, how to effectively use the relational information between various…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Zhihua Liu

Semi-supervised learning addresses the issue of limited annotations in medical images effectively, but its performance is often inadequate for complex backgrounds and challenging tasks. Multi-modal fusion methods can significantly improve…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Dongdong Meng , Sheng Li , Hao Wu , Guoping Wang , Xueqing Yan

Molecular subtyping of breast cancer is crucial for personalized treatment and prognosis. Traditional classification approaches rely on either histopathological images or gene expression profiling, limiting their predictive power. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Amin Honarmandi Shandiz

Many applications in image-guided surgery and therapy require fast and reliable non-linear, multi-modal image registration. Recently proposed unsupervised deep learning-based registration methods have demonstrated superior performance…

Image and Video Processing · Electrical Eng. & Systems 2022-10-07 Gerard Snaauw , Michele Sasdelli , Gabriel Maicas , Stephan Lau , Johan Verjans , Mark Jenkinson , Gustavo Carneiro

Current Computer-Aided Diagnosis (CAD) methods mainly depend on medical images. The clinical information, which usually needs to be considered in practical clinical diagnosis, has not been fully employed in CAD. In this paper, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2021-03-11 Songxiao Yang , Xiabi Liu , Zhongshu Zheng , Wei Wang , Xiaohong Ma

The rising global prevalence of skin conditions, some of which can escalate to life-threatening stages if not timely diagnosed and treated, presents a significant healthcare challenge. This issue is particularly acute in remote areas where…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Mahapara Khurshid , Mayank Vatsa , Richa Singh

Image analysis using more than one modality (i.e. multi-modal) has been increasingly applied in the field of biomedical imaging. One of the challenges in performing the multimodal analysis is that there exist multiple schemes for fusing the…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Zhe Guo , Xiang Li , Heng Huang , Ning Guo , Quanzheng Li

Multimodal learning leverages complementary information derived from different modalities, thereby enhancing performance in medical image segmentation. However, prevailing multimodal learning methods heavily rely on extensive well-annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Xiaogen Zhou , Yiyou Sun , Min Deng , Winnie Chiu Wing Chu , Qi Dou

This paper tries to give a gentle introduction to deep learning in medical image processing, proceeding from theoretical foundations to applications. We first discuss general reasons for the popularity of deep learning, including several…

Computer Vision and Pattern Recognition · Computer Science 2018-12-24 Andreas Maier , Christopher Syben , Tobias Lasser , Christian Riess

Tumor segmentation in multimodal medical images has seen a growing trend towards deep learning based methods. Typically, studies dealing with this topic fuse multimodal image data to improve the tumor segmentation contour for a single…

Image and Video Processing · Electrical Eng. & Systems 2020-09-25 Theresa Neubauer , Maria Wimmer , Astrid Berg , David Major , Dimitrios Lenis , Thomas Beyer , Jelena Saponjski , Katja Bühler

This thesis works to address a pivotal challenge in medical image analysis: the reliance on extensive labeled datasets, which are often limited due to the need for expert annotation and constrained by privacy and legal issues. By focusing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Cristian Simionescu

Healthcare applications are inherently multimodal, benefiting greatly from the integration of diverse data sources. However, the modalities available in clinical settings can vary across different locations and patients. A key area that…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Mohammed Amer , Mohamed A. Suliman , Tu Bui , Nuria Garcia , Serban Georgescu

Deep learning methods have recently made notable advances in the tasks of classification and representation learning. These tasks are important for brain imaging and neuroscience discovery, making the methods attractive for porting to a…

Neural and Evolutionary Computing · Computer Science 2014-02-20 Sergey M. Plis , Devon R. Hjelm , Ruslan Salakhutdinov , Vince D. Calhoun

Multimodal deep learning has been used to predict clinical endpoints and diagnoses from clinical routine data. However, these models suffer from scaling issues: they have to learn pairwise interactions between each piece of information in…