English
Related papers

Related papers: ProtoMedX: Towards Explainable Multi-Modal Prototy…

200 papers

Pathological diagnosis remains the definitive standard for identifying tumors. The rise of multimodal large models has simplified the process of integrating image analysis with textual descriptions. Despite this advancement, the substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Xiaomin Wu , Rui Xu , Pengchen Wei , Wenkang Qin , Peixiang Huang , Ziheng Li , Lin Luo

Computer-assisted diagnostic and prognostic systems of the future should be capable of simultaneously processing multimodal data. Multimodal deep learning (MDL), which involves the integration of multiple sources of data, such as images and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Zhaoyi Sun , Mingquan Lin , Qingqing Zhu , Qianqian Xie , Fei Wang , Zhiyong Lu , Yifan Peng

Physical experiments often involve multiple imaging representations, such as X-ray scans and microscopic images. Deep learning models have been widely used for supervised analysis in these experiments. Combining different image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Nadav Schneider , Muriel Tzdaka , Galit Sturm , Guy Lazovski , Galit Bar , Gilad Oren , Raz Gvishi , Gal Oren

Machine learning methods in healthcare have traditionally focused on using data from a single modality, limiting their ability to effectively replicate the clinical practice of integrating multiple sources of information for improved…

Machine Learning · Computer Science 2024-02-13 Felix Krones , Umar Marikkar , Guy Parsons , Adam Szmul , Adam Mahdi

Deep learning has revolutionized biomedical research by providing sophisticated methods to handle complex, high-dimensional data. Multimodal deep learning (MDL) further enhances this capability by integrating diverse data types such as…

Machine Learning · Computer Science 2026-03-13 Valerio Guarrasi , Fatih Aksu , Camillo Maria Caruso , Francesco Di Feola , Aurora Rofena , Filippo Ruffini , Paolo Soda

Despite the fact that Artificial Intelligence (AI) has boosted the achievement of remarkable results across numerous data analysis tasks, however, this is typically accompanied by a significant shortcoming in the exhibited transparency and…

Medical multimodal representation learning aims to integrate heterogeneous clinical data into unified patient representations to support predictive modeling, which remains an essential yet challenging task in the medical data mining…

Machine Learning · Computer Science 2025-09-09 Xiaoguang Zhu , Lianlong Sun , Yang Liu , Pengyi Jiang , Uma Srivatsa , Nipavan Chiamvimonvat , Vladimir Filkov

Although machine learning (ML) models of AI achieve high performances in medicine, they are not free of errors. Empowering clinicians to identify incorrect model recommendations is crucial for engendering trust in medical AI. Explainable AI…

Artificial Intelligence · Computer Science 2022-12-20 Isil Guzey , Ozlem Ucar , Nukhet Aladag Ciftdemir , Betul Acunas

Deep learning integration into medical imaging systems has transformed disease detection and diagnosis processes with a focus on pneumonia identification. The study introduces an intricate deep learning system using Convolutional Neural…

Image and Video Processing · Electrical Eng. & Systems 2025-10-02 P K Dutta , Anushri Chowdhury , Anouska Bhattacharyya , Shakya Chakraborty , Sujatra Dey

Artificial Intelligence has emerged as a useful aid in numerous clinical applications for diagnosis and treatment decisions. Deep neural networks have shown same or better performance than clinicians in many tasks owing to the rapid…

Image and Video Processing · Electrical Eng. & Systems 2021-11-05 Zohaib Salahuddin , Henry C Woodruff , Avishek Chatterjee , Philippe Lambin

Explainable Artificial Intelligence (XAI) is an emerging research topic of machine learning aimed at unboxing how AI systems' black-box choices are made. This research field inspects the measures and models involved in decision-making and…

Artificial Intelligence · Computer Science 2021-02-04 Guang Yang , Qinghao Ye , Jun Xia

Many diagnostic and therapeutic clinical tasks for prostate cancer increasingly rely on multi-parametric MRI. Automating these tasks is challenging because they necessitate expert interpretations, which are difficult to scale to capitalise…

Computer vision has shown promising results in medical image processing. Pneumothorax is a deadly condition and if not diagnosed and treated at time then it causes death. It can be diagnosed with chest X-ray images. We need an expert and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Karan Jakhar , Avneet Kaur , Meenu Gupta

Humans make accurate decisions by interpreting complex data from multiple sources. Medical diagnostics, in particular, often hinge on human interpretation of multi-modal information. In order for artificial intelligence to make progress in…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Faisal Mahmood , Ziyun Yang , Thomas Ashley , Nicholas J. Durr

Pneumonia has been one of the major causes of morbidities and mortality in the world and the prevalence of this disease is disproportionately high among the pediatric and elderly populations especially in resources trained areas Fast and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Sathish Krishna Anumula , Vetrivelan Tamilmani , Aniruddha Arjun Singh , Dinesh Rajendran , Venkata Deepak Namburi

Recent advancements in mixed-modal generative have opened new avenues for developing unified biomedical assistants capable of analyzing biomedical images, answering complex questions about them, and generating multimodal patient reports.…

Artificial Intelligence · Computer Science 2025-04-24 Hritik Bansal , Daniel Israel , Siyan Zhao , Shufan Li , Tung Nguyen , Aditya Grover

Dermatological diagnosis automation is essential in addressing the high prevalence of skin diseases and critical shortage of dermatologists. Despite approaching expert-level diagnosis performance, convolutional neural network (ConvNet)…

Image and Video Processing · Electrical Eng. & Systems 2022-10-04 Raluca Jalaboi , Frederik Faye , Mauricio Orbes-Arteaga , Dan Jørgensen , Ole Winther , Alfiia Galimzianova

With the advancements in computer technology, there is a rapid development of intelligent systems to understand the complex relationships in data to make predictions and classifications. Artificail Intelligence based framework is rapidly…

Machine Learning · Computer Science 2021-07-30 G Jignesh Chowdary , Suganya G , Premalatha M , Asnath Victy Phamila Y , Karunamurthy K

A novel deep learning architecture (XmasNet) based on convolutional neural networks was developed for the classification of prostate cancer lesions, using the 3D multiparametric MRI data provided by the PROSTATEx challenge. End-to-end…

Computer Vision and Pattern Recognition · Computer Science 2017-03-14 Saifeng Liu , Huaixiu Zheng , Yesu Feng , Wei Li

Automated skin lesion classification using deep learning has shown remarkable accuracy, yet clinical adoption remains limited due to the "black box" nature of these models. We present MelanomaNet, an explainable deep learning system for…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Sukhrobbek Ilyosbekov