English
Related papers

Related papers: Generation of Multimodal Justification Using Visua…

200 papers

In this paper, our focus is on constructing models to assist a clinician in the diagnosis of COVID-19 patients in situations where it is easier and cheaper to obtain X-ray data than to obtain high-quality images like those from CT scans.…

Image and Video Processing · Electrical Eng. & Systems 2021-02-15 Rishab Khincha , Soundarya Krishnan , Tirtharaj Dash , Lovekesh Vig , Ashwin Srinivasan

The widespread use of deep neural networks has achieved substantial success in many tasks. However, there still exists a huge gap between the operating mechanism of deep learning models and human-understandable decision making, so that…

Artificial Intelligence · Computer Science 2021-03-08 Xiaowei Zhou , Jie Yin , Ivor Tsang , Chen Wang

Explaining Deep Learning models is becoming increasingly important in the face of daily emerging multimodal models, particularly in safety-critical domains like medical imaging. However, the lack of detailed investigations into the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Anees Ur Rehman Hashmi , Dwarikanath Mahapatra , Mohammad Yaqub

Neural networks have recently been established as a viable classification method for imaging mass spectrometry data for tumor typing. For multi-laboratory scenarios however, certain confounding factors may strongly impede their performance.…

In mission-critical domains such as law enforcement and medical diagnosis, the ability to explain and interpret the outputs of deep learning models is crucial for ensuring user trust and supporting informed decision-making. Despite…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Bharat Chandra Yalavarthi , Nalini Ratha

One of the primary challenges faced by deep learning is the degree to which current methods exploit superficial statistics and dataset bias, rather than learning to generalise over the specific representations they have experienced. This is…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Damien Teney , Peng Wang , Jiewei Cao , Lingqiao Liu , Chunhua Shen , Anton van den Hengel

Convolutional neural networks (CNNs) define the current state-of-the-art for image recognition. With their emerging popularity, especially for critical applications like medical image analysis or self-driving cars, confirmability is…

Computer Vision and Pattern Recognition · Computer Science 2018-01-08 Keyang Zhou , Bernhard Kainz

The application of deep learning models in medical diagnosis has showcased considerable efficacy in recent years. Nevertheless, a notable limitation involves the inherent lack of explainability during decision-making processes. This study…

Image and Video Processing · Electrical Eng. & Systems 2024-05-01 Konstantinos Pasvantis , Eftychios Protopapadakis

Interpretable deep learning models have received widespread attention in the field of image recognition. Due to the unique multi-instance learning of medical images and the difficulty in identifying decision-making regions, many…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Yitao Peng , Lianghua He , Die Hu , Yihang Liu , Longzhen Yang , Shaohua Shang

The clinical adoption of artificial intelligence (AI) in medical diagnostics is critically hampered by its black-box nature, which prevents clinicians from verifying the rationale behind automated decisions. To overcome this fundamental…

In recent years, concepts and methods of complex networks have been employed to tackle the word sense disambiguation (WSD) task by representing words as nodes, which are connected if they are semantically similar. Despite the increasingly…

Computation and Language · Computer Science 2018-02-27 Edilson A. Correa , Alneu de Andrade Lopes , Diego R. Amancio

Many high-performance models suffer from a lack of interpretability. There has been an increasing influx of work on explainable artificial intelligence (XAI) in order to disentangle what is meant and expected by XAI. Nevertheless, there is…

Machine Learning · Computer Science 2019-10-23 Adrien Bennetot , Jean-Luc Laurent , Raja Chatila , Natalia Díaz-Rodríguez

Deep learning methods have proven extremely effective at performing a variety of medical image analysis tasks. With their potential use in clinical routine, their lack of transparency has however been one of their few weak points, raising…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Minh H. Vu , Tommy Löfstedt , Tufve Nyholm , Raphael Sznitman

Traditionally, for most machine learning settings, gaining some degree of explainability that tries to give users more insights into how and why the network arrives at its predictions, restricts the underlying model and hinders performance…

Machine Learning · Computer Science 2021-04-06 Robin M. Schmidt

We propose DeepMiner, a framework to discover interpretable representations in deep neural networks and to build explanations for medical predictions. By probing convolutional neural networks (CNNs) trained to classify cancer in mammograms,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Jimmy Wu , Bolei Zhou , Diondra Peck , Scott Hsieh , Vandana Dialani , Lester Mackey , Genevieve Patterson

Deep learning methods have been very effective for a variety of medical diagnostic tasks and has even beaten human experts on some of those. However, the black-box nature of the algorithms has restricted clinical use. Recent explainability…

Computer Vision and Pattern Recognition · Computer Science 2020-05-29 Amitojdeep Singh , Sourya Sengupta , Vasudevan Lakshminarayanan

We present DiffExplainer, a novel framework that, leveraging language-vision models, enables multimodal global explainability. DiffExplainer employs diffusion models conditioned on optimized text prompts, synthesizing images that maximize…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Matteo Pennisi , Giovanni Bellitto , Simone Palazzo , Mubarak Shah , Concetto Spampinato

In many practical applications, deep neural networks have been typically deployed to operate as a black box predictor. Despite the high amount of work on interpretability and high demand on the reliability of these systems, they typically…

Artificial Intelligence · Computer Science 2020-12-07 Martin Stano , Wanda Benesova , Lukas Samuel Martak

Classification of document images is a critical step for archival of old manuscripts, online subscription and administrative procedures. Computer vision and deep learning have been suggested as a first solution to classify documents based…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Nicolas Audebert , Catherine Herold , Kuider Slimani , Cédric Vidal

Recent studies show that deep learning models achieve good performance on medical imaging tasks such as diagnosis prediction. Among the models, multimodality has been an emerging trend, integrating different forms of data such as chest…

Machine Learning · Computer Science 2022-02-10 Haodi Zhang , Chenyu Xu , Peirou Liang , Ke Duan , Hao Ren , Weibin Cheng , Kaishun Wu