English
Related papers

Related papers: Interpreting Medical Image Classifiers by Optimiza…

200 papers

Most of the saliency methods are evaluated on their ability to generate saliency maps, and not on their functionality in a complete vision pipeline, like for instance, image classification. In the current paper, we propose an approach which…

Computer Vision and Pattern Recognition · Computer Science 2021-02-04 Carola Figueroa-Flores , Bogdan Raducanu , David Berga , Joost van de Weijer

In some medical imaging tasks and other settings where only small parts of the image are informative for the classification task, traditional CNNs can sometimes struggle to generalise. Manually annotated Regions of Interest (ROI) are…

Image and Video Processing · Electrical Eng. & Systems 2023-08-15 Alessandro Fontanella , Antreas Antoniou , Wenwen Li , Joanna Wardlaw , Grant Mair , Emanuele Trucco , Amos Storkey

Self-supervised learning holds promise in leveraging large numbers of unlabeled data. However, its success heavily relies on the highly-curated dataset, e.g., ImageNet, which still needs human cleaning. Directly learning representations…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Meilin Chen , Yizhou Wang , Shixiang Tang , Feng Zhu , Haiyang Yang , Lei Bai , Rui Zhao , Donglian Qi , Wanli Ouyang

Saliency maps have become a widely used method to assess which areas of the input image are most pertinent to the prediction of a trained neural network. However, in the context of medical imaging, there is no study to our knowledge that…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Nishanth Thumbavanam Arun , Nathan Gaw , Praveer Singh , Ken Chang , Katharina Viktoria Hoebel , Jay Patel , Mishka Gidwani , Jayashree Kalpathy-Cramer

Humans process visual scenes selectively and sequentially using attention. Central to models of human visual attention is the saliency map. We propose a hierarchical visual architecture that operates on a saliency map and uses a novel…

Computer Vision and Pattern Recognition · Computer Science 2017-11-15 Sean Welleck , Jialin Mao , Kyunghyun Cho , Zheng Zhang

Adversarial images highlight how vulnerable modern image classifiers are to perturbations outside of their training set. Human oversight might mitigate this weakness, but depends on humans understanding the AI well enough to predict when it…

Artificial Intelligence · Computer Science 2021-06-18 Tomas Folke , ZhaoBin Li , Ravi B. Sojitra , Scott Cheng-Hsin Yang , Patrick Shafto

Deep learning dominates image classification tasks, yet understanding how models arrive at predictions remains a challenge. Much research focuses on local explanations of individual predictions, such as saliency maps, which visualise the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 James Hinns , David Martens

Conventional and deep learning-based methods have shown great potential in the medical imaging domain, as means for deriving diagnostic, prognostic, and predictive biomarkers, and by contributing to precision medicine. However, these…

We propose to employ a saliency-driven hierarchical neural image compression network for a machine-to-machine communication scenario following the compress-then-analyze paradigm. By that, different areas of the image are coded at different…

Image and Video Processing · Electrical Eng. & Systems 2023-02-28 Kristian Fischer , Fabian Brand , Christian Blum , André Kaup

Deep learning has driven remarkable accuracy increases in many computer vision problems. One ongoing challenge is how to achieve the greatest accuracy in cases where training data is limited. A second ongoing challenge is that trained…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Aidan Boyd , Kevin Bowyer , Adam Czajka

While success of Deep Learning (DL) in automated diagnosis can be transformative to the medicinal practice especially for people with little or no access to doctors, its widespread acceptability is severely limited by inherent black-box…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Mehak Aggarwal , Nishanth Arun , Sharut Gupta , Ashwin Vaswani , Bryan Chen , Matthew Li , Ken Chang , Jay Patel , Katherine Hoebel , Mishka Gidwani , Jayashree Kalpathy-Cramer , Praveer Singh

CAM-based methods are widely-used post-hoc interpretability method that produce a saliency map to explain the decision of an image classification model. The saliency map highlights the important areas of the image relevant to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Magamed Taimeskhanov , Ronan Sicre , Damien Garreau

Saliency map estimation in computer vision aims to estimate the locations where people gaze in images. Since people tend to look at objects in images, the parameters of the model pretrained on ImageNet for image classification are useful…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Taiki Oyama , Takao Yamanaka

In supervised learning for medical image analysis, sample selection methodologies are fundamental to attain optimum system performance promptly and with minimal expert interactions (e.g. label querying in an active learning setup). In this…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Dwarikanath Mahapatra

Understanding specifically where a model focuses on within an image is critical for human interpretability of the decision-making process. Deep learning-based solutions are prone to learning coincidental correlations in training datasets,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Aidan Boyd , Mohamed Trabelsi , Huseyin Uzunalioglu , Dan Kushnir

With too few samples or too many model parameters, overfitting can inhibit the ability to generalise predictions to new data. Within medical imaging, this can occur when features are incorrectly assigned importance such as distinct hospital…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Becks Simpson , Francis Dutil , Yoshua Bengio , Joseph Paul Cohen

Conventional saliency maps highlight input features to which neural network predictions are highly sensitive. We take a different approach to saliency, in which we identify and analyze the network parameters, rather than inputs, which are…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Roman Levin , Manli Shu , Eitan Borgnia , Furong Huang , Micah Goldblum , Tom Goldstein

Neural Image Classifiers are effective but inherently hard to interpret and susceptible to adversarial attacks. Solutions to both problems exist, among others, in the form of counterfactual examples generation to enhance explainability or…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Rafael Bischof , Florian Scheidegger , Michael A. Kraus , A. Cristiano I. Malossi

The different families of saliency methods, either based on contrastive signals, closed-form formulas mixing gradients with activations or on perturbation masks, all focus on which parts of an image are responsible for the model's…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Sylvestre-Alvise Rebuffi , Ruth Fong , Xu Ji , Hakan Bilen , Andrea Vedaldi

Active learning (AL) has found wide applications in medical image segmentation, aiming to alleviate the annotation workload and enhance performance. Conventional uncertainty-based AL methods, such as entropy and Bayesian, often rely on an…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Siteng Ma , Haochang Wu , Aonghus Lawlor , Ruihai Dong