English
Related papers

Related papers: Metrics for saliency map evaluation of deep learni…

200 papers

Explaining deep convolutional neural networks has been recently drawing increasing attention since it helps to understand the networks' internal operations and why they make certain decisions. Saliency maps, which emphasize salient regions…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Quan Zheng , Ziwei Wang , Jie Zhou , Jiwen Lu

Deep learning models have great potential in medical imaging, including orthodontics and skeletal maturity assessment. However, applying a model to data different from its training set can lead to unreliable predictions that may impact…

Image and Video Processing · Electrical Eng. & Systems 2025-05-15 Omid Halimi Milani , Amanda Nikho , Lauren Mills , Marouane Tliba , Ahmet Enis Cetin , Mohammed H. Elnagar

News outlets' competition for attention in news interfaces has highlighted the need for demographically-aware saliency prediction models. Despite recent advancements in saliency detection applied to user interfaces (UI), existing datasets…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Matthew Kenely , Dylan Seychell , Carl James Debono , Chris Porter

While success of Deep Learning (DL) in automated diagnosis can be transformative to the medicinal practice especially for people with little or no access to doctors, its widespread acceptability is severely limited by inherent black-box…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Mehak Aggarwal , Nishanth Arun , Sharut Gupta , Ashwin Vaswani , Bryan Chen , Matthew Li , Ken Chang , Jay Patel , Katherine Hoebel , Mishka Gidwani , Jayashree Kalpathy-Cramer , Praveer Singh

With the increasing importance of safety requirements associated with the use of black box models, evaluation of selective answering capability of models has been critical. Area under the curve (AUC) is used as a metric for this purpose. We…

Computation and Language · Computer Science 2022-10-11 Swaroop Mishra , Anjana Arunkumar , Chitta Baral

This paper shows that further evaluation metrics during model training are needed to decide about its applicability in inference. As an example, a LayoutLM-based model is trained for token classification in documents. The documents are…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Anket Mehra , Malte Prieß , Marian Himstedt

Recent advances in deep learning have pushed the performances of visual saliency models way further than it has ever been. Numerous models in the literature present new ways to design neural networks, to arrange gaze pattern data, or to…

Computer Vision and Pattern Recognition · Computer Science 2019-07-05 Alexandre Bruckert , Hamed R. Tavakoli , Zhi Liu , Marc Christie , Olivier Le Meur

The adoption of deep learning across various fields has been extensive, yet there is a lack of focus on evaluating the performance of deep learning pipelines. Typically, with the increased use of large datasets and complex models, the…

Machine Learning · Computer Science 2024-05-21 Yewen Fan , Nian Si , Xiangchen Song , Kun Zhang

Data size is the bottleneck for developing deep saliency models, because collecting eye-movement data is very time consuming and expensive. Most of current studies on human attention and saliency modeling have used high quality stereotype…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Zhaohui Che , Ali Borji , Guangtao Zhai , Xiongkuo Min , Guodong Guo , Patrick Le Callet

Deep ensembles are capable of achieving state-of-the-art results in classification and out-of-distribution (OOD) detection. However, their effectiveness is limited due to the homogeneity of learned patterns within ensembles. To overcome…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Stanislav Dereka , Ivan Karpukhin , Maksim Zhdanov , Sergey Kolesnikov

Recently, data-driven deep saliency models have achieved high performance and have outperformed classical saliency models, as demonstrated by results on datasets such as the MIT300 and SALICON. Yet, there remains a large gap between the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Sen He , Hamed R. Tavakoli , Ali Borji , Yang Mi , Nicolas Pugeault

Interpretation of deep learning remains a very challenging problem. Although the Class Activation Map (CAM) is widely used to interpret deep model predictions by highlighting object location, it fails to provide insight into the salient…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Yuguang Yang , Runtang Guo , Sheng Wu , Yimi Wang , Juan Zhang , Xuan Gong , Baochang Zhang

Methods based on class activation maps (CAM) provide a simple mechanism to interpret predictions of convolutional neural networks by using linear combinations of feature maps as saliency maps. By contrast, masking-based methods optimize a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Hanwei Zhang , Felipe Torres , Ronan Sicre , Yannis Avrithis , Stephane Ayache

Interpretability is a critical factor in applying complex deep learning models to advance the understanding of brain disorders in neuroimaging studies. To interpret the decision process of a trained classifier, existing techniques typically…

Image and Video Processing · Electrical Eng. & Systems 2021-06-29 Zixuan Liu , Ehsan Adeli , Kilian M. Pohl , Qingyu Zhao

In high-stakes applications of machine learning models, interpretability methods provide guarantees that models are right for the right reasons. In medical imaging, saliency maps have become the standard tool for determining whether a…

Computer Vision and Pattern Recognition · Computer Science 2019-12-05 Jacob Pfau , Albert T. Young , Maria L. Wei , Michael J. Keiser

The expansion of explainable artificial intelligence as a field of research has generated numerous methods of visualizing and understanding the black box of a machine learning model. Attribution maps are generally used to highlight the…

Machine Learning · Computer Science 2023-08-02 Ian E. Nielsen , Ravi P. Ramachandran , Nidhal Bouaynaya , Hassan M. Fathallah-Shaykh , Ghulam Rasool

Saliency maps that identify the most informative regions of an image for a classifier are valuable for model interpretability. A common approach to creating saliency maps involves generating input masks that mask out portions of an image to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Jason Phang , Jungkyu Park , Krzysztof J. Geras

The success of recent deep convolutional neural networks (CNNs) depends on learning hidden representations that can summarize the important factors of variation behind the data. However, CNNs often criticized as being black boxes that lack…

Computer Vision and Pattern Recognition · Computer Science 2018-06-27 Bolei Zhou , David Bau , Aude Oliva , Antonio Torralba

Deep neural networks for medical image diagnosis often achieve high predictive accuracy while relying on spurious or clinically irrelevant visual cues, limiting their trustworthiness in practice. Post-hoc explanation methods are widely used…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zubair Faruqui , Rahul Dubey

Gaining insight into how deep convolutional neural network models perform image classification and how to explain their outputs have been a concern to computer vision researchers and decision makers. These deep models are often referred to…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Daniel Omeiza , Skyler Speakman , Celia Cintas , Komminist Weldermariam