English
Related papers

Related papers: Evaluating saliency methods on artificial data wit…

200 papers

Saliency maps that identify the most informative regions of an image for a classifier are valuable for model interpretability. A common approach to creating saliency maps involves generating input masks that mask out portions of an image to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Jason Phang , Jungkyu Park , Krzysztof J. Geras

The evolving landscape of explainable artificial intelligence (XAI) aims to improve the interpretability of intricate machine learning (ML) models, yet faces challenges in formalisation and empirical validation, being an inherently…

Artificial intelligence (AI) now enables automated interpretation of medical images for clinical use. However, AI's potential use for interventional images (versus those involved in triage or diagnosis), such as for guidance during surgery,…

Image and Video Processing · Electrical Eng. & Systems 2022-06-14 Cong Gao , Benjamin D. Killeen , Yicheng Hu , Robert B. Grupp , Russell H. Taylor , Mehran Armand , Mathias Unberath

The success of AI models relies on the availability of large, diverse, and high-quality datasets, which can be challenging to obtain due to data scarcity, privacy concerns, and high costs. Synthetic data has emerged as a promising solution…

Computation and Language · Computer Science 2024-08-13 Ruibo Liu , Jerry Wei , Fangyu Liu , Chenglei Si , Yanzhe Zhang , Jinmeng Rao , Steven Zheng , Daiyi Peng , Diyi Yang , Denny Zhou , Andrew M. Dai

Saliency maps have become a widely used method to assess which areas of the input image are most pertinent to the prediction of a trained neural network. However, in the context of medical imaging, there is no study to our knowledge that…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Nishanth Thumbavanam Arun , Nathan Gaw , Praveer Singh , Ken Chang , Katharina Viktoria Hoebel , Jay Patel , Mishka Gidwani , Jayashree Kalpathy-Cramer

In an era increasingly dominated by digital platforms, the spread of misinformation poses a significant challenge, highlighting the need for solutions capable of assessing information veracity. Our research contributes to the field of…

Computation and Language · Computer Science 2024-10-22 Darius Feher , Abdullah Khered , Hao Zhang , Riza Batista-Navarro , Viktor Schlegel

In this paper we propose two saliency models for salient object segmentation based on a hierarchical image segmentation, a tree-like structure that represents regions at different scales from the details to the whole image (e.g. gPb-UCM,…

Computer Vision and Pattern Recognition · Computer Science 2015-08-20 Verónica Vilaplana

The increasing complexity of LLMs presents significant challenges to their transparency and interpretability, necessitating the use of eXplainable AI (XAI) techniques to enhance trustworthiness and usability. This study introduces a…

Computation and Language · Computer Science 2025-04-09 Melkamu Abay Mersha , Mesay Gemeda Yigezu , Hassan Shakil , Ali K. AlShami , Sanghyun Byun , Jugal Kalita

As the applications of Natural Language Processing (NLP) in sensitive areas like Political Profiling, Review of Essays in Education, etc. proliferate, there is a great need for increasing transparency in NLP models to build trust with…

Computation and Language · Computer Science 2022-11-29 Adel Rahimi , Shaurya Jain

Generative AI (GenAI) is increasingly used in survey contexts to simulate human preferences. While many research endeavors evaluate the quality of synthetic GenAI data by comparing model-generated responses to gold-standard survey results,…

Machine Learning · Computer Science 2025-02-25 Sarah Ball , Simeon Allmendinger , Frauke Kreuter , Niklas Kühl

Recently, there has been a growing interest in developing saliency methods that provide visual explanations of network predictions. Still, the usability of existing methods is limited to image classification models. To overcome this…

Computer Vision and Pattern Recognition · Computer Science 2019-11-11 Lukas Hoyer , Mauricio Munoz , Prateek Katiyar , Anna Khoreva , Volker Fischer

Saliency methods are widely used to interpret neural network predictions, but different variants of saliency methods often disagree even on the interpretations of the same prediction made by the same model. In these cases, how do we…

Computation and Language · Computer Science 2021-04-14 Shuoyang Ding , Philipp Koehn

Recent years have shown an increased development of methods for justifying the predictions of neural networks through visual explanations. These explanations usually take the form of heatmaps which assign a saliency (or relevance) value to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Benjamin Vandersmissen , Jose Oramas

We propose an experimental method for measuring bias in face recognition systems. Existing methods to measure bias depend on benchmark datasets that are collected in the wild and annotated for protected (e.g., race, gender) and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Hao Liang , Pietro Perona , Guha Balakrishnan

The field of explainable AI (XAI) has quickly become a thriving and prolific community. However, a silent, recurrent and acknowledged issue in this area is the lack of consensus regarding its terminology. In particular, each new…

Artificial Intelligence · Computer Science 2021-11-03 Sebastian Palacio , Adriano Lucieri , Mohsin Munir , Jörn Hees , Sheraz Ahmed , Andreas Dengel

One of the motivations for explainable AI is to allow humans to make better and more informed decisions regarding the use and deployment of AI models. But careful evaluations are needed to assess whether this expectation has been fulfilled.…

Artificial Intelligence · Computer Science 2023-12-12 Shawn Im , Jacob Andreas , Yilun Zhou

The field of explainable artificial intelligence (XAI) aims to uncover the inner workings of complex deep neural models. While being crucial for safety-critical domains, XAI inherently lacks ground-truth explanations, making its automatic…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Robin Hesse , Simone Schaub-Meyer , Stefan Roth

We present a comprehensive analysis of quantitatively evaluating explainable artificial intelligence (XAI) techniques for remote sensing image classification. Our approach leverages state-of-the-art machine learning approaches to perform…

Machine Learning · Computer Science 2023-12-06 Akshatha Mohan , Joshua Peeples

The increasing complexity of machine learning models in computer vision, particularly in face verification, requires the development of explainable artificial intelligence (XAI) to enhance interpretability and transparency. This study…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Miriam Doh , Caroline Mazini Rodrigues , N. Boutry , L. Najman , Matei Mancas , Bernard Gosselin

Recent advances in deep learning and on-device inference could transform routine screening for skin cancers. Along with the anticipated benefits of this technology, potential dangers arise from unforeseen and inherent biases. A significant…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Ko Watanabe , Stanislav Frolov , Aya Hassan , David Dembinsky , Adriano Lucieri , Andreas Dengel