English
Related papers

Related papers: Be Careful When Evaluating Explanations Regarding …

200 papers

Artificial neural networks are being proposed as models of parts of the brain. The networks are compared to recordings of biological neurons, and good performance in reproducing neural responses is considered to support the model's…

Neurons and Cognition · Quantitative Biology 2023-09-01 Yena Han , Tomaso Poggio , Brian Cheung

Current Explainable AI (ExAI) methods, especially in the NLP field, are conducted on various datasets by employing different metrics to evaluate several aspects. The lack of a common evaluation framework is hindering the progress tracking…

Computation and Language · Computer Science 2022-10-14 Julia El Zini , Mohamad Mansour , Basel Mousi , Mariette Awad

As artificial intelligence systems become increasingly integrated into daily life, the field of explainability has gained significant attention. This trend is particularly driven by the complexity of modern AI models and their…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Rémi Kazmierczak , Eloïse Berthier , Goran Frehse , Gianni Franchi

Deep learning-based image restoration has achieved significant success. However, when addressing real-world degradations, model performance is limited by the quality of groundtruth images in datasets due to practical constraints in data…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Donghun Ryou , Inju Ha , Sanghyeok Chu , Bohyung Han

Automated Machine Learning-based systems' integration into a wide range of tasks has expanded as a result of their performance and speed. Although there are numerous advantages to employing ML-based systems, if they are not interpretable,…

Machine Learning · Computer Science 2022-12-08 Ioannis Mollas , Nick Bassiliades , Grigorios Tsoumakas

Machine learning models in safety-critical settings like healthcare are often blackboxes: they contain a large number of parameters which are not transparent to users. Post-hoc explainability methods where a simple, human-interpretable…

Machine Learning · Computer Science 2022-06-03 Aparna Balagopalan , Haoran Zhang , Kimia Hamidieh , Thomas Hartvigsen , Frank Rudzicz , Marzyeh Ghassemi

The ability to explain decisions made by AI systems is highly sought after, especially in domains where human lives are at stake such as medicine or autonomous vehicles. While it is often possible to approximate the input-output relations…

Artificial Intelligence · Computer Science 2020-10-15 Daniel C. Elton

Local explanations of learning-to-rank (LTR) models are thought to extract the most important features that contribute to the ranking predicted by the LTR model for a single data point. Evaluating the accuracy of such explanations is…

Machine Learning · Statistics 2022-03-17 Amir Hossein Akhavan Rahnama , Judith Butepage

The challenge of creating interpretable models has been taken up by two main research communities: ML researchers primarily focused on lower-level explainability methods that suit the needs of engineers, and HCI researchers who have more…

Machine Learning · Computer Science 2024-07-16 Juan D. Pinto , Luc Paquette

As deep neural networks (DNNs) are increasingly used in safety-critical applications, there is a growing concern for their reliability. Even highly trained, high-performant networks are not 100% accurate. However, it is very difficult to…

Neural and Evolutionary Computing · Computer Science 2024-07-30 Eduard Pinconschi , Divya Gopinath , Rui Abreu , Corina S. Pasareanu

The practical application of deep neural networks are still limited by their lack of transparency. One of the efforts to provide explanation for decisions made by artificial intelligence (AI) is the use of saliency or heat maps highlighting…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Erico Tjoa , Guan Cuntai

Explanation methods in Interpretable NLP often explain the model's decision by extracting evidence (rationale) from the input texts supporting the decision. Benchmark datasets for rationales have been released to evaluate how good the…

Computation and Language · Computer Science 2022-04-12 Cheng-Han Chiang , Hung-yi Lee

Explainability of deep convolutional neural networks (DCNNs) is an important research topic that tries to uncover the reasons behind a DCNN model's decisions and improve their understanding and reliability in high-risk environments. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Syed Ali Tariq , Tehseen Zia , Mubeen Ghafoor

Explainable AI is an emerging field providing solutions for acquiring insights into automated systems' rationale. It has been put on the AI map by suggesting ways to tackle key ethical and societal issues. Existing explanation techniques…

Machine Learning · Computer Science 2022-05-02 Ioannis Mollas , Nick Bassiliades , Grigorios Tsoumakas

With the rapid growth of Android malware, many machine learning-based malware analysis approaches are proposed to mitigate the severe phenomenon. However, such classifiers are opaque, non-intuitive, and difficult for analysts to understand…

Cryptography and Security · Computer Science 2020-08-14 Ming Fan , Wenying Wei , Xiaofei Xie , Yang Liu , Xiaohong Guan , Ting Liu

Explaining the decisions of models is becoming pervasive in the image processing domain, whether it is by using post-hoc methods or by creating inherently interpretable models. While the widespread use of surrogate explainers is a welcome…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Alexander Hepburn , Raul Santos-Rodriguez

The ability to navigate robots with natural language instructions in an unknown environment is a crucial step for achieving embodied artificial intelligence (AI). With the improving performance of deep neural models proposed in the field of…

Robotics · Computer Science 2023-10-11 Guanqi Chen , Lei Yang , Guanhua Chen , Jia Pan

As deep neural networks (DNNs) get adopted in an ever-increasing number of applications, explainability has emerged as a crucial desideratum for these models. In many real-world tasks, one of the principal reasons for requiring…

Artificial Intelligence · Computer Science 2020-07-03 Vedant Nanda , Till Speicher , John P. Dickerson , Krishna P. Gummadi , Muhammad Bilal Zafar

Explainable AI has attracted much research attention in recent years with feature attribution algorithms, which compute "feature importance" in predictions, becoming increasingly popular. However, there is little analysis of the validity of…

Artificial Intelligence · Computer Science 2021-05-21 Orcun Yalcin , Xiuyi Fan , Siyuan Liu

In today's society, where Artificial Intelligence (AI) has gained a vital role, concerns regarding user's trust have garnered significant attention. The use of AI systems in high-risk domains have often led users to either under-trust it,…

Human-Computer Interaction · Computer Science 2025-04-16 Siddharth Mehrotra , Ujwal Gadiraju , Eva Bittner , Folkert van Delden , Catholijn M. Jonker , Myrthe L. Tielman