English
Related papers

Related papers: Provably Robust Model-Centric Explanations for Cri…

200 papers

Deep neural networks form the backbone of artificial intelligence research, with potential to transform the human experience in areas ranging from autonomous driving to personal assistants, healthcare to education. However, their…

Machine Learning · Computer Science 2025-05-29 Vinitra Swamy

Calibration strengthens the trustworthiness of black-box models by producing better accurate confidence estimates on given examples. However, little is known about if model explanations can help confidence calibration. Intuitively, humans…

Computation and Language · Computer Science 2022-11-08 Dongfang Li , Baotian Hu , Qingcai Chen

State-of-the-art AI models largely lack an understanding of the cause-effect relationship that governs human understanding of the real world. Consequently, these models do not generalize to unseen data, often produce unfair results, and are…

Attention mechanisms are dominating the explainability of deep models. They produce probability distributions over the input, which are widely deemed as feature-importance indicators. However, in this paper, we find one critical limitation…

Machine Learning · Computer Science 2022-07-06 Yibing Liu , Haoliang Li , Yangyang Guo , Chenqi Kong , Jing Li , Shiqi Wang

The advances in artificial intelligence enabled by deep learning architectures are undeniable. In several cases, deep neural network driven models have surpassed human level performance in benchmark autonomy tasks. The underlying policies…

Artificial Intelligence · Computer Science 2021-06-11 Jeff Druce , James Niehaus , Vanessa Moody , David Jensen , Michael L. Littman

Although the widespread use of AI systems in today's world is growing, many current AI systems are found vulnerable due to hidden bias and missing information, especially in the most commonly used forecasting system. In this work, we…

Machine Learning · Computer Science 2024-07-30 Zhixuan Chu , Hui Ding , Guang Zeng , Shiyu Wang , Yiming Li

One of the several obstacles in the widespread use of AI systems is the lack of requirements of interpretability that can enable a layperson to ensure the safe and reliable behavior of such systems. We extend the analysis of an agent…

Artificial Intelligence · Computer Science 2021-08-24 Pulkit Verma , Siddharth Srivastava

Recent work in explanation generation for decision making agents has looked at how unexplained behavior of autonomous systems can be understood in terms of differences in the model of the system and the human's understanding of the same,…

Artificial Intelligence · Computer Science 2018-02-06 Tathagata Chakraborti , Sarath Sreedharan , Sachin Grover , Subbarao Kambhampati

In decision making tasks under uncertainty, humans display characteristic biases in seeking, integrating, and acting upon information relevant to the task. Here, we reexamine data from previous carefully designed experiments, collected at…

Artificial Intelligence · Computer Science 2021-02-05 Soumya Chatterjee , Pradeep Shenoy

Explainable AI (XAI) holds significant promise for enhancing the transparency and trustworthiness of AI-driven threat detection in Security Operations Centers (SOCs). However, identifying the appropriate level and format of explanation,…

Cryptography and Security · Computer Science 2025-07-22 Nidhi Rastogi , Shirid Pant , Devang Dhanuka , Amulya Saxena , Pranjal Mairal

Maintaining an acceptable level of quality of service in modern complex systems is challenging, particularly in the presence of various forms of uncertainty caused by changing execution context, unpredicted events, etc. Although…

Software Engineering · Computer Science 2020-12-04 Fatma Kachi , Chafia Bouanaka , Souheir Merkouche

AI solutions are heavily dependant on the quality and accuracy of the input training data, however the training data may not always fully reflect the most up-to-date policy landscape or may be missing business logic. The advances in…

Artificial Intelligence · Computer Science 2022-03-30 Elizabeth M. Daly , Massimiliano Mattetti , Öznur Alkan , Rahul Nair

In explainable artificial intelligence (XAI) research, the predominant focus has been on interpreting models for experts and practitioners. Model agnostic and local explanation approaches are deemed interpretable and sufficient in many…

Artificial Intelligence · Computer Science 2024-02-01 Adarsa Sivaprasad , Ehud Reiter , Nava Tintarev , Nir Oren

Model explanations can be valuable for interpreting and debugging predictive models. We study a specific kind called Concept Explanations, where the goal is to interpret a model using human-understandable concepts. Although popular for…

Machine Learning · Computer Science 2024-04-08 Vihari Piratla , Juyeon Heo , Katherine M. Collins , Sukriti Singh , Adrian Weller

Boolean satisfiability (SAT) is a fundamental NP-complete problem with many applications, including automated planning and scheduling. To solve large instances, SAT solvers have to rely on heuristics, e.g., choosing a branching variable in…

Artificial Intelligence · Computer Science 2023-07-19 Mikhail Shirokikh , Ilya Shenbin , Anton Alekseev , Sergey Nikolenko

Explainable AI (XAI) in high-stakes domains should help stakeholders trust and verify system outputs. Yet Chain-of-Thought methods reason before concluding, and logical gaps or hallucinations can yield conclusions that do not reliably align…

Artificial Intelligence · Computer Science 2026-01-13 Chen Qian , Yimeng Wang , Yu Chen , Lingfei Wu , Andreas Stathopoulos

In this paper, we argue for a paradigm shift from the current model of explainable artificial intelligence (XAI), which may be counter-productive to better human decision making. In early decision support systems, we assumed that we could…

Artificial Intelligence · Computer Science 2023-03-14 Tim Miller

Explainable AI (XAI) aims to support appropriate human-AI reliance by increasing the interpretability of complex model decisions. Despite the proliferation of proposed methods, there is mixed evidence surrounding the effects of different…

Human-Computer Interaction · Computer Science 2024-10-29 Emma Casolin , Flora D. Salim , Ben Newell

A central goal of cognitive modeling is to develop models that not only predict human behavior but also provide insight into the underlying cognitive mechanisms. While neural network models trained on large-scale behavioral data often…

Artificial Intelligence · Computer Science 2026-02-03 Jian-Qiao Zhu , Hanbo Xie , Dilip Arumugam , Robert C. Wilson , Thomas L. Griffiths

Many interpretable AI approaches have been proposed to provide plausible explanations for a model's decision-making. However, configuring an explainable model that effectively communicates among computational modules has received less…

Machine Learning · Computer Science 2023-11-09 Jinyung Hong , Keun Hee Park , Theodore P. Pavlic