中文
相关论文

相关论文: Provably Robust Model-Centric Explanations for Cri…

200 篇论文

Deep neural networks form the backbone of artificial intelligence research, with potential to transform the human experience in areas ranging from autonomous driving to personal assistants, healthcare to education. However, their…

机器学习 · 计算机科学 2025-05-29 Vinitra Swamy

Calibration strengthens the trustworthiness of black-box models by producing better accurate confidence estimates on given examples. However, little is known about if model explanations can help confidence calibration. Intuitively, humans…

计算与语言 · 计算机科学 2022-11-08 Dongfang Li , Baotian Hu , Qingcai Chen

State-of-the-art AI models largely lack an understanding of the cause-effect relationship that governs human understanding of the real world. Consequently, these models do not generalize to unseen data, often produce unfair results, and are…

Attention mechanisms are dominating the explainability of deep models. They produce probability distributions over the input, which are widely deemed as feature-importance indicators. However, in this paper, we find one critical limitation…

机器学习 · 计算机科学 2022-07-06 Yibing Liu , Haoliang Li , Yangyang Guo , Chenqi Kong , Jing Li , Shiqi Wang

The advances in artificial intelligence enabled by deep learning architectures are undeniable. In several cases, deep neural network driven models have surpassed human level performance in benchmark autonomy tasks. The underlying policies…

人工智能 · 计算机科学 2021-06-11 Jeff Druce , James Niehaus , Vanessa Moody , David Jensen , Michael L. Littman

Although the widespread use of AI systems in today's world is growing, many current AI systems are found vulnerable due to hidden bias and missing information, especially in the most commonly used forecasting system. In this work, we…

机器学习 · 计算机科学 2024-07-30 Zhixuan Chu , Hui Ding , Guang Zeng , Shiyu Wang , Yiming Li

One of the several obstacles in the widespread use of AI systems is the lack of requirements of interpretability that can enable a layperson to ensure the safe and reliable behavior of such systems. We extend the analysis of an agent…

人工智能 · 计算机科学 2021-08-24 Pulkit Verma , Siddharth Srivastava

Recent work in explanation generation for decision making agents has looked at how unexplained behavior of autonomous systems can be understood in terms of differences in the model of the system and the human's understanding of the same,…

人工智能 · 计算机科学 2018-02-06 Tathagata Chakraborti , Sarath Sreedharan , Sachin Grover , Subbarao Kambhampati

In decision making tasks under uncertainty, humans display characteristic biases in seeking, integrating, and acting upon information relevant to the task. Here, we reexamine data from previous carefully designed experiments, collected at…

人工智能 · 计算机科学 2021-02-05 Soumya Chatterjee , Pradeep Shenoy

Explainable AI (XAI) holds significant promise for enhancing the transparency and trustworthiness of AI-driven threat detection in Security Operations Centers (SOCs). However, identifying the appropriate level and format of explanation,…

密码学与安全 · 计算机科学 2025-07-22 Nidhi Rastogi , Shirid Pant , Devang Dhanuka , Amulya Saxena , Pranjal Mairal

Maintaining an acceptable level of quality of service in modern complex systems is challenging, particularly in the presence of various forms of uncertainty caused by changing execution context, unpredicted events, etc. Although…

软件工程 · 计算机科学 2020-12-04 Fatma Kachi , Chafia Bouanaka , Souheir Merkouche

AI solutions are heavily dependant on the quality and accuracy of the input training data, however the training data may not always fully reflect the most up-to-date policy landscape or may be missing business logic. The advances in…

人工智能 · 计算机科学 2022-03-30 Elizabeth M. Daly , Massimiliano Mattetti , Öznur Alkan , Rahul Nair

In explainable artificial intelligence (XAI) research, the predominant focus has been on interpreting models for experts and practitioners. Model agnostic and local explanation approaches are deemed interpretable and sufficient in many…

人工智能 · 计算机科学 2024-02-01 Adarsa Sivaprasad , Ehud Reiter , Nava Tintarev , Nir Oren

Model explanations can be valuable for interpreting and debugging predictive models. We study a specific kind called Concept Explanations, where the goal is to interpret a model using human-understandable concepts. Although popular for…

机器学习 · 计算机科学 2024-04-08 Vihari Piratla , Juyeon Heo , Katherine M. Collins , Sukriti Singh , Adrian Weller

Boolean satisfiability (SAT) is a fundamental NP-complete problem with many applications, including automated planning and scheduling. To solve large instances, SAT solvers have to rely on heuristics, e.g., choosing a branching variable in…

人工智能 · 计算机科学 2023-07-19 Mikhail Shirokikh , Ilya Shenbin , Anton Alekseev , Sergey Nikolenko

Explainable AI (XAI) in high-stakes domains should help stakeholders trust and verify system outputs. Yet Chain-of-Thought methods reason before concluding, and logical gaps or hallucinations can yield conclusions that do not reliably align…

人工智能 · 计算机科学 2026-01-13 Chen Qian , Yimeng Wang , Yu Chen , Lingfei Wu , Andreas Stathopoulos

In this paper, we argue for a paradigm shift from the current model of explainable artificial intelligence (XAI), which may be counter-productive to better human decision making. In early decision support systems, we assumed that we could…

人工智能 · 计算机科学 2023-03-14 Tim Miller

Explainable AI (XAI) aims to support appropriate human-AI reliance by increasing the interpretability of complex model decisions. Despite the proliferation of proposed methods, there is mixed evidence surrounding the effects of different…

人机交互 · 计算机科学 2024-10-29 Emma Casolin , Flora D. Salim , Ben Newell

A central goal of cognitive modeling is to develop models that not only predict human behavior but also provide insight into the underlying cognitive mechanisms. While neural network models trained on large-scale behavioral data often…

人工智能 · 计算机科学 2026-02-03 Jian-Qiao Zhu , Hanbo Xie , Dilip Arumugam , Robert C. Wilson , Thomas L. Griffiths

Many interpretable AI approaches have been proposed to provide plausible explanations for a model's decision-making. However, configuring an explainable model that effectively communicates among computational modules has received less…

机器学习 · 计算机科学 2023-11-09 Jinyung Hong , Keun Hee Park , Theodore P. Pavlic