English
Related papers

Related papers: Am I Building a White Box Agent or Interpreting a …

200 papers

The interpretability of model has become one of the obstacles to its wide application in the high-stake fields. The usual way to obtain interpretability is to build a black-box first and then explain it using the post-hoc methods. However,…

Machine Learning · Computer Science 2023-04-04 Zihao Chen , Xiaomeng Wang , Yuanjiang Huang , Tao Jia

Modern predictive analytics underpinned by machine learning techniques has become a key enabler to the automation of data-driven decision making. In the context of business process management, predictive analytics has been applied to making…

Machine Learning · Computer Science 2020-06-09 Renuka Sindhgatta , Chun Ouyang , Catarina Moreira

This paper provides empirical concerns about post-hoc explanations of black-box ML models, one of the major trends in AI explainability (XAI), by showing its lack of interpretability and societal consequences. Using a representative…

Human-Computer Interaction · Computer Science 2021-10-01 Jean-Marie John-Mathews

In this paper, we address the "black-box" problem in predictive process analytics by building interpretable models that are capable to inform both what and why is a prediction. Predictive process analytics is a newly emerged discipline…

Machine Learning · Computer Science 2022-04-26 Bemali Wickramanayake , Zhipeng He , Chun Ouyang , Catarina Moreira , Yue Xu , Renuka Sindhgatta

We consider two fundamental and related issues currently faced by Artificial Intelligence (AI) development: the lack of ethics and interpretability of AI decisions. Can interpretable AI decisions help to address ethics in AI? Using a…

Artificial Intelligence · Computer Science 2021-09-21 Jean-Marie John-Mathews

In the field of medical imaging, particularly in tasks related to early disease detection and prognosis, understanding the reasoning behind AI model predictions is imperative for assessing their reliability. Conventional explanation methods…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Yingying Fang , Shuang Wu , Zihao Jin , Caiwen Xu , Shiyi Wang , Simon Walsh , Guang Yang

It is commonly believed that increasing the interpretability of a machine learning model may decrease its predictive power. However, inspecting input-output relationships of those models using visual analytics, while treating them as…

Machine Learning · Statistics 2016-06-22 Josua Krause , Adam Perer , Enrico Bertini

Sentiment detection is an important building block for multiple information retrieval tasks such as product recommendation, cyberbullying detection, and misinformation detection. Unsurprisingly, multiple commercial APIs, each with different…

Machine Learning · Computer Science 2022-04-26 Abdulaziz A. Almuzaini , Vivek K. Singh

In the context of humans operating with artificial or autonomous agents in a hybrid team, it is essential to accurately identify when to authorize those team members to perform actions. Given past examples where humans and autonomous…

Artificial Intelligence · Computer Science 2023-10-12 Andrew Fuchs , Andrea Passarella , Marco Conti

We introduce Intelligent Annotation Dialogs for bounding box annotation. We train an agent to automatically choose a sequence of actions for a human annotator to produce a bounding box in a minimal amount of time. Specifically, we consider…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Ksenia Konyushkova , Jasper Uijlings , Christoph Lampert , Vittorio Ferrari

Explainable artificial intelligence (XAI) is a set of tools and algorithms that applied or embedded to machine learning models to understand and interpret the models. They are recommended especially for complex or advanced models including…

Machine Learning · Computer Science 2024-07-18 Ahmed M Salih , Yuhe Wang

Decision-theoretic agents predict and evaluate the results of their actions using a model, or ontology, of their environment. An agent's goal, or utility function, may also be specified in terms of the states of, or entities within, its…

Artificial Intelligence · Computer Science 2011-05-20 Peter de Blanc

What is the prospect of developing artificial general intelligence (AGI)? I investigate this question by systematically comparing living and algorithmic systems, with a special focus on the notion of "agency." There are three fundamental…

Artificial Intelligence · Computer Science 2024-03-03 Johannes Jaeger

Agentic AI has taken on the role of assistant, collaborator, and decision-support tool. We argue the next role on that list is more personal: you. These are digital twins of each individual -- twin agents -- representing their knowledge,…

Human-Computer Interaction · Computer Science 2026-05-20 Hugo Andersson , Niklas Elmqvist

Large language models (LLMs) are increasingly deployed in high-stakes settings where good decisions require forming beliefs over the probability of unknown outcomes. However, it is unclear whether LLMs act as if they hold coherent beliefs…

Artificial Intelligence · Computer Science 2026-05-12 Khurram Yamin , Jingjing Tang , Santiago Cortes-Gomez , Amit Sharma , Eric Horvitz , Bryan Wilder

Explaining the behavior of black box machine learning models through human interpretable rules is an important research area. Recent work has focused on explaining model behavior locally i.e. for specific predictions as well as globally…

Machine Learning · Computer Science 2021-05-17 Sukriti Verma , Nikaash Puri , Piyush Gupta , Balaji Krishnamurthy

Enabling humans to identify potential flaws in an agent's decision making is an important Explainable AI application. We consider identifying such flaws in a planning-based deep reinforcement learning (RL) agent for a complex real-time…

Artificial Intelligence · Computer Science 2021-09-30 Kin-Ho Lam , Zhengxian Lin , Jed Irvine , Jonathan Dodge , Zeyad T Shureih , Roli Khanna , Minsuk Kahng , Alan Fern

Fundamental to robotics is the debate between model-based and model-free learning: should the robot build an explicit model of the world, or learn a policy directly? In the context of HRI, part of the world to be modeled is the human. One…

Robotics · Computer Science 2020-05-25 Gokul Swamy , Jens Schulz , Rohan Choudhury , Dylan Hadfield-Menell , Anca Dragan

We consider settings where an uninformed principal must hear arguments from two better-informed agents, corresponding to two possible courses of action that they argue for. The arguments are verifiable in the sense that the true state of…

Computer Science and Game Theory · Computer Science 2025-12-01 Alexander Heckett , Vincent Conitzer

Intelligent agents offer a new and exciting way of understanding the world of work. In this paper we apply agent-based modeling and simulation to investigate a set of problems in a retail context. Specifically, we are working to understand…

Neural and Evolutionary Computing · Computer Science 2010-07-05 Peer-Olaf Siebers , Uwe Aickelin , Helen Celia , Christopher Clegg