中文
相关论文

相关论文: Beyond the Black Box: Interpretability of Agentic …

200 篇论文

When developing AI systems that interact with humans, it is essential to design both a system that can understand humans, and a system that humans can understand. Most deep network based agent-modeling approaches are 1) not interpretable…

机器学习 · 计算机科学 2021-07-14 Ini Oguntola , Dana Hughes , Katia Sycara

Although numerous strategies have recently been proposed to enhance the autonomous interaction capabilities of multimodal agents in graphical user interface (GUI), their reliability remains limited when faced with complex or out-of-domain…

计算与语言 · 计算机科学 2025-10-06 Pengzhou Cheng , Lingzhong Dong , Zeng Wu , Zongru Wu , Xiangru Tang , Chengwei Qin , Zhuosheng Zhang , Gongshen Liu

Predicting the motion of other road agents enables autonomous vehicles to perform safe and efficient path planning. This task is very complex, as the behaviour of road agents depends on many factors and the number of possible future…

In this preprint, we present A collaborative human-AI approach to building an inspectable semantic layer for Agentic AI. AI agents first propose candidate knowledge structures from diverse data sources; domain experts then validate,…

人工智能 · 计算机科学 2025-12-05 Liam McGee , James Harvey , Lucy Cull , Andreas Vermeulen , Bart-Floris Visscher , Malvika Sharan

Explainable AI is an emerging field providing solutions for acquiring insights into automated systems' rationale. It has been put on the AI map by suggesting ways to tackle key ethical and societal issues. Existing explanation techniques…

机器学习 · 计算机科学 2022-05-02 Ioannis Mollas , Nick Bassiliades , Grigorios Tsoumakas

With the growing capabilities of intelligent systems, the integration of robots in our everyday life is increasing. However, when interacting in such complex human environments, the occasional failure of robotic systems is inevitable. The…

人工智能 · 计算机科学 2021-08-05 Devleena Das , Siddhartha Banerjee , Sonia Chernova

Computationally explicit hypotheses of brain function derived from machine learning (ML)-based models have recently revolutionized neuroscience. Despite the unprecedented ability of these artificial neural networks (ANNs) to capture…

神经元与认知 · 定量生物学 2023-12-12 Kohitij Kar , Simon Kornblith , Evelina Fedorenko

Modern predictive analytics underpinned by machine learning techniques has become a key enabler to the automation of data-driven decision making. In the context of business process management, predictive analytics has been applied to making…

机器学习 · 计算机科学 2020-06-09 Renuka Sindhgatta , Chun Ouyang , Catarina Moreira

Real-world requests to AI agents are fundamentally underspecified. Natural human communication relies on shared context and unstated constraints that speakers expect listeners to infer. Current agentic benchmarks test explicit…

人工智能 · 计算机科学 2026-02-25 Ved Sirdeshmukh , Marc Wetter

Still under debate is the question of whether machine learning is capable of going beyond black-box modeling for complex physical systems. We investigate the generalizing and interpretability properties of learning algorithms. To this end,…

统计力学 · 物理学 2019-02-18 C. Casert , T. Vieijra , J. Nys , J. Ryckebusch

Multi-agent robotic systems are increasingly operating in real-world environments in close proximity to humans, yet are largely controlled by policy models with inscrutable deep neural network representations. We introduce a method for…

机器学习 · 计算机科学 2023-02-24 Renos Zabounidis , Joseph Campbell , Simon Stepputtis , Dana Hughes , Katia Sycara

Although modern machine learning and deep learning methods allow for complex and in-depth data analytics, the predictive models generated by these methods are often highly complex, and lack transparency. Explainable AI (XAI) methods are…

机器学习 · 计算机科学 2021-06-17 Mythreyi Velmurugan , Chun Ouyang , Catarina Moreira , Renuka Sindhgatta

Agentic language models operate in a fundamentally different safety regime than chat models: they must plan, call tools, and execute long-horizon actions where a single misstep, such as accessing files or entering credentials, can cause…

计算与语言 · 计算机科学 2026-03-04 Aradhye Agarwal , Gurdit Siyan , Yash Pandya , Joykirat Singh , Akshay Nambi , Ahmed Awadallah

Interpretable AI tools are often motivated by the goal of understanding model behavior in out-of-distribution (OOD) contexts. Despite the attention this area of study receives, there are comparatively few cases where these tools have…

机器学习 · 计算机科学 2023-09-25 Stephen Casper , Yuxiao Li , Jiawei Li , Tong Bu , Kevin Zhang , Kaivalya Hariharan , Dylan Hadfield-Menell

The lack of interpretability and transparency are preventing economists from using advanced tools like neural networks in their empirical research. In this paper, we propose a class of interpretable neural network models that can achieve…

计量经济学 · 经济学 2020-12-01 Yucheng Yang , Zhong Zheng , Weinan E

Financial forecasting plays an important role in making informed decisions for financial stakeholders, specifically in the stock exchange market. In a traditional setting, investors commonly rely on the equity research department for…

统计金融 · 定量金融 2024-07-23 Sahar Arshad , Seemab Latif , Ahmad Salman , Rabia Latif

Modern software infrastructure increasingly relies on LLM agents for development and maintenance, such as Claude Code and Gemini-cli. However, these AI agents differ fundamentally from traditional deterministic software, posing a…

操作系统 · 计算机科学 2025-10-21 Yusheng Zheng , Yanpeng Hu , Tong Yu , Andi Quinn

Personalized computer-use agents are rapidly moving from expert communities into mainstream use. Unlike conventional chatbots, these systems can install skills, invoke tools, access private resources, and modify local environments on users'…

密码学与安全 · 计算机科学 2026-04-01 Zifan Peng , Mingchen Li

Evaluating GUI agents presents a distinct challenge: trajectories are long, visually grounded, and open-ended, yet evaluation must be both accurate and interpretable. Existing approaches typically apply a single holistic judgment over the…

人工智能 · 计算机科学 2026-04-07 Yuwen Zhai , Runze Li , Liang Wang , Nian Shi , Liwu Xu , Wei Zhang , Ran Lin , Bo Xu , Benlei Cui

Artificial intelligence (AI) systems increasingly match or surpass human experts in biomedical signal interpretation. However, their effective integration into clinical practice requires more than high predictive accuracy. Clinicians must…

机器学习 · 计算机科学 2025-10-27 Stefan Kraft , Andreas Theissler , Vera Wienhausen-Wilke , Gjergji Kasneci , Hendrik Lensch