中文
相关论文

相关论文: Beyond the Black Box: Interpretability of Agentic …

200 篇论文

With machine learning models being increasingly used to aid decision making even in high-stakes domains, there has been a growing interest in developing interpretable models. Although many supposedly interpretable models have been proposed,…

The problem of human trust in artificial intelligence is one of the most fundamental problems in applied machine learning. Our processes for evaluating AI trustworthiness have substantial ramifications for ML's impact on science, health,…

机器学习 · 计算机科学 2022-02-14 Max W. Shen

Not only automation of manufacturing processes but also automation of automation procedures itself become increasingly relevant to automation research. In this context, automated capability assessment, mainly leveraged by deep learning…

人工智能 · 计算机科学 2022-01-31 Raoul Schönhof , Artem Werner , Jannes Elstner , Boldizsar Zopcsak , Ramez Awad , Marco Huber

Much of the research on learning symbolic models of AI agents focuses on agents with stationary models. This assumption fails to hold in settings where the agent's capabilities may change as a result of learning, adaptation, or other…

人工智能 · 计算机科学 2022-05-20 Rashmeet Kaur Nayyar , Pulkit Verma , Siddharth Srivastava

As companies enter the race for agentic AI adoption, fears surface around agentic autonomy and its subsequent risks. These fears compound as companies scale their agentic AI adoption with low-code applications, without a comparable scaling…

人机交互 · 计算机科学 2026-04-17 Yomna Elsayed , Cecily Jones

AI-based systems, currently driven largely by LLMs and tool-using agentic harnesses, are increasingly discussed as a possible threat to software engineering. Foundation models get stronger, agents can plan and act across multiple steps, and…

软件工程 · 计算机科学 2026-04-24 Robert Feldt , Per Lenberg , Julian Frattini , Dhasarathy Parthasarathy

Earth Observation (EO) is moving beyond static prediction toward multi-step analytical workflows that require coordinated reasoning over data, tools, and geospatial state. While foundation models and vision-language models have advanced…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Muhammad Akhtar Munir , Muhammad Umer Sheikh , Akashah Shabbir , Muhammad Haris Khan , Fahad Khan , Xiao Xiang Zhu , Begum Demir , Salman Khan

Modern data analytics underpinned by machine learning techniques has become a key enabler to the automation of data-led decision making. As an important branch of state-of-the-art data analytics, business process predictions are also faced…

人工智能 · 计算机科学 2021-07-22 Chun Ouyang , Renuka Sindhgatta , Catarina Moreira

The implementation of agentic AI systems has the potential of providing more helpful AI systems in a variety of applications. These systems work autonomously towards a defined goal with reduced external control. Despite their potential, one…

人工智能 · 计算机科学 2025-11-13 Niclas Flehmig , Mary Ann Lundteigen , Shen Yin

The importance of explainability in AI has become a pressing concern, for which several explainable AI (XAI) approaches have been recently proposed. However, most of the available XAI techniques are post-hoc methods, which however may be…

机器学习 · 计算机科学 2022-04-15 Leonardo Lucio Custode , Giovanni Iacca

Deep reinforcement learning (RL) has recently led to many breakthroughs on a range of complex control tasks. However, the agent's decision-making process is generally not transparent. The lack of interpretability hinders the applicability…

计算机视觉与模式识别 · 计算机科学 2021-03-22 Wenjie Shi , Gao Huang , Shiji Song , Zhuoyuan Wang , Tingyu Lin , Cheng Wu

Significant digitalization of financial services in a short period of time has led to an urgent demand to have autonomous, transparent and real-time credit risk decision making systems. The traditional machine learning models are effective…

人工智能 · 计算机科学 2026-01-06 Chandra Sekhar Kubam

With recent advancements in multi-agent generative AI (Gen AI), technology organizations like Microsoft are adopting these complex tools, redefining AI agents as active collaborators in complex workflows rather than as passive tools. In…

人机交互 · 计算机科学 2025-10-09 Suchismita Naik , Austin L. Toombs , Amanda Snellinger , Scott Saponas , Amanda K. Hall

The implementation of Artificial Intelligence (AI) systems in the manufacturing domain enables higher production efficiency, outstanding performance, and safer operations, leveraging powerful tools such as deep learning and reinforcement…

人工智能 · 计算机科学 2021-07-07 Georgios Sofianidis , Jože M. Rožanec , Dunja Mladenić , Dimosthenis Kyriazis

Nowadays, agentic AI is emerging as a transformative paradigm for next-generation communication networks, promising to evolve large language models (LLMs) from passive chatbots into autonomous operators. However, unleashing this potential…

网络与互联网体系结构 · 计算机科学 2026-01-14 Yinqiu Liu , Ruichen Zhang , Dusit Niyato , Abbas Jamalipour , Trung Q. Duong , Dong In Kim

To truly understand vision models, we must not only interpret their learned features but also validate these interpretations through controlled experiments. While earlier work offers either rich semantics or direct control, few post-hoc…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Samuel Stevens , Wei-Lun Chao , Tanya Berger-Wolf , Yu Su

Complex black-box predictive models may have high performance, but lack of interpretability causes problems like lack of trust, lack of stability, sensitivity to concept drift. On the other hand, achieving satisfactory accuracy of…

机器学习 · 计算机科学 2020-02-12 Alicja Gosiewska , Przemyslaw Biecek

Predicting default is essential for banks to ensure profitability and financial stability. While modern machine learning methods often outperform traditional regression techniques, their lack of transparency limits their use in regulated…

机器学习 · 计算机科学 2025-09-16 Sagi Schwartz , Qinling Wang , Fang Fang

The rapid evolution of machine learning (ML) has led to the widespread adoption of complex "black box" models, such as deep neural networks and ensemble methods. These models exhibit exceptional predictive performance, making them…

机器学习 · 计算机科学 2025-03-28 Moncef Garouani , Josiane Mothe , Ayah Barhrhouj , Julien Aligon

Deep learning models trained on extensive Electronic Health Records (EHR) data have achieved high accuracy in diagnosis prediction, offering the potential to assist clinicians in decision-making and treatment planning. However, these models…

人工智能 · 计算机科学 2025-09-30 Xiaoxue Han , Pengfei Hu , Jun-En Ding , Chang Lu , Feng Liu , Yue Ning