English
Related papers

Related papers: $\tau$-Knowledge: Evaluating Conversational Agents…

200 papers

Large language model (LLM)-based agents that reason, plan, and act through tools, memory, and structured interaction are emerging as a promising paradigm for automating complex workflows. Recent systems such as OpenClaw and Claude Code…

Information Retrieval · Computer Science 2026-05-27 Yingli Zhou , Wang Shu , Yaodong Su , Wenchuan Du , Yixiang Fang , Xuemin Lin

LLM-based agents have emerged as promising tools, which are crafted to fulfill complex tasks by iterative planning and action. However, these agents are susceptible to undesired planning hallucinations when lacking specific knowledge for…

Computation and Language · Computer Science 2024-06-24 Ruixuan Xiao , Wentao Ma , Ke Wang , Yuchuan Wu , Junbo Zhao , Haobo Wang , Fei Huang , Yongbin Li

Current researches on spoken language understanding (SLU) heavily are limited to a simple setting: the plain text-based SLU that takes the user utterance as input and generates its corresponding semantic frames (e.g., intent and slots).…

Computation and Language · Computer Science 2022-01-13 Xiao Xu , Libo Qin , Kaiji Chen , Guoxing Wu , Linlin Li , Wanxiang Che

Automated planning technology has developed significantly. Designing a planning model that allows an automated agent to be capable of reacting intelligently to unexpected events in a real execution environment yet remains a challenge. This…

Artificial Intelligence · Computer Science 2019-04-23 Mohannad Babli , Eva Onaindia

Communication stands as a potent mechanism to harmonize the behaviors of multiple agents. However, existing works primarily concentrate on broadcast communication, which not only lacks practicality, but also leads to information redundancy.…

Multiagent Systems · Computer Science 2024-01-23 Chuxiong Sun , Zehua Zang , Jiabao Li , Jiangmeng Li , Xiao Xu , Rui Wang , Changwen Zheng

Deployed, autonomous AI systems must often evaluate multiple plausible courses of action (extended sequences of behavior) in novel or under-specified contexts. Despite extensive training, these systems will inevitably encounter scenarios…

Artificial Intelligence · Computer Science 2025-11-19 Steven J. Jones , Robert E. Wray , John E. Laird

The rise of agentic AI systems, where agents collaborate to perform diverse tasks, poses new challenges with observing, analyzing and optimizing their behavior. Traditional evaluation and benchmarking approaches struggle to handle the…

Artificial Intelligence · Computer Science 2025-03-11 Dany Moshkovich , Hadar Mulian , Sergey Zeltyn , Natti Eder , Inna Skarbovsky , Roy Abitbol

The rise of personal assistant agents, e.g., OpenClaw, highlights the growing potential of large language models to support users across everyday life and work. A core challenge in these settings is proactive assistance, since users often…

Artificial Intelligence · Computer Science 2026-05-20 Haoran Zhang , Luxin Xu , Zhilin Wang , Runquan Gui , Shunkai Zhang , Haodi Lei , Zihao He , Bingsu He , Chicheng Qin , Tong Zhu , Xiaoye Qu , Yang Yang , Yu Cheng , Yafu Li

AI deployed in the real-world should be capable of autonomously adapting to novelties encountered after deployment. Yet, in the field of continual learning, the reliance on novelty and labeling oracles is commonplace albeit unrealistic.…

Machine Learning · Computer Science 2024-12-24 Amanda S. Rios , Ibrahima J. Ndiour , Parual Datta , Jaroslaw Sydir , Omesh Tickoo , Nilesh Ahuja

Conversational Tree Search (V\"ath et al., 2023) is a recent approach to controllable dialog systems, where domain experts shape the behavior of a Reinforcement Learning agent through a dialog tree. The agent learns to efficiently navigate…

Computation and Language · Computer Science 2024-03-27 Dirk Väth , Lindsey Vanderlyn , Ngoc Thang Vu

Large Language Models (LLMs) have demonstrated impressive capabilities as intelligent agents capable of solving complex problems. However, effective planning in scenarios involving dependencies between API or tool calls-particularly in…

Multi-agent collaboration has emerged as a pivotal paradigm for addressing complex, distributed tasks in large language model (LLM)-driven applications. While prior research has focused on high-level architectural frameworks, the granular…

Multiagent Systems · Computer Science 2025-05-20 Haochun Wang , Sendong Zhao , Jingbo Wang , Zewen Qiang , Bing Qin , Ting Liu

The emergence of large language models has catalyzed two distinct yet interconnected paradigms in artificial intelligence: standalone AI Agents and collaborative Agentic AI ecosystems. This comprehensive study establishes a definitive…

Artificial Intelligence · Computer Science 2025-06-17 Prashik Buddhaghosh Bansod

The rise of LLM-based agents has opened new frontiers in AI applications, yet evaluating these agents remains a complex and underdeveloped area. This survey provides an in-depth overview of the emerging field of LLM agent evaluation,…

Machine Learning · Computer Science 2025-07-30 Mahmoud Mohammadi , Yipeng Li , Jane Lo , Wendy Yip

AI agents deployed as persistent assistants must maintain correct beliefs as their information environment evolves. In practice, evidence is scattered across heterogeneous sources that often contradict one another, new information can…

Machine Learning · Computer Science 2026-05-19 Haonian Ji , Kaiwen Xiong , Siwei Han , Peng Xia , Shi Qiu , Yiyang Zhou , Jiaqi Liu , Jinlong Li , Bingzhou Li , Zeyu Zheng , Cihang Xie , Huaxiu Yao

To solve difficult tasks, humans ask questions to acquire knowledge from external sources. In contrast, classical reinforcement learning agents lack such an ability and often resort to exploratory behavior. This is exacerbated as few…

Artificial Intelligence · Computer Science 2022-07-05 Iou-Jen Liu , Xingdi Yuan , Marc-Alexandre Côté , Pierre-Yves Oudeyer , Alexander G. Schwing

As large language models increasingly mediate firm - customer interactions, firms face a tradeoff: the most capable models perform well but are costly and difficult to control at scale. Existing knowledge distillation methods address this…

Computation and Language · Computer Science 2026-02-23 Tong Wang , K. Sudhir

Next-generation AI must manage vast personal data, diverse tools, and multi-step reasoning, yet most benchmarks remain context-free and single-turn. We present ASTRA-bench (Assistant Skills in Tool-use, Reasoning \& Action-planning), a…

Artificial Intelligence · Computer Science 2026-03-03 Zidi Xiu , David Q. Sun , Kevin Cheng , Maitrik Patel , Josh Date , Yizhe Zhang , Jiarui Lu , Omar Attia , Raviteja Vemulapalli , Oncel Tuzel , Meng Cao , Samy Bengio

Remarkable advancements in modern generative foundation models have enabled the development of sophisticated and highly capable autonomous agents that can observe their environment, invoke tools, and communicate with other agents to solve…

Human-Computer Interaction · Computer Science 2024-12-17 Gagan Bansal , Jennifer Wortman Vaughan , Saleema Amershi , Eric Horvitz , Adam Fourney , Hussein Mozannar , Victor Dibia , Daniel S. Weld

In today's data-driven era, fully automated end-to-end data analytics, particularly insight discovery, is critical for discovering actionable insights that assist organizations in making effective decisions. With the rapid advancement of…

Artificial Intelligence · Computer Science 2025-11-25 Xiaochuan Liu , Yuanfeng Song , Xiaoming Yin , Xing Chen