English
Related papers

Related papers: $\pi$-Bench: Evaluating Proactive Personal Assista…

200 papers

Large Language Models (LLMs) are becoming increasingly powerful and capable of handling complex tasks, e.g., building single agents and multi-agent systems. Compared to single agents, multi-agent systems have higher requirements for the…

Computation and Language · Computer Science 2024-08-29 Wei Wang , Dan Zhang , Tao Feng , Boyan Wang , Jie Tang

As Large Language Models transition to autonomous agents, user inputs frequently violate cooperative assumptions (e.g., implicit intent, missing parameters, false presuppositions, or ambiguous expressions), creating execution risks that…

Artificial Intelligence · Computer Science 2026-02-03 Han Bao , Zheyuan Zhang , Pengcheng Jing , Zhengqing Yuan , Kaiwen Shi , Yanfang Ye

With the rapid advancement of Large Language Models (LLMs) in code generation, human-AI interaction is evolving from static text responses to dynamic, interactive HTML-based applications, which we term MiniApps. These applications require…

Artificial Intelligence · Computer Science 2026-05-11 Zuhao Zhang , Chengyue Yu , Yuante Li , Chenyi Zhuang , Linjian Mo , Shuai Li

Tool learning empowers large language models (LLMs) as agents to use external tools and extend their utility. Existing methods employ one single LLM-based agent to iteratively select and execute tools, thereafter incorporating execution…

Computation and Language · Computer Science 2024-06-25 Zhengliang Shi , Shen Gao , Xiuyi Chen , Yue Feng , Lingyong Yan , Haibo Shi , Dawei Yin , Pengjie Ren , Suzan Verberne , Zhaochun Ren

When deployed, AI agents will encounter problems that are beyond their autonomous problem-solving capabilities. Leveraging human assistance can help agents overcome their inherent limitations and robustly cope with unfamiliar situations. We…

Machine Learning · Computer Science 2022-06-24 Khanh Nguyen , Yonatan Bisk , Hal Daumé

A long-term goal of reinforcement learning is to design agents that can autonomously interact and learn in the world. A critical challenge to such autonomy is the presence of irreversible states which require external assistance to recover…

Machine Learning · Computer Science 2022-10-20 Annie Xie , Fahim Tajwar , Archit Sharma , Chelsea Finn

The deployment of Large Language Models (LLMs) in interactive systems necessitates a deep alignment with the nuanced and dynamic preferences of individual users. Current alignment techniques predominantly address universal human values or…

Computation and Language · Computer Science 2025-12-18 Xiaotian Zhang , Yuan Wang , Ruizhe Chen , Zeya Wang , Runchen Hou , Zuozhu Liu

Learning action models from real-world human-centric interaction datasets is important towards building general-purpose intelligent assistants with efficiency. However, most existing datasets only offer specialist interaction category and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Liang Xu , Chengqun Yang , Zili Lin , Fei Xu , Yifan Liu , Congsheng Xu , Yiyi Zhang , Jie Qin , Xingdong Sheng , Yunhui Liu , Xin Jin , Yichao Yan , Wenjun Zeng , Xiaokang Yang

Mobile GUI agents are becoming critical tools to improve user experience on smart devices, with multimodal large language models (MLLMs) emerging as the dominant paradigms in this domain. Current agents, however, rely on explicit human…

Human-Computer Interaction · Computer Science 2026-03-17 Qinglong Yang , Haoming Li , Haotian Zhao , Xiaokai Yan , Jingtao Ding , Fengli Xu , Yong Li

Deep Research (DR) agents extend Large Language Models (LLMs) beyond parametric knowledge by autonomously retrieving and synthesizing evidence from large web corpora into long-form reports, enabling a long-horizon agentic paradigm. However,…

Artificial Intelligence · Computer Science 2026-02-04 Haohao Luo , Zexi Li , Yuexiang Xie , Wenhao Zhang , Yaliang Li , Ying Shen

The next step for intelligent dialog agents is to escape their role as silent bystanders and become proactive. Well-defined proactive behavior may improve human-machine cooperation, as the agent takes a more active role during interaction…

Computation and Language · Computer Science 2023-06-23 Matthias Kraus , Nicolas Wagner , Ron Riekenbrauck , Wolfgang Minker

Robotic assistants in long-term human-robot collaboration need to assist users under partial observations while leveraging cross-day interaction history. However, human traits and routines are often unknown at the beginning of…

Robotics · Computer Science 2026-05-26 Chengbo He , Sheng Li , Chenyang Ma , Bochao Zou , Li Sun , Jiansheng Chen , Junliang Xing , Yuanchun Shi , Huimin Ma

Large language model (LLM) agents are increasingly deployed to automate productivity tasks (e.g., email, scheduling, document management), but evaluating them on live services is risky due to potentially irreversible changes. Existing…

Modern AI benchmarks operate at a complexity that outpaces traditional verification methods. Tasks authored by domain experts often contain implicit assumptions, incomplete environment specifications, and brittle evaluation logic that human…

Computation and Language · Computer Science 2026-05-27 Junlin Wang , Federico Bianchi , Shang Zhu , Fan Nie , Yongchan Kwon , Bhuwan Dhingra , James Zou

Recent research on proactive conversational agents (PCAs) mainly focuses on improving the system's capabilities in anticipating and planning action sequences to accomplish tasks and achieve goals before users articulate their requests. This…

Information Retrieval · Computer Science 2024-04-22 Yang Deng , Lizi Liao , Zhonghua Zheng , Grace Hui Yang , Tat-Seng Chua

Large language models excel at following explicit instructions, but they often struggle with ambiguous or incomplete user requests, defaulting to verbose, generic responses instead of seeking clarification. We introduce InfoQuest, a…

Computation and Language · Computer Science 2025-04-29 Bryan L. M. de Oliveira , Luana G. B. Martins , Bruno Brandão , Luckeciano C. Melo

With the rise of personalized, persistent LLM agent frameworks such as OpenClaw, human-centered agentic social networks in which teams of collaborative AI agents serve individual users in a social network across multiple domains are…

Artificial Intelligence · Computer Science 2026-04-07 Prince Zizhuang Wang , Shuli Jiang

Autonomous data analysis agents are increasingly expected to conduct exploratory analysis with limited human guidance about data. However, existing benchmarks typically evaluate such agents in prior-guided settings, providing selected data…

Artificial Intelligence · Computer Science 2026-05-28 Qiaohong Zhang , Weihao Ye , Jialong Chen , Yi Luo , BoYuan Li , Bowen Deng , Zibin Zheng , Jianhao Lin , Wei-Shi Zheng , Chuan Chen

As humans delegate more tasks and decisions to artificial intelligence (AI), we risk losing control of our individual and collective futures. Relatively simple algorithmic systems already steer human decision-making, such as social media…

Computers and Society · Computer Science 2025-09-11 Benjamin Sturgeon , Daniel Samuelson , Jacob Haimes , Jacy Reese Anthis

Advances in generative AI point towards a new era of personalized applications that perform diverse tasks on behalf of users. While general AI assistants have yet to fully emerge, their potential to share personal data raises significant…

Artificial Intelligence · Computer Science 2024-09-24 Zhao Cheng , Diane Wan , Matthew Abueg , Sahra Ghalebikesabi , Ren Yi , Eugene Bagdasarian , Borja Balle , Stefan Mellem , Shawn O'Banion