English
Related papers

Related papers: Implicit Intelligence -- Evaluating Agents on What…

200 papers

Proactive agents that anticipate user intentions without explicit prompts represent a significant evolution in human-AI interaction, promising to reduce cognitive load and streamline workflows. However, existing datasets suffer from two…

Human-Computer Interaction · Computer Science 2026-02-11 Yuanbo Tang , Huaze Tang , Tingyu Cao , Lam Nguyen , Anping Zhang , Xinwen Cao , Chunkang Liu , Wenbo Ding , Yang Li

Artificially intelligent systems, given a set of non-trivial ethical rules to follow, will inevitably be faced with scenarios which call into question the scope of those rules. In such cases, human reasoners typically will engage in…

Artificial Intelligence · Computer Science 2019-11-06 John Licato , Zaid Marji , Sophia Abraham

A new generation of AI models generates step-by-step reasoning text before producing an answer. This text appears to offer a human-readable window into their computation process, and is increasingly relied upon for transparency and…

Human-Computer Interaction · Computer Science 2025-08-29 Mosh Levy , Zohar Elyoseph , Yoav Goldberg

While GUI agents have shown strong performance under explicit and completion instructions, real-world deployment requires aligning with users' more complex implicit intents. In this work, we highlight Hierarchical Implicit Intent Alignment…

Artificial Intelligence · Computer Science 2026-05-14 Yibo Lyu , Gongwei Chen , Rui Shao , Weili Guan , Liqiang Nie

Artificial Intelligence (AI) is taking on increasingly autonomous roles, e.g., browsing the web as a research assistant and managing money. But specifying goals and restrictions for AI behavior is difficult. Similar to how parties to a…

Computation and Language · Computer Science 2023-01-31 John J. Nay

Many benchmarks show that large language models can answer direct questions about culture. We study a different question: do they also change how they speak when culture is only implied by the situation? We evaluate 60 culturally grounded…

Large language models (LLMs) have demonstrated remarkable capabilities across a range of text-generation tasks. However, LLMs still struggle with problems requiring multi-step decision-making and environmental feedback, such as online…

Artificial Intelligence · Computer Science 2025-02-18 Zhenfang Chen , Delin Chen , Rui Sun , Wenjun Liu , Chuang Gan

Agentic AI increasingly intervenes proactively by inferring users' situations from contextual data yet often fails for lack of principled judgment about when, why, and whether to act. We address this gap by proposing a conceptual model that…

Artificial Intelligence · Computer Science 2026-02-27 Soyoung Jung , Daehoo Yoon , Sung Gyu Koh , Young Hwan Kim , Yehan Ahn , Sung Park

This article presents early findings from designing, deploying and evaluating an AI-based educational agent deployed as the primary instructor in a graduate-level Cloud Computing course at IISc. We detail the design of a Large Language…

Computers and Society · Computer Science 2025-10-24 Yogesh Simmhan , Varad Kulkarni

Large Language Models (LLMs) based autonomous agents demonstrate multifaceted capabilities to contribute substantially to economic production. However, existing benchmarks remain focused on single agentic capability, failing to capture…

Artificial Intelligence · Computer Science 2026-04-24 Keyu Li , Junhao Shi , Yang Xiao , Mohan Jiang , Jie Sun , Yunze Wu , Dayuan Fu , Shijie Xia , Xiaojie Cai , Tianze Xu , Weiye Si , Wenjie Li , Dequan Wang , Pengfei Liu

Artificial Intelligence (AI) agents have rapidly evolved from specialized, rule-based programs to versatile, learning-driven autonomous systems capable of perception, reasoning, and action in complex environments. The explosion of data,…

A fundamental bottleneck in human-AI collaboration is the ``intention expression gap," the difficulty for humans to effectively convey complex, high-dimensional thoughts to AI. This challenge often traps users in inefficient trial-and-error…

Artificial Intelligence · Computer Science 2026-02-02 Jianwen Sun , Yukang Feng , Yifan Chang , Chuanhao Li , Zizhen Li , Jiaxin Ai , Fanrui Zhang , Yu Dai , Kaipeng Zhang

Effective communication is an essential component in collaborative multi-agent systems. Situations where explicit messaging is not feasible have been common in human society throughout history, which motivate the study of implicit…

Multiagent Systems · Computer Science 2025-02-11 Han Wang , Binbin Chen , Tieying Zhang , Baoxiang Wang

Large language models have advanced web agents, yet current agents lack personalization capabilities. Since users rarely specify every detail of their intent, practical web agents must be able to interpret ambiguous queries by inferring…

Computation and Language · Computer Science 2026-05-28 Serin Kim , Sangam Lee , Dongha Lee

AI agents deployed as persistent assistants must maintain correct beliefs as their information environment evolves. In practice, evidence is scattered across heterogeneous sources that often contradict one another, new information can…

Machine Learning · Computer Science 2026-05-19 Haonian Ji , Kaiwen Xiong , Siwei Han , Peng Xia , Shi Qiu , Yiyang Zhou , Jiaqi Liu , Jinlong Li , Bingzhou Li , Zeyu Zheng , Cihang Xie , Huaxiu Yao

Is explainability a false promise? This debate has emerged from the insufficient evidence that explanations help people in situations they are introduced for. More human-centered, application-grounded evaluations of explanations are needed…

Computation and Language · Computer Science 2024-11-06 Fateme Hashemi Chaleshtori , Atreya Ghosal , Alexander Gill , Purbid Bambroo , Ana Marasović

Generative artificial intelligence (AI) agents are increasingly embedded in collaborative learning environments, yet their impact on the processes of argumentative knowledge construction remains insufficiently understood. Emerging…

Human-Computer Interaction · Computer Science 2025-12-11 Lixiang Yan , Yueqiao Jin , Linxuan Zhao , Roberto Martinez-Maldonado , Xinyu Li , Xiu Guan , Wenxin Guo , Xibin Han , Dragan Gašević

A long-standing vision of computing is the personal AI system: one that understands us well enough to address our underlying needs. Today's AI focuses on what users do, ignoring why they might be doing such things in the first place. As a…

Human-Computer Interaction · Computer Science 2026-04-10 Dora Zhao , Michelle S. Lam , Diyi Yang , Michael S. Bernstein

The rapid development of Artificial Intelligence (AI) requires developers and designers of AI systems to focus on the collaboration between humans and machines. AI explanations of system behavior and reasoning are vital for effective…

Human-Computer Interaction · Computer Science 2022-10-11 Ruben S. Verhagen , Siddharth Mehrotra , Mark A. Neerincx , Catholijn M. Jonker , Myrthe L. Tielman

Conversational human-AI interaction (CHAI) have recently driven mainstream adoption of AI. However, CHAI poses two key challenges for designers and researchers: users frequently have ambiguous goals and an incomplete understanding of AI…

Human-Computer Interaction · Computer Science 2025-01-31 Arthur Caetano , Kavya Verma , Atieh Taheri , Radha Kumaran , Zichen Chen , Jiaao Chen , Tobias Höllerer , Misha Sra