English
Related papers

Related papers: Building Proactive Voice Assistants: When and How …

200 papers

This paper addresses the problem of synthesizing the behavior of an AI agent that provides proactive task assistance to a human in settings like factory floors where they may coexist in a common environment. Unlike in the case of requested…

Artificial Intelligence · Computer Science 2021-09-07 Anagha Kulkarni , Siddharth Srivastava , Subbarao Kambhampati

Using robots in educational contexts has already shown to be beneficial for a student's learning and social behaviour. For levitating them to the next level of providing more effective and human-like tutoring, the ability to adapt to the…

Robotics · Computer Science 2022-12-21 Matthias Kraus , Diana Betancourt , Wolfgang Minker

Recent advancements in LLM agents are gradually shifting from reactive, text-based paradigms toward proactive, multimodal interaction. However, existing benchmarks primarily focus on reactive responses, overlooking the complexities of…

Artificial Intelligence · Computer Science 2026-05-05 Ke Xu , Yuhao Wang , Yu Wang

The rise of personal assistant agents, e.g., OpenClaw, highlights the growing potential of large language models to support users across everyday life and work. A core challenge in these settings is proactive assistance, since users often…

Artificial Intelligence · Computer Science 2026-05-20 Haoran Zhang , Luxin Xu , Zhilin Wang , Runquan Gui , Shunkai Zhang , Haodi Lei , Zihao He , Bingsu He , Chicheng Qin , Tong Zhu , Xiaoye Qu , Yang Yang , Yu Cheng , Yafu Li

Information-Seeking Dialogue (ISD) agents aim to provide accurate responses to user queries. While proficient in directly addressing user queries, these agents, as well as LLMs in general, predominantly exhibit reactive behavior, lacking…

Computation and Language · Computer Science 2024-11-19 Jing Yang Lee , Seokhwan Kim , Kartik Mehta , Jiun-Yu Kao , Yu-Hsiang Lin , Arpit Gupta

Voice assistants provide users a new way of interacting with digital products, allowing them to retrieve information and complete tasks with an increased sense of control and flexibility. Such products are comprised of several machine…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-27 Shachaf Poran , Gil Amsalem , Amit Beka , Dmitri Goldenberg

Proactive AR agents promise context-aware assistance, but their interactions often rely on explicit voice prompts or responses, which can be disruptive or socially awkward. We introduce Sensible Agent, a framework designed for unobtrusive…

Human-Computer Interaction · Computer Science 2025-11-03 Geonsun Lee , Min Xia , Nels Numan , Xun Qian , David Li , Yanhe Chen , Achin Kulshrestha , Ishan Chatterjee , Yinda Zhang , Dinesh Manocha , David Kim , Ruofei Du

Current in-IDE AI coding tools typically rely on time-consuming manual prompting and context management, whereas proactive alternatives that anticipate developer needs without explicit invocation remain underexplored. Understanding when…

Human-Computer Interaction · Computer Science 2026-01-16 Nadine Kuo , Agnia Sergeyuk , Valerie Chen , Maliheh Izadi

One of the long-standing aspirations in conversational AI is to allow them to autonomously take initiatives in conversations, i.e., being proactive. This is especially challenging for multi-party conversations. Prior NLP research focused…

Human-Computer Interaction · Computer Science 2025-02-19 Xingyu Bruce Liu , Shitao Fang , Weiyan Shi , Chien-Sheng Wu , Takeo Igarashi , Xiang Anthony Chen

Conversational agents have been studied as tools to scaffold planning and self-reflection for productivity and well-being. While prior work has demonstrated positive outcomes, we still lack a clear understanding of what drives these results…

Human-Computer Interaction · Computer Science 2026-02-06 Adnan Abbas , Caleb Wohn , Arnav Jagtap , Eugenia H Rho , Young-Ho Kim , Sang Won Lee

Artificial intelligence (AI) assistants are increasingly embedded in workplace tools, raising the question of how initiative-taking shapes adoption. Prior work highlights trust and expectation mismatches as barriers, but the underlying…

Human-Computer Interaction · Computer Science 2026-04-28 Dana Harari , Ofra Amir

Intelligent agents such as Alexa, Siri, and Google Assistant are now built into streaming TV systems, allowing people to use voice input to navigate the increasingly complex set of apps available on a TV. However, these systems typically…

Human-Computer Interaction · Computer Science 2019-05-16 Sarah McRoberts , Joshua Wissbroecker , Ruotong Wang , F. Maxwell Harper

Coding agents are rapidly changing the landscape of software development, moving from inline completion to autonomous systems that edit repositories, open pull requests, respond to issues, and run scheduled or webhook triggered routines…

Software Engineering · Computer Science 2026-05-11 Nghi D. Q. Bui , Georgios Evangelopoulos

Agents powered by large language models have shown remarkable abilities in solving complex tasks. However, most agent systems remain reactive, limiting their effectiveness in scenarios requiring foresight and autonomous decision-making. In…

Proactive dialogue system is able to lead the conversation to a goal topic and has advantaged potential in bargain, persuasion and negotiation. Current corpus-based learning manner limits its practical application in real-world scenarios.…

Information Retrieval · Computer Science 2022-04-18 Wenqiang Lei , Yao Zhang , Feifan Song , Hongru Liang , Jiaxin Mao , Jiancheng Lv , Zhenglu Yang , Tat-Seng Chua

While AI agents demonstrate remarkable capabilities in reasoning and tool use, they remain fundamentally reactive: they compute responses only after explicit user prompts. This paradigm ignores a critical opportunity: the idle time between…

Computation and Language · Computer Science 2026-05-27 Haoyi Hu , Qirong Lyu , Xianghan Kong , Weiwen Liu , Jianghao Lin , Zixuan Guo , Yan Xu , Yasheng Wang , Weinan Zhang , Yong Yu

Hand interactions are increasingly used as the primary input modality in immersive environments, but they are not always feasible due to situational impairments, motor limitations, and environmental constraints. Speech interfaces have been…

Human-Computer Interaction · Computer Science 2025-07-25 Chen Liang , Yuxuan Liu , Martez Mott , Anhong Guo

A proactive dialogue system has the ability to proactively lead the conversation. Different from the general chatbots which only react to the user, proactive dialogue systems can be used to achieve some goals, e.g., to recommend some items…

Computation and Language · Computer Science 2021-07-20 Yutao Zhu , Jian-Yun Nie , Kun Zhou , Pan Du , Hao Jiang , Zhicheng Dou

Enterprise conversational AI systems are becoming increasingly popular to assist users in completing daily tasks such as those in marketing and customer management. However, new users often struggle to ask effective questions, especially in…

Computation and Language · Computer Science 2024-12-17 Xiaobin Shen , Daniel Lee , Sumit Ranjan , Sai Sree Harsha , Pawan Sevak , Yunyao Li

Recently, spoken dialogue systems have been widely deployed in a variety of applications, serving a huge number of end-users. A common issue is that the errors resulting from noisy utterances, semantic misunderstandings, or lack of…

Computation and Language · Computer Science 2022-12-08 Wei Shen , Xiaonan He , Chuheng Zhang , Xuyun Zhang , Jian XIe