English
Related papers

Related papers: Building Proactive Voice Assistants: When and How …

200 papers

The use of natural language and voice-based interfaces gradu-ally transforms how consumers search, shop, and express their preferences. The current work explores how changes in the syntactical structure of the interaction with…

Artificial Intelligence · Computer Science 2021-11-04 Christian Hildebrand , Donna Hoffman , Tom Novak

AI systems have long been expected to interact with users, answering questions, generating content, and continuing (social) conversations. Agentic AI, however, breaks from this expectation, as its primary objective is workflow execution on…

Human-Computer Interaction · Computer Science 2026-05-05 Eunchae Jang , S. Shyam Sundar

As the use of interactive AI systems becomes increasingly prevalent in our daily lives, it is crucial to understand how individuals feel when interacting with such systems. In this work, we investigate the comfort level of individuals when…

Human-Computer Interaction · Computer Science 2023-03-01 Yi Ru Wang , Jiafei Duan , Sidharth Talia , Hao Zhu

Active listening is a well-known skill applied in human communication to build intimacy and elicit self-disclosure to support a wide variety of cooperative tasks. When applied to conversational UIs, active listening from machines can also…

Human-Computer Interaction · Computer Science 2022-09-26 Eugene Cho , Nasim Motalebi , S. Shyam Sundar , Saeed Abdullah

Many companies, including Google, Amazon, and Apple, offer voice assistants as a convenient solution for answering general voice queries and accessing their services. These voice assistants have gained popularity and can be easily accessed…

Human-Computer Interaction · Computer Science 2024-09-16 Tina Khezresmaeilzadeh , Elaine Zhu , Kiersten Grieco , Daniel J. Dubois , Konstantinos Psounis , David Choffnes

Recommender systems mainly tailor personalized recommendations according to user interests learned from user feedback. However, such recommender systems passively cater to user interests and even reinforce existing interests in the feedback…

Information Retrieval · Computer Science 2024-03-13 Shuxian Bi , Wenjie Wang , Hang Pan , Fuli Feng , Xiangnan He

The advent of increasingly powerful language models has raised expectations for language-based interactions. However, controlling these models is a challenge, emphasizing the need to be able to investigate the feasibility and value of their…

To cooperate with humans effectively, virtual agents need to be able to understand and execute language instructions. A typical setup to achieve this is with a scripted teacher which guides a virtual agent using language instructions.…

Computation and Language · Computer Science 2019-08-15 Mathijs Mul , Diane Bouchacourt , Elia Bruni

Current large language model agents predominantly operate under a reactive paradigm, responding only to immediate user queries within short-term sessions. This limitation hinders their ability to maintain long-term user's intents and…

Artificial Intelligence · Computer Science 2026-01-15 Qinglong Shi , Donghai Wang , Hantao Zhou , Jiguo Li , Jun Xu , Jiuchong Gao , Jinghua Hao , Renqing He

Conversational human-AI interaction (CHAI) have recently driven mainstream adoption of AI. However, CHAI poses two key challenges for designers and researchers: users frequently have ambiguous goals and an incomplete understanding of AI…

Human-Computer Interaction · Computer Science 2025-01-31 Arthur Caetano , Kavya Verma , Atieh Taheri , Radha Kumaran , Zichen Chen , Jiaao Chen , Tobias Höllerer , Misha Sra

Phone automation agents aim to autonomously perform a given natural-language user request, such as scheduling appointments or booking a hotel. While much research effort has been devoted to screen understanding and action planning, complex…

Human-Computer Interaction · Computer Science 2025-04-02 Noam Kahlon , Guy Rom , Anatoly Efros , Filippo Galgani , Omri Berkovitch , Sapir Caduri , William E. Bishop , Oriana Riva , Ido Dagan

Conversational AI agents are commonly applied within single-user, turn-taking scenarios. The interaction mechanics of these scenarios are trivial: when the user enters a message, the AI agent produces a response. However, the interaction…

Assistance in collaborative manipulation is often initiated by user instructions, making high-level reasoning request-driven. In fluent human teamwork, however, partners often infer the next helpful step from the observed outcome of an…

Robotics · Computer Science 2026-03-26 Fengkai Liu , Hao Su , Haozhuang Chi , Rui Geng , Congzhi Ren , Xuqing Liu , Yucheng Xu , Yuichi Ohsita , Liyun Zhang

In general, self help systems are being increasingly deployed by service based industries because they are capable of delivering better customer service and increasingly the switch is to voice based self help systems because they provide a…

Computation and Language · Computer Science 2015-04-08 Sunil Kumar Kopparapu

Building socially-intelligent AI agents (Social-AI) is a multidisciplinary, multimodal research goal that involves creating agents that can sense, perceive, reason about, learn from, and respond to affect, behavior, and cognition of other…

Human-Computer Interaction · Computer Science 2024-10-10 Leena Mathur , Paul Pu Liang , Louis-Philippe Morency

The field of eXplainable Artificial Intelligence (XAI) is increasingly recognizing the need to personalize and/or interactively adapt the explanation to better reflect users' explanation needs. While dialogue-based approaches to XAI have…

Machine Learning · Computer Science 2024-08-15 Dimitry Mindlin , Amelie Sophie Robrecht , Michael Morasch , Philipp Cimiano

Proactive task-oriented dialogue (TOD), such as outbound sales, demands a persuasive agent that actively probes the user's concerns and steers the conversation toward acceptance within a bounded number of turns. Yet post-trained LLMs are…

Artificial Intelligence · Computer Science 2026-05-22 Hongbin Zhang , Ning Gao , Yuqin Dai , Ruiyuan Wu , Jinpeng Wang , Rena Wei Gao , Bingdong Tan , Shuzheng Gao , Zongjie Li , Chaozheng Wang

Transparency regarding the processing of personal data in online services is a necessary precondition for informed decisions on whether or not to share personal data. In this paper, we argue that privacy interfaces shall incorporate the…

Software Engineering · Computer Science 2023-04-18 Elias Grünewald , Johannes M. Halkenhäußer , Nicola Leschke , Johanna Washington , Cristina Paupini , Frank Pallas

Recent studies have begun to explore proactive large language model (LLM) agents that provide unobtrusive assistance by automatically leveraging contextual information, such as in code editing and in-app suggestions. However, most focus on…

Artificial Intelligence · Computer Science 2026-05-08 Bufang Yang , Lilin Xu , Liekang Zeng , Yunqi Guo , Siyang Jiang , Wenrui Lu , Kaiwei Liu , Yixuan Li , Xiaofan Jiang , Guoliang Xing , Zhenyu Yan

Voice assistants have been successfully adopted for simple, routine tasks, such as asking for the weather or setting an alarm. However, as people get more familiar with voice assistants, they may increase their expectations for more complex…

Human-Computer Interaction · Computer Science 2020-03-09 Xiao Ma , Ariel Liu