English
Related papers

Related papers: Building Proactive Voice Assistants: When and How …

200 papers

Voice assistants have sharply risen in popularity in recent years, but their use has been limited mostly to simple applications like music, hands-free search, or control of internet-of-things devices. What would it take for voice assistants…

Human-Computer Interaction · Computer Science 2023-09-13 Alyssa Hwang , Natasha Oza , Chris Callison-Burch , Andrew Head

Effective error detection is crucial to prevent task disruption and maintain user trust. Traditional methods often rely on task-specific models or user reporting, which can be inflexible or slow. Recent research suggests social signals,…

Robotics · Computer Science 2025-01-14 Maia Stiber , Russell Taylor , Chien-Ming Huang

Multimodal AI Agents are AI models that have the capability of interactively and cooperatively assisting human users to solve day-to-day tasks. Augmented Reality (AR) head worn devices can uniquely improve the user experience of solving…

Artificial Intelligence · Computer Science 2025-01-17 Saptarashmi Bandyopadhyay , Vikas Bahirwani , Lavisha Aggarwal , Bhanu Guda , Lin Li , Andrea Colaco

Recent development in developing humanoid robot poses new challenges to human-machine interaction communication. A major challenge is to develop robots that can behave like and interact with human in the most natural way possible. This…

Robotics · Computer Science 2014-12-03 Ong Sing Goh , Lance Fung

Vast improvements in natural language understanding and speech recognition have paved the way for conversational interaction with computers. While conversational agents have often been used for short goal-oriented dialog, we know little…

Human-Computer Interaction · Computer Science 2020-08-20 Jessica Van Brummelen , Kevin Weng , Phoebe Lin , Catherine Yeo

Proactive agents that anticipate user needs and autonomously execute tasks hold great promise as digital assistants, yet the lack of realistic user simulation frameworks hinders their development. Existing approaches model apps as flat…

Artificial Intelligence · Computer Science 2026-04-02 Deepak Nathani , Cheng Zhang , Chang Huan , Jiaming Shan , Yinfei Yang , Alkesh Patel , Zhe Gan , William Yang Wang , Michael Saxon , Xin Eric Wang

Visual analytics (VA) is typically applied to complex data, thus requiring complex tools. While visual analytics empowers analysts in data analysis, analysts may get lost in the complexity occasionally. This highlights the need for…

Human-Computer Interaction · Computer Science 2025-07-25 Yuheng Zhao , Xueli Shu , Liwen Fan , Lin Gao , Yu Zhang , Siming Chen

Research demonstrates that the proactivity of in-vehicle conversational assistants (IVCAs) can help to reduce distractions and enhance driving safety, better meeting users' cognitive needs. However, existing IVCAs struggle with user intent…

Human-Computer Interaction · Computer Science 2024-03-15 Huifang Du , Xuejing Feng , Jun Ma , Meng Wang , Shiyu Tao , Yijie Zhong , Yuan-Fang Li , Haofen Wang

Smart speakers are gaining popularity. However, such devices can put the user's privacy at risk whenever hot-words are misinterpreted and voice data is recorded without the user's consent. To mitigate such risks, smart speakers provide…

Human-Computer Interaction · Computer Science 2019-11-19 Christian Tiefenau , Maximilian Häring , Eva Gerlitz , Emanuel von Zezschwitz

Intelligent conversational assistants, such as Apple's Siri, Microsoft's Cortana, and Amazon's Echo, have quickly become a part of our digital life. However, these assistants have major limitations, which prevents users from conversing with…

Human-Computer Interaction · Computer Science 2017-08-11 Ting-Hao Kenneth Huang , Walter S. Lasecki , Amos Azaria , Jeffrey P. Bigham

Determining how voice assistants should broker consent to share data with third party software has proven to be a complex problem. Devices often require users to switch to companion smartphone apps in order to navigate permissions menus for…

Human-Computer Interaction · Computer Science 2022-04-22 William Seymour , Mark Cote , Jose Such

The technology of Conversational AI has made significant advancements over the last eighteen months. As a consequence, conversational agents are likely to be deployed in the near future that are designed to pursue targeted influence…

Human-Computer Interaction · Computer Science 2024-12-30 Louis Rosenberg

Interactive storytelling is vital for preschooler development. While children's interactive partners have traditionally been their parents and teachers, recent advances in artificial intelligence (AI) have sparked a surge of AI-based…

Human-Computer Interaction · Computer Science 2024-09-04 Yuling Sun , Jiaju Chen , Bingsheng Yao , Jiali Liu , Dakuo Wang , Xiaojuan Ma , Yuxuan Lu , Ying Xu , Liang He

The adoption of modern technologies for use in healthcare has become an inevitable change. The emergence of artificial intelligence drives this digital disruption. Artificial intelligence has augmented machine capabilities to act like and…

Human-Computer Interaction · Computer Science 2023-05-23 Akiri Surely

Robotic assistants in long-term human-robot collaboration need to assist users under partial observations while leveraging cross-day interaction history. However, human traits and routines are often unknown at the beginning of…

Robotics · Computer Science 2026-05-26 Chengbo He , Sheng Li , Chenyang Ma , Bochao Zou , Li Sun , Jiansheng Chen , Junliang Xing , Yuanchun Shi , Huimin Ma

Despite significant improvements in automatic speech recognition and spoken language understanding - human interaction with Virtual Personal Assistants (VPAs) through speech remains irregular and sporadic. According to recent studies,…

Human-Computer Interaction · Computer Science 2018-07-13 Mateusz Dubiel , Martin Halvey , Leif Azzopardi

Conversational Agents (CAs) acting as peer supporters have been widely studied and demonstrated beneficial for people's mental health. However, previous peer support CAs either are user-initiated or follow predefined rules to initiate the…

Human-Computer Interaction · Computer Science 2024-08-07 Tianjian Liu , Hongzheng Zhao , Yuheng Liu , Xingbo Wang , Zhenhui Peng

Current Graphical User Interface (GUI) agents operate primarily under a reactive paradigm: a user must provide an explicit instruction for the agent to execute a task. However, an intelligent AI assistant should be proactive, which is…

Artificial Intelligence · Computer Science 2026-03-10 Yuxiang Chai , Shunye Tang , Han Xiao , Rui Liu , Hongsheng Li

Many businesses and consumers are extending the capabilities of voice-based services such as Amazon Alexa, Google Home, Microsoft Cortana, and Apple Siri to create custom voice experiences (also known as skills). As the number of these…

Computation and Language · Computer Science 2019-11-18 Maryam Fazel-Zarandi , Sampat Biswas , Ryan Summers , Ahmed Elmalt , Andy McCraw , Michael McPhilips , John Peach

Generative AI agents equate understanding with resolving explicit queries, an assumption that confines interaction to what users can articulate. This assumption breaks down when users themselves lack awareness of what is missing, risky, or…

Computers and Society · Computer Science 2026-02-18 Kirandeep Kaur , Xingda Lyu , Chirag Shah