English
Related papers

Related papers: Proactive Conversational Assistant for a Procedura…

200 papers

Sequential recommendation aims to predict users' next interaction with items based on their past engagement sequence. Recently, the advent of Large Language Models (LLMs) has sparked interest in leveraging them for sequential…

Information Retrieval · Computer Science 2024-05-07 Jiayi Liao , Sihang Li , Zhengyi Yang , Jiancan Wu , Yancheng Yuan , Xiang Wang , Xiangnan He

Large language model (LLM)-based agents have demonstrated remarkable capabilities in addressing complex tasks, thereby enabling more advanced information retrieval and supporting deeper, more sophisticated human information-seeking…

Artificial Intelligence · Computer Science 2025-11-11 Yuyang Zhao , Wentao Shi , Fuli Feng , Xiangnan He

How can we train an assistive human-machine interface (e.g., an electromyography-based limb prosthesis) to translate a user's raw command signals into the actions of a robot or computer when there is no prior mapping, we cannot ask the user…

Machine Learning · Computer Science 2022-09-16 Siddharth Reddy , Sergey Levine , Anca D. Dragan

Traditional hearing aids often rely on static fittings that fail to adapt to their dynamic acoustic environments. We propose CAFA, a Context-Adaptive Fitting Advisor that provides personalized, real-time hearing aid adjustments through a…

Human-Computer Interaction · Computer Science 2025-09-09 Yingke Ding , Zeyu Wang , Xiyuxing Zhang , Hongbin Chen , Zhenan Xu

Virtual try-on has made significant progress in recent years. This paper addresses how to achieve multifunctional virtual try-on guided solely by text instructions, including full outfit change and local editing. Previous methods primarily…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Yujie Hu , Xuanyu Zhang , Weiqi Li , Jian Zhang

Interactions with virtual assistants typically start with a predefined trigger phrase followed by the user command. To make interactions with the assistant more intuitive, we explore whether it is feasible to drop the requirement that users…

Computation and Language · Computer Science 2024-03-27 Dominik Wagner , Alexander Churchill , Siddharth Sigtia , Panayiotis Georgiou , Matt Mirsamadi , Aarshee Mishra , Erik Marchi

Current service robots suffer from limited natural language communication abilities, heavy reliance on predefined commands, ongoing human intervention, and, most notably, a lack of proactive collaboration awareness in human-populated…

Robotics · Computer Science 2025-12-02 Nan Sun , Bo Mao , Yongchang Li , Di Guo , Huaping Liu

Recent advances in Natural Language Interfaces (NLIs) and Large Language Models (LLMs) have transformed our approach to NLP tasks, shifting the focus towards a more Pragmatics-based approach. This shift enables more natural interactions…

Human-Computer Interaction · Computer Science 2024-09-23 Roderick Tabalba , Christopher J. Lee , Giorgio Tran , Nurit Kirshenbaum , Jason Leigh

We present an extensible user simulation toolkit to facilitate automatic evaluation of conversational recommender systems. It builds on an established agenda-based approach and extends it with several novel elements, including user…

Information Retrieval · Computer Science 2023-01-25 Jafar Afzali , Aleksander Mark Drzewiecki , Krisztian Balog , Shuo Zhang

Large language models (LLMs) have recently been applied in software engineering to perform tasks such as translating code between programming languages, generating code from natural language, and autocompleting code as it is being written.…

Human-Computer Interaction · Computer Science 2023-02-15 Steven I. Ross , Fernando Martinez , Stephanie Houde , Michael Muller , Justin D. Weisz

AI is promising in assisting UX evaluators with analyzing usability tests, but its judgments are typically presented as non-interactive visualizations. Evaluators may have questions about test recordings, but have no way of asking them.…

Human-Computer Interaction · Computer Science 2023-03-08 Emily Kuang , Ehsan Jahangirzadeh Soure , Mingming Fan , Jian Zhao , Kristen Shinohara

Hearing-impaired individuals often face significant barriers in daily communication due to the inherent challenges of producing clear speech. To address this, we introduce the Omni-Model paradigm into assistive technology and present…

Computation and Language · Computer Science 2025-11-17 Zhiming Ma , Shiyu Gan , Junhao Zhao , Xianming Li , Qingyun Pan , Peidong Wang , Mingjun Pan , Yuhao Mo , Jiajie Cheng , Chengxin Chen , Zhonglun Cao , Chonghan Liu , Shi Cheng

We address the problem of designing a conversational avatar capable of a sequence of casual conversations with older adults. Users at risk of loneliness, social anxiety or a sense of ennui may benefit from practicing such conversations in…

Artificial Intelligence · Computer Science 2019-06-27 S. Zahra Razavi , Lenhart K. Schubert , Benjamin Kane , Mohammad Rafayet Ali , Kimberly Van Orden , Tianyi Ma

Chat-oriented dialogue systems designed to provide tangible benefits, such as sharing the latest news or preventing frailty in senior citizens, often require Proactive acquisition of specific user Information via chats on user-faVOred…

Computation and Language · Computer Science 2025-04-11 Shiki Sato , Jun Baba , Asahi Hentona , Shinji Iwata , Akifumi Yoshimoto , Koichiro Yoshino

Today's conversational agents are restricted to simple standalone commands. In this paper, we present Iris, an agent that draws on human conversational strategies to combine commands, allowing it to perform more complex tasks that it has…

Human-Computer Interaction · Computer Science 2017-07-18 Ethan Fast , Binbin Chen , Julia Mendelsohn , Jonathan Bassen , Michael Bernstein

The concept of a Human-AI team has gained increasing attention in recent years. For effective collaboration between humans and AI teammates, proactivity is crucial for close coordination and effective communication. However, the design of…

Artificial Intelligence · Computer Science 2023-06-21 Matthias Kraus , Ron Riekenbrauck , Wolfgang Minker

The next step for intelligent dialog agents is to escape their role as silent bystanders and become proactive. Well-defined proactive behavior may improve human-machine cooperation, as the agent takes a more active role during interaction…

Computation and Language · Computer Science 2023-06-23 Matthias Kraus , Nicolas Wagner , Ron Riekenbrauck , Wolfgang Minker

With the rapid development of large language models, AI assistants like ChatGPT have become increasingly integrated into people's works and lives but are limited in personalized services. In this paper, we present a plug-and-play framework…

Computation and Language · Computer Science 2024-10-15 Ruifeng Yuan , Shichao Sun , Yongqi Li , Zili Wang , Ziqiang Cao , Wenjie Li

Explainable AI (XAI) techniques aim to provide insights into predictive models and enhance user performance, yet they often fall short of these expectations. Conversational XAI assistants promise to overcome such limitations, but empirical…

Machine Learning · Computer Science 2026-05-21 Sven Kruschel , Julian Rosenberger , Lasse Bohlen , Mathias Kraus , Patrick Zschech

Deploying large language model (LLM)-driven conversational agents in enterprise settings requires prompts that are simultaneously correct at launch and resilient to the non-deterministic behavioral drift that characterizes production LLM…

Artificial Intelligence · Computer Science 2026-05-18 Keshava Chaitanya , Jahnavi Gundakaram