English
Related papers

Related papers: Detecting Interlocutor Confusion in Situated Human…

200 papers

Recently, large language models have shown great potential to transform online medical consultation. Despite this, most research targets improving diagnostic accuracy with ample information, often overlooking the inquiry phase. Some studies…

Computation and Language · Computer Science 2025-03-12 Zhaocheng Liu , Quan Tu , Wen Ye , Yu Xiao , Zhishou Zhang , Hengfu Cui , Yalun Zhu , Qiang Ju , Shizheng Li , Jian Xie

As voice assistants (VAs) become increasingly integrated into daily life, the need for emotion-aware systems that can recognize and respond appropriately to user emotions has grown. While significant progress has been made in speech emotion…

Human-Computer Interaction · Computer Science 2025-02-24 Yong Ma , Yuchong Zhang , Di Fu , Stephanie Zubicueta Portales , Danica Kragic , Morten Fjeld

There is growing concern that AI chatbots might fuel delusional beliefs in users. Some have suggested that humans and chatbots mutually reinforce false beliefs over time, but quantitative evidence is lacking. Using a unique dataset of chat…

Computation and Language · Computer Science 2026-04-29 Ashish Mehta , Jared Moore , Jacy Reese Anthis , William Agnew , Eric Lin , Peggy Yin , Desmond C. Ong , Nick Haber , Carol Dweck

Human communication often relies on visual cues to resolve ambiguity. While humans can intuitively integrate these cues, AI systems often find it challenging to engage in sophisticated multimodal reasoning. We introduce VAGUE, a benchmark…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Heejeong Nam , Jinwoo Ahn , Keummin Ka , Jiwan Chung , Youngjae Yu

Task-Oriented Dialogue (TOD) systems are drawing more and more attention in recent studies. Current methods focus on constructing pre-trained models or fine-tuning strategies while the evaluation of TOD is limited by a policy mismatch…

Computation and Language · Computer Science 2022-10-27 Qinyuan Cheng , Linyang Li , Guofeng Quan , Feng Gao , Xiaofeng Mou , Xipeng Qiu

Persona can function as the prior knowledge for maintaining the consistency of dialogue systems. Most of previous studies adopted the self persona in dialogue whose response was about to be selected from a set of candidates or directly…

Computation and Language · Computer Science 2021-05-24 Jia-Chen Gu , Hui Liu , Zhen-Hua Ling , Quan Liu , Zhigang Chen , Xiaodan Zhu

Investigating cooperativity of interlocutors is central in studying pragmatics of dialogue. Models of conversation that only assume cooperative agents fail to explain the dynamics of strategic conversations. Thus, we investigate the ability…

Computation and Language · Computer Science 2022-07-18 Anthony Sicilia , Tristan Maidment , Pat Healy , Malihe Alikhani

The recent abundance of conversational data on the Web and elsewhere calls for effective NLP systems for dialog understanding. Complete utterance-level understanding often requires context understanding, defined by nearby utterances. In…

Computation and Language · Computer Science 2020-10-23 Deepanway Ghosal , Navonil Majumder , Rada Mihalcea , Soujanya Poria

This work investigates the task-oriented dialogue problem in mixed-domain settings. We study the effect of alternating between different domains in sequences of dialogue turns using two related state-of-the-art dialogue systems. We first…

Computation and Language · Computer Science 2019-09-06 Tho Luong Chi , Phuong Le-Hong

Most human interactions occur in the form of spoken conversations where the semantic meaning of a given utterance depends on the context. Each utterance in spoken conversation can be represented by many semantic and speaker attributes, and…

Computation and Language · Computer Science 2023-05-02 Siddhant Arora , Hayato Futami , Emiru Tsunoo , Brian Yan , Shinji Watanabe

Modern virtual personal assistants provide a convenient interface for completing daily tasks via voice commands. An important consideration for these assistants is the ability to recover from automatic speech recognition (ASR) and natural…

Computation and Language · Computer Science 2017-12-13 Maryam Fazel-Zarandi , Shang-Wen Li , Jin Cao , Jared Casale , Peter Henderson , David Whitney , Alborz Geramifard

Understanding the needs of a variety of distinct user groups is vital in designing effective, desirable dialogue systems that will be adopted by the largest possible segment of the population. Despite the increasing popularity of dialogue…

Human-Computer Interaction · Computer Science 2019-02-13 Libby Ferland , Thomas Huffstutler , Jacob Rice , Joan Zheng , Shi Ni , Maria Gini

We present a virtual reality (VR) environment featuring conversational avatars powered by a locally-deployed LLM, integrated with automatic speech recognition (ASR), text-to-speech (TTS), and lip-syncing. Through a pilot study, we explored…

Human-Computer Interaction · Computer Science 2025-01-08 Mykola Maslych , Christian Pumarada , Amirpouya Ghasemaghaei , Joseph J. LaViola

Dialogue systems are a popular natural language processing (NLP) task as it is promising in real-life applications. It is also a complicated task since many NLP tasks deserving study are involved. As a result, a multitude of novel works on…

Computation and Language · Computer Science 2022-03-31 Jinjie Ni , Tom Young , Vlad Pandelea , Fuzhao Xue , Erik Cambria

User simulation is a promising approach for automatically training and evaluating conversational information access agents, enabling the generation of synthetic dialogues and facilitating reproducible experiments at scale. However, the…

Information Retrieval · Computer Science 2024-06-28 Nolwenn Bernard , Krisztian Balog

The use of chatbots has spread, generating great interest in the industry for the possibility of automating tasks within the execution of their processes. The implementation of chatbots, however simple, is a complex endeavor that involves…

Software Engineering · Computer Science 2021-09-03 Bedilia Estrada-Torres , Adela del-Río-Ortega , Manuel Resinas

The collaborative design process is intrinsically complicated and dynamic, and researchers have long been exploring how to enhance efficiency in this process. As Artificial Intelligence technology evolves, it has been widely used as a…

Human-Computer Interaction · Computer Science 2025-02-25 Zhuoyi Cheng , Pei Chen , Wenzheng Song , Hongbo Zhang , Zhuoshu Li , Lingyun Sun

In Task-Oriented Dialogue (TOD) systems, correctly updating the system's understanding of the user's needs is key to a smooth interaction. Traditionally TOD systems are composed of several modules that interact with one another. While each…

Computation and Language · Computer Science 2023-11-21 Lucas Druart , Léo Jacqmin , Benoît Favre , Lina Maria Rojas-Barahona , Valentin Vielzeuf

Data for human-human spoken dialogues for research and development are currently very limited in quantity, variety, and sources; such data are even scarcer in healthcare. In this work, we investigate fast prototyping of a dialogue…

Current image generation systems produce high-quality images but struggle with ambiguous user prompts, making interpretation of actual user intentions difficult. Many users must modify their prompts several times to ensure the generated…