English
Related papers

Related papers: Conversations Gone Awry, But Then? Evaluating Conv…

200 papers

Conversational agents promise conversational interaction but fail to deliver. Efforts often emulate functional rules from human speech, without considering key characteristics that conversation must encapsulate. Given its potential in…

Computational thinking, and by extension, computer programming, is notoriously challenging to learn. Conversational agents and generative artificial intelligence (genAI) have the potential to facilitate this learning process by offering…

Human-Computer Interaction · Computer Science 2024-06-17 Jacob Penney , João Felipe Pimentel , Igor Steinmacher , Marco A. Gerosa

The interaction of conversational systems with users poses an exciting opportunity for improving them after deployment, but little evidence has been provided of its feasibility. In most applications, users are not able to provide the…

Computation and Language · Computer Science 2020-11-03 Jon Ander Campos , Kyunghyun Cho , Arantxa Otegi , Aitor Soroa , Gorka Azkune , Eneko Agirre

The experience and adoption of conversational search is tied to the accuracy and completeness of users' mental models -- their internal frameworks for understanding and predicting system behaviour. Thus, understanding these models can…

Human-Computer Interaction · Computer Science 2025-06-05 Chadha Degachi , Samuel Kernan Freire , Evangelos Niforatos , Gerd Kortuem

Online discourse is often perceived as polarized and unproductive. While some conversational discourse parsing frameworks are available, they do not naturally lend themselves to the analysis of contentious and polarizing discussions.…

Computation and Language · Computer Science 2020-12-09 Stepan Zakharov , Omri Hadar , Tovit Hakak , Dina Grossman , Yifat Ben-David Kolikant , Oren Tsur

Pre-trained language models (LLMs) such as GPT-3 can carry fluent, multi-turn conversations out-of-the-box, making them attractive materials for chatbot design. Further, designers can improve LLM chatbot utterances by prepending textual…

Human-Computer Interaction · Computer Science 2023-02-08 J. D. Zamfirescu-Pereira , Bjoern Hartmann , Qian Yang

Recommendation dialogue systems aim to build social bonds with users and provide high-quality recommendations. This paper pushes forward towards a promising paradigm called target-driven recommendation dialogue systems, which is highly…

Computation and Language · Computer Science 2022-08-09 Jian Wang , Dongding Lin , Wenjie Li

The inability to correctly resolve rumours circulating online can have harmful real-world consequences. We present a method for incorporating model and data uncertainty estimates into natural language processing models for automatic rumour…

Computation and Language · Computer Science 2020-05-15 Elena Kochkina , Maria Liakata

Personal attacks in the context of social media conversations often lead to fast-paced derailment, leading to even more harmful exchanges being made. State-of-the-art systems for the detection of such conversational derailment often make…

Computation and Language · Computer Science 2023-11-20 Steven Leung , Filippos Papapolyzos

To use generative question-and-answering (QA) systems for decision-making and in any critical application, these systems need to provide well-calibrated confidence scores that reflect the correctness of their answers. Existing calibration…

Computation and Language · Computer Science 2025-03-04 Putra Manggala , Atalanti Mastakouri , Elke Kirschbaum , Shiva Prasad Kasiviswanathan , Aaditya Ramdas

Many conversation datasets have been constructed in the recent years using crowdsourcing. However, the data collection process can be time consuming and presents many challenges to ensure data quality. Since language generation has improved…

Computation and Language · Computer Science 2021-06-08 Chulaka Gunasekara , Guy Feigenblat , Benjamin Sznajder , Sachindra Joshi , David Konopnicki

Causal networks are widely used in many fields, including epidemiology, social science, medicine, and engineering, to model the complex relationships between variables. While it can be convenient to algorithmically infer these models…

Artificial Intelligence · Computer Science 2023-12-29 Yanming Zhang , Brette Fitzgibbon , Dino Garofolo , Akshith Kota , Eric Papenhausen , Klaus Mueller

Despite tremendous advancements in dialogue systems, stable evaluation still requires human judgments producing notoriously high-variance metrics due to their inherent subjectivity. Moreover, methods and labels in dialogue evaluation are…

Computation and Language · Computer Science 2023-08-01 Sarah E. Finch , James D. Finch , Jinho D. Choi

The recent wave of audio foundation models (FMs) could provide new capabilities for conversational modeling. However, there have been limited efforts to evaluate these audio FMs comprehensively on their ability to have natural and…

Computation and Language · Computer Science 2025-03-04 Siddhant Arora , Zhiyun Lu , Chung-Cheng Chiu , Ruoming Pang , Shinji Watanabe

There is substantial variability in the expectations that communication partners bring into interactions, creating the potential for misunderstandings. To directly probe these gaps and our ability to overcome them, we propose a…

Computation and Language · Computer Science 2022-04-28 Sonia K. Murthy , Thomas L. Griffiths , Robert D. Hawkins

Can large language models assist in data discovery? Data discovery predominantly happens via search on a data portal or the web, followed by assessment of the dataset to ensure it is fit for the intended purpose. The ability of…

Human-Computer Interaction · Computer Science 2024-02-01 Johanna Walker , Elisavet Koutsiana , Joe Massey , Gefion Thuermer , Elena Simperl

Conversational practice, while crucial for all language learners, can be challenging to get enough of and very expensive. Chatbots are computer programs developed to engage in conversations with humans. They are designed as software avatars…

Human-Computer Interaction · Computer Science 2020-11-17 Jasna Petrovic , Mladjan Jovanovic

Evaluating the quality of a dialogue system is an understudied problem. The recent evolution of evaluation method motivated this survey, in which an explicit and comprehensive analysis of the existing methods is sought. We are first to…

Computation and Language · Computer Science 2021-08-04 Xinmeng Li , Wansen Wu , Long Qin , Quanjun Yin

The interpretation of human voices holds importance across various applications. This study ventures into predicting age, gender, and emotion from vocal cues, a field with vast applications. Voice analysis tech advancements span domains,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-05 Aron R , Indra Sigicharla , Chirag Periwal , Mohanaprasad K , Nithya Darisini P S , Sourabh Tiwari , Shivani Arora

The ability to understand a user's underlying needs is critical for conversational systems, especially with limited input from users in a conversation. Thus, in such a domain, Asking Clarification Questions (ACQs) to reveal users' true…

Information Retrieval · Computer Science 2023-05-26 Hossein A. Rahmani , Xi Wang , Yue Feng , Qiang Zhang , Emine Yilmaz , Aldo Lipani