English
Related papers

Related papers: Offline and Online Satisfaction Prediction in Open…

200 papers

To hold a true conversation, an intelligent agent should be able to occasionally take initiative and recommend the next natural conversation topic. This is a challenging task. A topic suggested by the agent should be relevant to the person,…

Computation and Language · Computer Science 2020-05-29 Ali Ahmadvand , Harshita Sahijwani , Eugene Agichtein

There has recently been an explosion of work on spoken dialogue systems, along with an increased interest in open-domain systems that engage in casual conversations on popular topics such as movies, books and music. These systems aim to…

Computation and Language · Computer Science 2021-10-22 Marilyn Walker , Colin Harmon , James Graupera , Davan Harrison , Steve Whittaker

An automated metric to evaluate dialogue quality is vital for optimizing data driven dialogue management. The common approach of relying on explicit user feedback during a conversation is intrusive and sparse. Current models to estimate…

We will demonstrate a conversational products recommendation agent. This system shows how we combine research in personalized recommendation systems with research in dialogue systems to build a virtual sales agent. Based on new deep…

Computation and Language · Computer Science 2016-10-06 Yueming Sun , Yi Zhang , Yunfei Chen , Roger Jin

This research aims to explore various methods for assessing user feedback in mixed-initiative conversational search (CS) systems. While CS systems enjoy profuse advancements across multiple aspects, recent research fails to successfully…

Information Retrieval · Computer Science 2023-05-09 Paul Owoicho , Ivan Sekulić , Mohammad Aliannejadi , Jeffrey Dalton , Fabio Crestani

Reward-driven proactive dialogue agents require precise estimation of user satisfaction as an intrinsic reward signal to determine optimal interaction strategies. Specifically, this framework triggers clarification questions when detecting…

Machine Learning · Computer Science 2025-05-27 Wei Shen , Xiaonan He , Chuheng Zhang , Xuyun Zhang , Xiaolong Xu , Wanchun Dou

Conversational AI systems are becoming famous in day to day lives. In this paper, we are trying to address the following key question: To identify whether design, as well as development efforts for search oriented conversational AI are…

Artificial Intelligence · Computer Science 2017-09-15 Mahipal Jadeja , Neelanshi Varia

User Satisfaction Estimation (USE) is an important yet challenging task in goal-oriented conversational systems. Whether the user is satisfied with the system largely depends on the fulfillment of the user's needs, which can be implicitly…

Computation and Language · Computer Science 2022-02-08 Yang Deng , Wenxuan Zhang , Wai Lam , Hong Cheng , Helen Meng

Explainable AI (XAI) techniques aim to provide insights into predictive models and enhance user performance, yet they often fall short of these expectations. Conversational XAI assistants promise to overcome such limitations, but empirical…

Machine Learning · Computer Science 2026-05-21 Sven Kruschel , Julian Rosenberger , Lasse Bohlen , Mathias Kraus , Patrick Zschech

Dialogue level quality estimation is vital for optimizing data driven dialogue management. Current automated methods to estimate turn and dialogue level user satisfaction employ hand-crafted features and rely on complex annotation schemes,…

Computation and Language · Computer Science 2020-10-12 Praveen Kumar Bodigutla , Aditya Tiwari , Josep Valls Vargas , Lazaros Polymenakos , Spyros Matsoukas

Job interviews play a critical role in shaping one's career, yet practicing interview skills can be challenging, especially without access to human coaches or peers for feedback. Recent advancements in large language models (LLMs) present…

Human-Computer Interaction · Computer Science 2024-11-05 Taufiq Daryanto , Xiaohan Ding , Lance T. Wilhelm , Sophia Stil , Kirk McInnis Knutsen , Eugenia H. Rho

Open-domain conversational search assistants aim at answering user questions about open topics in a conversational manner. In this paper we show how the Transformer architecture achieves state-of-the-art results in key IR tasks, leveraging…

Information Retrieval · Computer Science 2021-01-21 Rafael Ferreira , Mariana Leite , David Semedo , Joao Magalhaes

Conversational agents are exploding in popularity. However, much work remains in the area of non goal-oriented conversations, despite significant growth in research interest over recent years. To advance the state of the art in…

The field of conversational information seeking, which is rapidly gaining interest in both academia and industry, is changing how we interact with search engines through natural language interactions. Existing datasets and methods are…

Information Retrieval · Computer Science 2024-05-13 Chris Samarinas , Hamed Zamani

Goal-oriented conversational agents are becoming prevalent in our daily lives. For these systems to engage users and achieve their goals, they need to exhibit appropriate social behavior as well as provide informative replies that guide…

Computation and Language · Computer Science 2021-01-01 Yi-Chia Wang , Alexandros Papangelis , Runze Wang , Zhaleh Feizollahi , Gokhan Tur , Robert Kraut

Accurate automatic evaluation metrics for open-domain dialogs are in high demand. Existing model-based metrics for system response evaluation are trained on human annotated data, which is cumbersome to collect. In this work, we propose to…

Computation and Language · Computer Science 2022-03-29 Sarik Ghazarian , Behnam Hedayatnia , Alexandros Papangelis , Yang Liu , Dilek Hakkani-Tur

Conversational interfaces that allow for intuitive and comprehensive access to digitally stored information remain an ambitious goal. In this thesis, we lay foundations for designing conversational search systems by analyzing the…

Information Retrieval · Computer Science 2019-12-17 Svitlana Vakulenko

Classifying the general intent of the user utterance in a conversation, also known as Dialogue Act (DA), e.g., open-ended question, statement of opinion, or request for an opinion, is a key step in Natural Language Understanding (NLU) for…

Computation and Language · Computer Science 2020-05-29 Ali Ahmadvand , Jason Ingyu Choi , Eugene Agichtein

Predicting the success of Conversational Task Assistants (CTA) can be critical to understand user behavior and act accordingly. In this paper, we propose TB-Rater, a Transformer model which combines conversational-flow features with user…

Computation and Language · Computer Science 2023-09-21 Rafael Ferreira , David Semedo , João Magalhães

There is a resurgent interest in developing intelligent open-domain dialog systems due to the availability of large amounts of conversational data and the recent progress on neural approaches to conversational AI. Unlike traditional…

Computation and Language · Computer Science 2020-03-02 Minlie Huang , Xiaoyan Zhu , Jianfeng Gao