English
Related papers

Related papers: Offline and Online Satisfaction Prediction in Open…

200 papers

The performance of a task-completion dialogue agent usually affects the user experience: when the conversation system yields an unreasonable response, users may feel dissatisfied. Besides, early termination often occurs in disappointing…

Human-Computer Interaction · Computer Science 2021-10-06 Rui Zhang , Kai Yin , Li Li

Accurate and interpretable user satisfaction estimation (USE) is critical for understanding, evaluating, and continuously improving conversational systems. Users express their satisfaction or dissatisfaction with diverse conversational…

Successful conversational search systems can present natural, adaptive and interactive shopping experience for online shopping customers. However, building such systems from scratch faces real word challenges from both imperfect product…

Computation and Language · Computer Science 2021-09-14 Liqiang Xiao , Jun Ma2 , Xin Luna Dong , Pascual Martinez-Gomez , Nasser Zalmout , Wei Chen , Tong Zhao , Hao He , Yaohui Jin

This paper introduces the task of product demand clarification within an e-commercial scenario, where the user commences the conversation with ambiguous queries and the task-oriented agent is designed to achieve more accurate and tailored…

Information Retrieval · Computer Science 2024-07-02 Jingheng Ye , Yong Jiang , Xiaobin Wang , Yinghui Li , Yangning Li , Hai-Tao Zheng , Pengjun Xie , Fei Huang

The overall objective of 'social' dialogue systems is to support engaging, entertaining, and lengthy conversations on a wide variety of topics, including social chit-chat. Apart from raw dialogue data, user-provided ratings are the most…

Computation and Language · Computer Science 2018-11-05 Igor Shalyminov , Ondřej Dušek , Oliver Lemon

Conversational systems typically focus on functional tasks such as scheduling appointments or creating todo lists. Instead we design and evaluate SlugBot (SB), one of 8 semifinalists in the 2018 AlexaPrize, whose goal is to support casual…

Computation and Language · Computer Science 2019-08-15 Kevin K. Bowden , Jiaqi Wu , Wen Cui , Juraj Juraska , Vrindavan Harrison , Brian Schwarzmann , Nicholas Santer , Steve Whittaker , Marilyn Walker

Open domain conversational agents can answer a broad range of targeted queries. However, the sequential nature of interaction with these systems makes knowledge exploration a lengthy task which burdens the user with asking a chain of well…

Computation and Language · Computer Science 2023-02-23 Christopher Richardson , Sudipta Kar , Anjishnu Kumar , Anand Ramachandran , Omar Zia Khan , Zeynab Raeesy , Abhinav Sethy

Our research is focused on making a human-like question answering system which can answer rationally. The distinguishing characteristic of our approach is that it will use automated common sense reasoning to truly "understand" dialogues,…

Artificial Intelligence · Computer Science 2019-09-19 Kinjal Basu

Online shopping platforms, such as Amazon and AliExpress, are increasingly prevalent in society, helping customers purchase products conveniently. With recent progress in natural language processing, researchers and practitioners shift…

Computation and Language · Computer Science 2024-11-25 Jie Zou , Jimmy Xiangji Huang , Zhaochun Ren , Evangelos Kanoulas

Conversational search has evolved as a new information retrieval paradigm, marking a shift from traditional search systems towards interactive dialogues with intelligent search agents. This change especially affects exploratory…

Computation and Language · Computer Science 2023-02-28 Phillip Schneider , Anum Afzal , Juraj Vladika , Daniel Braun , Florian Matthes

Conversational information access is an emerging research area. Currently, human evaluation is used for end-to-end system evaluation, which is both very time and resource intensive at scale, and thus becomes a bottleneck of progress. As an…

Information Retrieval · Computer Science 2020-06-17 Shuo Zhang , Krisztian Balog

Systems powered by artificial intelligence are being developed to be more user-friendly by communicating with users in a progressively human-like conversational way. Chatbots, also known as dialogue systems, interactive conversational…

Human-Computer Interaction · Computer Science 2020-01-03 Kennedy Ralston , Yuhao Chen , Haruna Isah , Farhana Zulkernine

User Satisfaction Estimation is an important task and increasingly being applied in goal-oriented dialogue systems to estimate whether the user is satisfied with the service. It is observed that whether the user's needs are met often…

Computation and Language · Computer Science 2024-10-15 Kaisong Song , Yangyang Kang , Jiawei Liu , Xurui Li , Changlong Sun , Xiaozhong Liu

Voice-based systems like Amazon Alexa, Google Assistant, and Apple Siri, along with the growing popularity of OpenAI's ChatGPT and Microsoft's Copilot, serve diverse populations, including visually impaired and low-literacy communities.…

Human-Computer Interaction · Computer Science 2024-09-04 Sachin Pathiyan Cherumanal , Falk Scholer , Johanne R. Trippas , Damiano Spina

Different people have different habits of describing their intents in conversations. Some people tend to deliberate their intents in several successive utterances, i.e., they use several consistent messages for readability instead of a long…

Computation and Language · Computer Science 2021-09-23 Zehao Lin , Shaobo Cui , Guodun Li , Xiaoming Kang , Feng Ji , Fenglin Li , Zhongzhou Zhao , Haiqing Chen , Yin Zhang

In our work, we present the first-of-its-kind open-source web-based tool which is able to demonstrate the impacts of a user's speech act during discourse with conversational agents, which leverages open-source large language models. With…

Computation and Language · Computer Science 2025-02-21 Godfrey I

Spoken dialogue systems allow humans to interact with machines using natural speech. As such, they have many benefits. By using speech as the primary communication medium, a computer interface can facilitate swift, human-like acquisition of…

Computation and Language · Computer Science 2016-09-12 Milica Gasic , Nikola Mrksic , Lina M. Rojas-Barahona , Pei-Hao Su , Stefan Ultes , David Vandyke , Tsung-Hsien Wen , Steve Young

We present ConvLab-2, an open-source toolkit that enables researchers to build task-oriented dialogue systems with state-of-the-art models, perform an end-to-end evaluation, and diagnose the weakness of systems. As the successor of ConvLab…

Computation and Language · Computer Science 2020-04-30 Qi Zhu , Zheng Zhang , Yan Fang , Xiang Li , Ryuichi Takanobu , Jinchao Li , Baolin Peng , Jianfeng Gao , Xiaoyan Zhu , Minlie Huang

Conversational recommender systems offer the promise of interactive, engaging ways for users to find items they enjoy. We seek to improve conversational recommendation via three dimensions: 1) We aim to mimic a common mode of human…

Computation and Language · Computer Science 2021-12-13 Shuyang Li , Bodhisattwa Prasad Majumder , Julian McAuley

Many businesses and consumers are extending the capabilities of voice-based services such as Amazon Alexa, Google Home, Microsoft Cortana, and Apple Siri to create custom voice experiences (also known as skills). As the number of these…

Computation and Language · Computer Science 2019-11-18 Maryam Fazel-Zarandi , Sampat Biswas , Ryan Summers , Ahmed Elmalt , Andy McCraw , Michael McPhilips , John Peach