English
Related papers

Related papers: Offline and Online Satisfaction Prediction in Open…

200 papers

Enterprise conversational AI systems are becoming increasingly popular to assist users in completing daily tasks such as those in marketing and customer management. However, new users often struggle to ask effective questions, especially in…

Computation and Language · Computer Science 2024-12-17 Xiaobin Shen , Daniel Lee , Sumit Ranjan , Sai Sree Harsha , Pawan Sevak , Yunyao Li

While multimodal conversation agents are gaining importance in several domains such as retail, travel etc., deep learning research in this area has been limited primarily due to the lack of availability of large-scale, open chatlogs. To…

Computation and Language · Computer Science 2018-02-01 Amrita Saha , Mitesh Khapra , Karthik Sankaranarayanan

State-of-the-art conversational agents have advanced significantly in conjunction with the use of large transformer-based language models. However, even with these advancements, conversational agents still lack the ability to produce…

Computation and Language · Computer Science 2020-10-21 Sashank Santhanam , Wei Ping , Raul Puri , Mohammad Shoeybi , Mostofa Patwary , Bryan Catanzaro

Recently, self-learning methods based on user satisfaction metrics and contextual bandits have shown promising results to enable consistent improvements in conversational AI systems. However, directly targeting such metrics by off-policy…

Machine Learning · Computer Science 2023-05-16 Mohammad Kachuee , Sungjin Lee

Having an intelligent dialogue agent that can engage in conversational question answering (ConvQA) is now no longer limited to Sci-Fi movies only and has, in fact, turned into a reality. These intelligent agents are required to understand…

Computation and Language · Computer Science 2023-04-17 Munazza Zaib , Quan Z. Sheng , Wei Emma Zhang , Adnan Mahmood

An important unexplored aspect in previous work on user satisfaction estimation for Task-Oriented Dialogue (TOD) systems is their evaluation in terms of robustness for the identification of user dissatisfaction: current benchmarks for user…

Computation and Language · Computer Science 2024-08-21 Amin Abolghasemi , Zhaochun Ren , Arian Askari , Mohammad Aliannejadi , Maarten de Rijke , Suzan Verberne

Conversational agents (CAs) are increasingly embedded in daily life, yet their ability to navigate user emotions efficiently is still evolving. This study investigates how users with varying traits -- gender, personality, and cultural…

Human-Computer Interaction · Computer Science 2025-11-11 Yuchong Zhang , Yong Ma , Di Fu , Stephanie Zubicueta Portales , Morten Fjeld , Danica Kragic

A frequent pattern in customer care conversations is the agents responding with appropriate webpage URLs that address users' needs. We study the task of predicting the documents that customer care agents can use to facilitate users' needs.…

Forecasting conversation derailment can be useful in real-world settings such as online content moderation, conflict resolution, and business negotiations. However, despite language models' success at identifying offensive speech present in…

Computation and Language · Computer Science 2025-10-07 Yunfan Zhang , Kathleen McKeown , Smaranda Muresan

Vast improvements in natural language understanding and speech recognition have paved the way for conversational interaction with computers. While conversational agents have often been used for short goal-oriented dialog, we know little…

Human-Computer Interaction · Computer Science 2020-08-20 Jessica Van Brummelen , Kevin Weng , Phoebe Lin , Catherine Yeo

Using chatbots to deliver recommendations is increasingly popular. The design of recommendation chatbots has primarily been taking an information-centric approach by focusing on the recommended content per se. Limited attention is on how…

Computation and Language · Computer Science 2022-11-14 Kai-Hui Liang , Weiyan Shi , Yoojung Oh , Hao-Chuan Wang , Jingwen Zhang , Zhou Yu

Chatbots are conversational software applications designed to interact dialectically with users for a plethora of different purposes. Surprisingly, these colloquial agents have only recently been coupled with computational models of…

Artificial Intelligence · Computer Science 2024-08-07 Federico Castagna , Nadin Kokciyan , Isabel Sassoon , Simon Parsons , Elizabeth Sklar

We survey SoTA open-domain conversational AI models with the purpose of presenting the prevailing challenges that still exist to spur future research. In addition, we provide statistics on the gender of conversational AI in order to guide…

Computation and Language · Computer Science 2022-05-03 Tosin Adewumi , Foteini Liwicki , Marcus Liwicki

We introduce dodecaDialogue: a set of 12 tasks that measures if a conversational agent can communicate engagingly with personality and empathy, ask questions, answer questions by utilizing knowledge resources, discuss topics and situations,…

Computation and Language · Computer Science 2020-04-30 Kurt Shuster , Da Ju , Stephen Roller , Emily Dinan , Y-Lan Boureau , Jason Weston

This paper describes the design and functionality of ConvoKit, an open-source toolkit for analyzing conversations and the social interactions embedded within. ConvoKit provides an unified framework for representing and manipulating…

Computation and Language · Computer Science 2020-05-12 Jonathan P. Chang , Caleb Chiam , Liye Fu , Andrew Z. Wang , Justine Zhang , Cristian Danescu-Niculescu-Mizil

We present the first English corpus study on abusive language towards three conversational AI systems gathered "in the wild": an open-domain social bot, a rule-based chatbot, and a task-based system. To account for the complexity of the…

Computation and Language · Computer Science 2021-09-21 Amanda Cercas Curry , Gavin Abercrombie , Verena Rieser

We present our view of what is necessary to build an engaging open-domain conversational agent: covering the qualities of such an agent, the pieces of the puzzle that have been built so far, and the gaping holes we have not filled yet. We…

One challenge for dialogue agents is recognizing feelings in the conversation partner and replying accordingly, a key communicative skill. While it is straightforward for humans to recognize and acknowledge others' feelings in a…

Computation and Language · Computer Science 2019-08-30 Hannah Rashkin , Eric Michael Smith , Margaret Li , Y-Lan Boureau

Business process automation is a booming multi-billion-dollar industry that promises to remove menial tasks from workers' plates -- through the introduction of autonomous agents -- and free up their time and brain power for more creative…

Artificial Intelligence · Computer Science 2020-01-13 Yara Rizk , Abhishek Bhandwalder , Scott Boag , Tathagata Chakraborti , Vatche Isahagian , Yasaman Khazaeni , Falk Pollock , Merve Unuvar

Virtual assistants such as Google Assistant, Alexa and Siri provide a conversational interface to a large number of services and APIs spanning multiple domains. Such systems need to support an ever-increasing number of services with…

Computation and Language · Computer Science 2020-01-30 Abhinav Rastogi , Xiaoxue Zang , Srinivas Sunkara , Raghav Gupta , Pranav Khaitan