English
Related papers

Related papers: Metaphorical User Simulators for Evaluating Task-o…

200 papers

Realistic user simulation is crucial for training and evaluating multi-turn dialogue systems, yet creating simulators that accurately replicate human behavior remains a significant challenge. An effective simulator must expose the failure…

Computation and Language · Computer Science 2026-05-07 Ziyi Zhu , Olivier Tieleman , Caitlin A. Stamatis , Luka Smyth , Thomas D. Hull , Daniel R. Cahn , Jinghong Chen , Matteo Malgaroli

One of the difficulties in training dialogue systems is the lack of training data. We explore the possibility of creating dialogue data through the interaction between a dialogue system and a user simulator. Our goal is to develop a…

Computation and Language · Computer Science 2021-07-27 Bo-Hsiang Tseng , Yinpei Dai , Florian Kreyssig , Bill Byrne

Though widely used in industry, traditional task-oriented dialogue systems suffer from three bottlenecks: (i) difficult ontology construction (e.g., intents and slots); (ii) poor controllability and interpretability; (iii)…

Computation and Language · Computer Science 2022-05-16 Xiangyu Xi , Chenxu Lv , Yuncheng Hua , Wei Ye , Chaobo Sun , Shuaipeng Liu , Fan Yang , Guanglu Wan

Automated dialogue or conversational systems are anthropomorphised by developers and personified by users. While a degree of anthropomorphism may be inevitable due to the choice of medium, conscious and unconscious design choices can guide…

Computation and Language · Computer Science 2023-10-24 Gavin Abercrombie , Amanda Cercas Curry , Tanvi Dinkar , Verena Rieser , Zeerak Talat

Task-oriented dialogue (TOD) systems have assisted users on many tasks, including ticket booking and service inquiries. While existing TOD systems have shown promising performance in serving customer needs, these systems mostly assume that…

Computation and Language · Computer Science 2022-10-25 Zhiqiang Hu , Roy Kaa-Wei Lee , Nancy F. Chen

User simulation has been a cost-effective technique for evaluating conversational recommender systems. However, building a human-like simulator is still an open challenge. In this work, we focus on how users reformulate their utterances…

Information Retrieval · Computer Science 2022-05-05 Shuo Zhang , Mu-Chun Wang , Krisztian Balog

Generative encoder-decoder models offer great promise in developing domain-general dialog systems. However, they have mainly been applied to open-domain conversations. This paper presents a practical and novel framework for building…

Computation and Language · Computer Science 2017-06-27 Tiancheng Zhao , Allen Lu , Kyusong Lee , Maxine Eskenazi

Digital assistants are experiencing rapid growth due to their ability to assist users with day-to-day tasks where most dialogues are happening multi-turn. However, evaluating multi-turn dialogues remains challenging, especially at scale. We…

Computation and Language · Computer Science 2021-06-21 Ziming Li , Dookun Park , Julia Kiseleva , Young-Bum Kim , Sungjin Lee

In Conversational Recommendation Systems (CRS), a user can provide feedback on recommended items at each interaction turn, leading the CRS towards more desirable recommendations. Currently, different types of CRS offer various possibilities…

Information Retrieval · Computer Science 2024-01-12 Maria Vlachou , Craig Macdonald

We present BotSIM, a data-efficient end-to-end Bot SIMulation toolkit for commercial text-based task-oriented dialog (TOD) systems. BotSIM consists of three major components: 1) a Generator that can infer semantic-level dialog acts and…

Computation and Language · Computer Science 2022-12-01 Guangsen Wang , Samson Tan , Shafiq Joty , Gang Wu , Jimmy Au , Steven Hoi

Dialogue systems capable of social influence such as persuasion, negotiation, and therapy, are essential for extending the use of technology to numerous realistic scenarios. However, existing research primarily focuses on either…

Computation and Language · Computer Science 2023-01-26 Kushal Chawla , Weiyan Shi , Jingwen Zhang , Gale Lucas , Zhou Yu , Jonathan Gratch

Existing Conversational Recommender Systems (CRS) predominantly utilize user simulators for training and evaluating recommendation policies. These simulators often oversimplify the complexity of user interactions by focusing solely on…

Information Retrieval · Computer Science 2024-09-10 Gangyi Zhang , Chongming Gao , Hang Pan , Runzhe Teng , Ruizhe Li

Design of dialogue systems has witnessed many advances lately, yet acquiring huge set of data remains an hindrance to their fast development for a new task or language. Besides, training interactive systems with batch data is not…

Computation and Language · Computer Science 2021-10-27 Matthieu Riou , Bassam Jabaian , Stéphane Huet , Fabrice Lefèvre

Different people have different habits of describing their intents in conversations. Some people tend to deliberate their intents in several successive utterances, i.e., they use several consistent messages for readability instead of a long…

Computation and Language · Computer Science 2021-09-23 Zehao Lin , Shaobo Cui , Guodun Li , Xiaoming Kang , Feng Ji , Fenglin Li , Zhongzhou Zhao , Haiqing Chen , Yin Zhang

Morality in dialogue systems has raised great attention in research recently. A moral dialogue system aligned with users' values could enhance conversation engagement and user connections. In this paper, we propose a framework, MoralDial to…

Computation and Language · Computer Science 2023-05-29 Hao Sun , Zhexin Zhang , Fei Mi , Yasheng Wang , Wei Liu , Jianwei Cui , Bin Wang , Qun Liu , Minlie Huang

In recent research on dialogue systems and corpora, there has been a significant focus on two distinct categories: task-oriented (TOD) and open-domain (chit-chat) dialogues. TOD systems aim to satisfy specific user goals, such as finding a…

Computation and Language · Computer Science 2023-08-29 Wen-Yu Chang , Yun-Nung Chen

User reviews on e-commerce and review sites are crucial for making purchase decisions, although creating detailed reviews is time-consuming and labor-intensive. In this study, we propose a novel use of dialogue systems to facilitate user…

Human-Computer Interaction · Computer Science 2026-03-10 Yoshiki Tanaka , Michimasa Inaba

This research aims to explore various methods for assessing user feedback in mixed-initiative conversational search (CS) systems. While CS systems enjoy profuse advancements across multiple aspects, recent research fails to successfully…

Information Retrieval · Computer Science 2023-05-09 Paul Owoicho , Ivan Sekulić , Mohammad Aliannejadi , Jeffrey Dalton , Fabio Crestani

With the widespread application of LLM-based dialogue systems in daily life, quality assurance has become more important than ever. Recent research has successfully introduced methods to identify unexpected behaviour in single-turn testing…

Software Engineering · Computer Science 2025-06-24 Guoxiang Guo , Aldeida Aleti , Neelofar Neelofar , Chakkrit Tantithamthavorn , Yuanyuan Qi , Tsong Yueh Chen

The popularity of conversational digital assistants has resulted in the availability of large amounts of conversational data which can be utilized for improved user experience and personalized response generation. Building these assistants…

Computation and Language · Computer Science 2023-10-26 Ankita Bhaumik , Praveen Venkateswaran , Yara Rizk , Vatche Isahagian
‹ Prev 1 4 5 6 7 8 10 Next ›