English
Related papers

Related papers: ConvLab-2: An Open-Source Toolkit for Building, Ev…

200 papers

Progress in conversational information access (CIA) systems has been hindered by the difficulty of evaluating such systems with reproducible experiments. While user simulation offers a promising solution, the lack of infrastructure and…

Information Retrieval · Computer Science 2025-10-27 Nolwenn Bernard , Sharath Chandra Etagi Suresh , Krisztian Balog , ChengXiang Zhai

Along with the development of systems for natural language understanding and generation, dialog systems have been widely adopted for language learning and practicing. Many current educational dialog systems perform chitchat, where the…

Computation and Language · Computer Science 2023-04-13 Kun Qian , Ryan Shea , Yu Li , Luke Kutszik Fryer , Zhou Yu

We introduce Edu-ConvoKit, an open-source library designed to handle pre-processing, annotation and analysis of conversation data in education. Resources for analyzing education conversation data are scarce, making the research challenging…

Computation and Language · Computer Science 2024-02-08 Rose E. Wang , Dorottya Demszky

Open-domain dialogue systems aim to converse with humans through text, and dialogue research has heavily relied on benchmark datasets. In this work, we observe the overlapping problem in DailyDialog and OpenSubtitles, two popular…

Computation and Language · Computer Science 2022-05-10 Yuqiao Wen , Guoqing Luo , Lili Mou

Conversational agents have become an integral part of the general population for simple task enabling situations. However, these systems are yet to have any social impact on the diverse and minority population, for example, helping people…

Computation and Language · Computer Science 2021-12-07 Shachi H Kumar , Hsuan Su , Ramesh Manuvinakurike , Saurav Sahay , Lama Nachman

Automatic evaluating the performance of Open-domain dialogue system is a challenging problem. Recent work in neural network-based metrics has shown promising opportunities for automatic dialogue evaluation. However, existing methods mainly…

Computation and Language · Computer Science 2018-05-09 Xiaowei Tong , Zhenxin Fu , Mingyue Shang , Dongyan Zhao , Rui Yan

Task-oriented dialogue systems aim at providing users with task-specific services. Users of such systems often do not know all the information about the task they are trying to accomplish, requiring them to seek information about the task.…

Computation and Language · Computer Science 2023-05-24 Yue Feng , Hossein A. Rahmani , Aldo Lipani , Emine Yilmaz

One of the major drawbacks of modularized task-completion dialogue systems is that each module is trained individually, which presents several challenges. For example, downstream modules are affected by earlier modules, and the performance…

Computation and Language · Computer Science 2018-02-13 Xiujun Li , Yun-Nung Chen , Lihong Li , Jianfeng Gao , Asli Celikyilmaz

We introduce dodecaDialogue: a set of 12 tasks that measures if a conversational agent can communicate engagingly with personality and empathy, ask questions, answer questions by utilizing knowledge resources, discuss topics and situations,…

Computation and Language · Computer Science 2020-04-30 Kurt Shuster , Da Ju , Stephen Roller , Emily Dinan , Y-Lan Boureau , Jason Weston

Resources for simulation-based evaluation of conversational recommender systems (CRSs) are scarce. The UserSimCRS toolkit was introduced to address this gap. In this work, we present UserSimCRS v2, a significant upgrade aligning the toolkit…

Information Retrieval · Computer Science 2026-03-18 Nolwenn Bernard , Krisztian Balog

The goal of building dialogue agents that can converse with humans naturally has been a long-standing dream of researchers since the early days of artificial intelligence. The well-known Turing Test proposed to judge the ultimate validity…

Artificial Intelligence · Computer Science 2022-12-13 Tom Young

We describe an architecture for spoken dialogue interfaces to semi-autonomous systems that transforms speech signals through successive representations of linguistic, dialogue, and domain knowledge. Each step produces an output, and a…

Computation and Language · Computer Science 2007-05-23 Manny Rayner , Beth Ann Hockey , Frankie James

The evolution of conversational agents has been driven by the need for more contextually aware systems that can effectively manage dialogue over extended interactions. To address the limitations of existing models in capturing and utilizing…

Computation and Language · Computer Science 2025-04-15 Akanksha Mehndiratta , Krishna Asawa

Open-domain dialogue systems have started to engage in continuous conversations with humans. Those dialogue systems are required to be adjusted to the human interlocutor and evaluated in terms of their perspective. However, it is…

Computation and Language · Computer Science 2024-01-05 Yuma Tsuta , Naoki Yoshinaga , Shoetsu Sato , Masashi Toyoda

In this paper, we introduce a novel Face-to-Face spoken dialogue model. It processes audio-visual speech from user input and generates audio-visual speech as the response, marking the initial step towards creating an avatar chatbot system…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Se Jin Park , Chae Won Kim , Hyeongseop Rha , Minsu Kim , Joanna Hong , Jeong Hun Yeo , Yong Man Ro

Conversational search provides a more convenient interface for users to search by allowing multi-turn interaction with the search engine. However, the effectiveness of the conversational dense retrieval methods is limited by the scarcity of…

Information Retrieval · Computer Science 2024-03-19 Fengran Mo , Bole Yi , Kelong Mao , Chen Qu , Kaiyu Huang , Jian-Yun Nie

With the advent of conversational assistants, like Amazon Alexa, Google Now, etc., dialogue systems are gaining a lot of traction, especially in industrial setting. These systems typically consist of Spoken Language understanding component…

Computation and Language · Computer Science 2019-07-19 Arshit Gupta , John Hewitt , Katrin Kirchhoff

Successful conversational search systems can present natural, adaptive and interactive shopping experience for online shopping customers. However, building such systems from scratch faces real word challenges from both imperfect product…

Computation and Language · Computer Science 2021-09-14 Liqiang Xiao , Jun Ma2 , Xin Luna Dong , Pascual Martinez-Gomez , Nasser Zalmout , Wei Chen , Tong Zhao , Hao He , Yaohui Jin

This paper summarises the experimental setup and results of the first shared task on end-to-end (E2E) natural language generation (NLG) in spoken dialogue systems. Recent end-to-end generation systems are promising since they reduce the…

Computation and Language · Computer Science 2018-11-22 Ondřej Dušek , Jekaterina Novikova , Verena Rieser

Though generative dialogue modeling is widely seen as a language modeling task, the task demands an agent to have a complex natural language understanding of its input text to carry a meaningful interaction with an user. The automatic…

Computation and Language · Computer Science 2020-08-25 Prasanna Parthasarathi , Joelle Pineau , Sarath Chandar