English
Related papers

Related papers: Rethinking Response Evaluation from Interlocutor's…

200 papers

Open-domain dialog systems (also known as chatbots) have increasingly drawn attention in natural language processing. Some of the recent work aims at incorporating affect information into sequence-to-sequence neural dialog modeling, making…

Computation and Language · Computer Science 2020-06-25 Yubo Xie , Ekaterina Svikhnushina , Pearl Pu

A long-term goal of machine learning research is to build an intelligent dialog agent. Most research in natural language understanding has focused on learning from fixed training sets of labeled data, with supervision either at the word…

Computation and Language · Computer Science 2016-10-26 Jason Weston

Though generative dialogue modeling is widely seen as a language modeling task, the task demands an agent to have a complex natural language understanding of its input text to carry a meaningful interaction with an user. The automatic…

Computation and Language · Computer Science 2020-08-25 Prasanna Parthasarathi , Joelle Pineau , Sarath Chandar

User reviews on e-commerce and review sites are crucial for making purchase decisions, although creating detailed reviews is time-consuming and labor-intensive. In this study, we propose a novel use of dialogue systems to facilitate user…

Human-Computer Interaction · Computer Science 2026-03-10 Yoshiki Tanaka , Michimasa Inaba

Automatic evaluation metrics are a crucial component of dialog systems research. Standard language evaluation metrics are known to be ineffective for evaluating dialog. As such, recent research has proposed a number of novel,…

Computation and Language · Computer Science 2021-07-09 Yi-Ting Yeh , Maxine Eskenazi , Shikib Mehri

The construction of open-domain dialogue systems requires high-quality dialogue datasets. The dialogue data admits a wide variety of responses for a given dialogue history, especially responses with different semantics. However, collecting…

Computation and Language · Computer Science 2022-11-01 Jiao Ou , Jinchao Zhang , Yang Feng , Jie Zhou

Building dialog agents that can converse naturally with humans is a challenging yet intriguing problem of artificial intelligence. In open-domain human-computer conversation, where the conversational agent is expected to respond to human…

Artificial Intelligence · Computer Science 2018-02-13 Tom Young , Erik Cambria , Iti Chaturvedi , Minlie Huang , Hao Zhou , Subham Biswas

User attributes provide rich and useful information for user understanding, yet structured and easy-to-use attributes are often sparsely populated. In this paper, we leverage dialogues with conversational agents, which contain strong…

Computation and Language · Computer Science 2019-08-14 Chien-Sheng Wu , Andrea Madotto , Zhaojiang Lin , Peng Xu , Pascale Fung

Automatic evaluation is an integral aspect of dialogue system research. The traditional reference-based NLG metrics are generally found to be unsuitable for dialogue assessment. Consequently, recent studies have suggested various unique,…

Computation and Language · Computer Science 2024-01-23 Chen Zhang , Luis Fernando D'Haro , Yiming Chen , Malu Zhang , Haizhou Li

During the past decade, several areas of speech and language understanding have witnessed substantial breakthroughs from the use of data-driven models. In the area of dialogue systems, the trend is less obvious, and most practical systems…

Computation and Language · Computer Science 2017-03-22 Iulian Vlad Serban , Ryan Lowe , Peter Henderson , Laurent Charlin , Joelle Pineau

Recently, utilizing deep neural networks to build the opendomain dialogue models has become a hot topic. However, the responses generated by these models suffer from many problems such as responses not being contextualized and tend to…

Computation and Language · Computer Science 2023-09-07 Mengjuan Liu , Chenyang Liu , Yunfan Yang , Jiang Liu , Mohan Jing

Sharing ideas through communication with peers is the primary mode of human interaction. Consequently, extensive research has been conducted in the area of conversational AI, leading to an increase in the availability and diversity of…

Computation and Language · Computer Science 2024-05-24 Shivani Kumar , Sumit Bhatia , Milan Aggarwal , Tanmoy Chakraborty

Recent open-domain dialogue models have brought numerous breakthroughs. However, building a chat system is not scalable since it often requires a considerable volume of human-human dialogue data, especially when enforcing features such as…

Computation and Language · Computer Science 2022-05-03 Sanghwan Bae , Donghyun Kwak , Sungdong Kim , Donghoon Ham , Soyoung Kang , Sang-Woo Lee , Woomyoung Park

This paper describes a system that leads us to believe in the feasibility of constructing natural spoken dialogue systems in task-oriented domains. It specifically addresses the issue of robust interpretation of speech in the presence of…

cmp-lg · Computer Science 2008-02-03 James F. Allen , Bradford W. Miller , Eric K. Ringger , Teresa Sikorski

Despite advances in open-domain dialogue systems, automatic evaluation of such systems is still a challenging problem. Traditional reference-based metrics such as BLEU are ineffective because there could be many valid responses for a given…

Computation and Language · Computer Science 2019-04-25 Sarik Ghazarian , Johnny Tian-Zheng Wei , Aram Galstyan , Nanyun Peng

Open-domain chatbots are supposed to converse freely with humans without being restricted to a topic, task or domain. However, the boundaries and/or contents of open-domain conversations are not clear. To clarify the boundaries of…

Computation and Language · Computer Science 2022-11-28 A. Seza Doğruöz , Gabriel Skantze

The DIAlogue MOdel Learning Environment supports an engineering-oriented approach towards dialogue modelling for a spoken-language interface. Major steps towards dialogue models is to know about the basic units that are used to construct a…

cmp-lg · Computer Science 2008-02-03 Jens-Uwe Moeller

The predominant approach to open-domain dialog generation relies on end-to-end training of neural models on chat datasets. However, this approach provides little insight as to what these models learn (or do not learn) about engaging in…

Computation and Language · Computer Science 2020-08-04 Abdelrhman Saleh , Tovly Deutsch , Stephen Casper , Yonatan Belinkov , Stuart Shieber

With the rise of Large Language Models (LLMs), AI assistants' ability to utilize tools, especially through API calls, has advanced notably. This progress has necessitated more accurate evaluation methods. Many existing studies adopt static…

Computation and Language · Computer Science 2024-03-28 Honglin Mu , Yang Xu , Yunlong Feng , Xiaofeng Han , Yitong Li , Yutai Hou , Wanxiang Che

Despite the recent advances in open-domain dialogue systems, building a reliable evaluation metric is still a challenging problem. Recent studies proposed learnable metrics based on classification models trained to distinguish the correct…

Computation and Language · Computer Science 2023-05-26 ChaeHun Park , Seungil Chad Lee , Daniel Rim , Jaegul Choo