中文
相关论文

相关论文: Improving Dialog Evaluation with a Multi-reference…

200 篇论文

Automatic evaluation metrics are a crucial component of dialog systems research. Standard language evaluation metrics are known to be ineffective for evaluating dialog. As such, recent research has proposed a number of novel,…

计算与语言 · 计算机科学 2021-07-09 Yi-Ting Yeh , Maxine Eskenazi , Shikib Mehri

Text representation models are prone to exhibit a range of societal biases, reflecting the non-controlled and biased nature of the underlying pretraining data, which consequently leads to severe ethical issues and even bias amplification.…

计算与语言 · 计算机科学 2021-06-08 Soumya Barikeri , Anne Lauscher , Ivan Vulić , Goran Glavaš

Recent progress on neural approaches for language processing has triggered a resurgence of interest on building intelligent open-domain chatbots. However, even the state-of-the-art neural chatbots cannot produce satisfying responses for…

计算与语言 · 计算机科学 2022-08-10 Behnam Hedayatnia , Di Jin , Yang Liu , Dilek Hakkani-Tur

Recently, utilizing deep neural networks to build the opendomain dialogue models has become a hot topic. However, the responses generated by these models suffer from many problems such as responses not being contextualized and tend to…

计算与语言 · 计算机科学 2023-09-07 Mengjuan Liu , Chenyang Liu , Yunfan Yang , Jiang Liu , Mohan Jing

The evaluation of recent embedding-based evaluation metrics for text generation is primarily based on measuring their correlation with human evaluations on standard benchmarks. However, these benchmarks are mostly from similar domains to…

计算与语言 · 计算机科学 2022-09-08 Doan Nam Long Vu , Nafise Sadat Moosavi , Steffen Eger

Deaf and hard of hearing individuals regularly rely on captioning while watching live TV. Live TV captioning is evaluated by regulatory agencies using various caption evaluation metrics. However, caption evaluation metrics are often not…

计算与语言 · 计算机科学 2022-06-27 Akhter Al Amin , Saad Hassan , Cecilia O. Alm , Matt Huenerfauth

Maintaining consistent personas is essential for dialogue agents. Although tremendous advancements have been brought, the limited-scale of annotated persona-dense data are still barriers towards training robust and consistent persona-based…

计算与语言 · 计算机科学 2021-06-15 Haoyu Song , Yan Wang , Kaiyan Zhang , Wei-Nan Zhang , Ting Liu

The objective of this study is to improve automated feedback tools designed for English Language Learners (ELLs) through the utilization of data science techniques encompassing machine learning, natural language processing, and educational…

计算与语言 · 计算机科学 2024-01-12 Jiaxin Huang , Xinyu Zhao , Chang Che , Qunwei Lin , Bo Liu

Adversarial attacks have gained traction in order to identify potential vulnerabilities in neural ranking models (NRMs), but current attack methods often introduce grammatical errors, nonsensical expressions, or incoherent text fragments,…

信息检索 · 计算机科学 2023-05-05 Xuanang Chen , Ben He , Zheng Ye , Le Sun , Yingfei Sun

Pre-trained language models have been successfully used in response generation for open-domain dialogue. Four main frameworks have been proposed: (1) Transformer-ED using Transformer encoder and decoder separately for source and target…

计算与语言 · 计算机科学 2020-10-27 Yan Zeng , Jian-Yun Nie

Dialogue assistants are rapidly becoming an indispensable daily aid. To avoid the significant effort needed to hand-craft the required dialogue flow, the Dialogue Management (DM) module can be cast as a continuous Markov Decision Process…

Open domain neural dialogue models, despite their successes, are known to produce responses that lack relevance, diversity, and in many cases coherence. These shortcomings stem from the limited ability of common training objectives to…

计算与语言 · 计算机科学 2019-09-06 Oluwatobi Olabiyi , Erik T. Mueller , Christopher Larson , Tarek Lahlou

Pre-trained language models (PLM) have marked a huge leap in neural dialogue modeling. While PLMs are pre-trained on large-scale text corpora, they are usually fine-tuned on scarce dialogue data with specific domain knowledge and dialogue…

计算与语言 · 计算机科学 2021-12-14 Xiaodong Gu , Kang Min Yoo , Sang-Woo Lee

The design of better automated dialogue evaluation metrics offers the potential of accelerate evaluation research on conversational AI. However, existing trainable dialogue evaluation models are generally restricted to classifiers trained…

计算与语言 · 计算机科学 2021-04-19 Xiang Gao , Yizhe Zhang , Michel Galley , Bill Dolan

Question-answering datasets require a broad set of reasoning skills. We show how to use question decompositions to teach language models these broad reasoning skills in a robust fashion. Specifically, we use widely available QDMR…

计算与语言 · 计算机科学 2022-11-07 Harsh Trivedi , Niranjan Balasubramanian , Tushar Khot , Ashish Sabharwal

In this paper, we propose Inverse Adversarial Training (IAT) algorithm for training neural dialogue systems to avoid generic responses and model dialogue history better. In contrast to standard adversarial training algorithms, IAT…

计算与语言 · 计算机科学 2021-06-01 Wangchunshu Zhou , Qifei Li , Chenle Li

Recent advancements in dialogue response selection (DRS) are based on the \textit{task-adaptive pre-training (TAP)} approach, by first initializing their model with BERT~\cite{devlin-etal-2019-bert}, and adapt to dialogue data with…

计算与语言 · 计算机科学 2022-10-11 Tzu-Hsiang Lin , Ta-Chung Chi , Anna Rumshisky

Large-language-model (LLM) agents excel at reactive dialogue but struggle with proactive, goal-driven interactions due to myopic decoding and costly planning. We introduce DialogXpert, which leverages a frozen LLM to propose a small,…

计算与语言 · 计算机科学 2025-05-26 Tazeek Bin Abdur Rakib , Ambuj Mehrish , Lay-Ki Soon , Wern Han Lim , Soujanya Poria

When provided with sufficient explanatory context, smaller Language Models have been shown to exhibit strong reasoning ability on challenging short-answer question-answering tasks where the questions are unseen in training. We evaluate two…

计算与语言 · 计算机科学 2023-10-16 Tim Hartill , Diana Benavides-Prado , Michael Witbrock , Patricia J. Riddle

Recent advances in pre-trained language models have significantly improved neural response generation. However, existing methods usually view the dialogue context as a linear sequence of tokens and learn to generate the next word through…

计算与语言 · 计算机科学 2021-12-14 Xiaodong Gu , Kang Min Yoo , Jung-Woo Ha