中文
相关论文

相关论文: DynaEval: Unifying Turn and Dialogue Level Evaluat…

200 篇论文

The advent and fast development of neural networks have revolutionized the research on dialogue systems and subsequently have triggered various challenges regarding their automatic evaluation. Automatic evaluation of open-domain dialogue…

Encoder-decoder based neural architectures serve as the basis of state-of-the-art approaches in end-to-end open domain dialog systems. Since most of such systems are trained with a maximum likelihood~(MLE) objective they suffer from issues…

With the continuous development of deep learning (DL), the task of multimodal dialogue emotion recognition (MDER) has recently received extensive research attention, which is also an essential branch of DL. The MDER aims to identify the…

计算与语言 · 计算机科学 2024-09-04 Wei Ai , Yuntao Shou , Tao Meng , Nan Yin , Keqin Li

User engagement is a critical metric for evaluating the quality of open-domain dialogue systems. Prior work has focused on conversation-level engagement by using heuristically constructed features such as the number of turns and the total…

计算与语言 · 计算机科学 2020-01-27 Sarik Ghazarian , Ralph Weischedel , Aram Galstyan , Nanyun Peng

While dialogue remains an important end-goal of natural language research, the difficulty of evaluation is an oft-quoted reason why it remains troublesome to make real progress towards its solution. Evaluation difficulties are actually…

计算与语言 · 计算机科学 2019-09-10 Margaret Li , Jason Weston , Stephen Roller

This paper provides preliminary results on exploring the task of performing turn-level data augmentation for dialogue system based on different types of commonsense relationships, and the automatic evaluation of the generated synthetic…

计算与语言 · 计算机科学 2025-06-25 Marcos Estecha-Garitagoitia , Chen Zhang , Mario Rodríguez-Cantelar , Luis Fernando D'Haro

We present an empirical investigation of pre-trained Transformer-based auto-regressive language models for the task of open-domain dialogue generation. Training paradigm of pre-training and fine-tuning is employed to conduct the parameter…

计算与语言 · 计算机科学 2020-03-10 Piji Li

Automatically evaluating the quality of dialogue responses for unstructured domains is a challenging problem. ADEM(Lowe et al. 2017) formulated the automatic evaluation of dialogue systems as a learning problem and showed that such a model…

计算与语言 · 计算机科学 2019-02-26 Ananya B. Sai , Mithun Das Gupta , Mitesh M. Khapra , Mukundhan Srinivasan

Dialogue state tracking (DST) aims to extract essential information from multi-turn dialogue situations and take appropriate actions. A belief state, one of the core pieces of information, refers to the subject and its specific content, and…

计算与语言 · 计算机科学 2022-04-01 Takyoung Kim , Hoonsang Yoon , Yukyung Lee , Pilsung Kang , Misuk Kim

Recent breakthroughs in diffusion models, multimodal pretraining, and efficient finetuning have led to an explosion of text-to-image generative models. Given human evaluation is expensive and difficult to scale, automated methods are…

计算机视觉与模式识别 · 计算机科学 2023-10-19 Dhruba Ghosh , Hanna Hajishirzi , Ludwig Schmidt

We present FlipDial, a generative model for visual dialogue that simultaneously plays the role of both participants in a visually-grounded dialogue. Given context in the form of an image and an associated caption summarising the contents of…

计算机视觉与模式识别 · 计算机科学 2018-04-04 Daniela Massiceti , N. Siddharth , Puneet K. Dokania , Philip H. S. Torr

An important step towards enabling English language learners to improve their conversational speaking proficiency involves automated scoring of multiple aspects of interactional competence and subsequent targeted feedback. This paper builds…

人机交互 · 计算机科学 2020-05-21 Vikram Ramanarayanan , Matthew Mulholland , Debanjan Ghosh

Task-oriented dialogue systems rely on predefined conversation schemes (dialogue flows) often represented as directed acyclic graphs. These flows can be manually designed or automatically generated from previously recorded conversations.…

计算与语言 · 计算机科学 2024-11-18 Mehrnoosh Mirtaheri , Nikhil Varghese , Chandra Khatri , Amol Kelkar

Knowledge-grounded dialogue systems powered by large language models often generate responses that, while fluent, are not attributable to a relevant source of information. Progress towards models that do not exhibit this issue requires…

计算与语言 · 计算机科学 2022-06-29 Nouha Dziri , Hannah Rashkin , Tal Linzen , David Reitter

Multiturn dialogue models aim to generate human-like responses by leveraging conversational context, consisting of utterances from previous exchanges. Existing methods often neglect the interactions between these utterances or treat all of…

计算与语言 · 计算机科学 2025-04-15 Akanksha Mehndiratta , Krishna Asawa

Multimodal Dialogue Summarization (MDS) is a critical task with wide-ranging applications. To support the development of effective MDS models, robust automatic evaluation methods are essential for reducing both cost and human effort.…

The ability to accurately represent sentences is central to language understanding. We describe a convolutional architecture dubbed the Dynamic Convolutional Neural Network (DCNN) that we adopt for the semantic modelling of sentences. The…

计算与语言 · 计算机科学 2014-04-09 Nal Kalchbrenner , Edward Grefenstette , Phil Blunsom

Achieving seamless, human-like interaction remains a key challenge for full-duplex spoken dialogue models (SDMs). Reinforcement learning (RL) has substantially enhanced text- and vision-language models, while well-designed reward signals…

人工智能 · 计算机科学 2026-04-17 Yifu Chen , Shengpeng Ji , Zhengqing Liu , Qian Chen , Wen Wang , Ziqing Wang , Yangzhuo Li , Tianle Liang , Zhou Zhao

Dialogues are a predominant mode of communication for humans, and it is immensely helpful to have automatically generated summaries of them (e.g., to revise key points discussed in a meeting, to review conversations between customer agents…

Emotion Recognition in Conversations (ERC) facilitates a deeper understanding of the emotions conveyed by speakers in each utterance within a conversation. Recently, Graph Neural Networks (GNNs) have demonstrated their strengths in…

计算与语言 · 计算机科学 2024-12-24 Cuong Tran Van , Thanh V. T. Tran , Van Nguyen , Truong Son Hy