中文
相关论文

相关论文: SelF-Eval: Self-supervised Fine-grained Dialogue E…

200 篇论文

Task-oriented dialogue (TOD) systems are experiencing a revolution driven by Large Language Models (LLMs), yet the evaluation methodologies for these systems remain insufficient for their growing sophistication. While traditional automatic…

计算与语言 · 计算机科学 2025-07-17 Emre Can Acikgoz , Carl Guo , Suvodip Dey , Akul Datta , Takyoung Kim , Gokhan Tur , Dilek Hakkani-Tür

In this paper, a novel Generation-Evaluation framework is developed for multi-turn conversations with the objective of letting both participants know more about each other. For the sake of rational knowledge utilization and coherent…

计算与语言 · 计算机科学 2019-06-04 Siqi Bao , Huang He , Fan Wang , Rongzhong Lian , Hua Wu

We propose a novel large-scale emotional dialogue dataset, consisting of 1M dialogues retrieved from the OpenSubtitles corpus and annotated with 32 emotions and 9 empathetic response intents using a BERT-based fine-grained dialogue emotion…

计算与语言 · 计算机科学 2020-12-29 Anuradha Welivita , Yubo Xie , Pearl Pu

The sequential order of utterances is often meaningful in coherent dialogues, and the order changes of utterances could lead to low-quality and incoherent conversations. We consider the order information as a crucial supervised signal for…

计算与语言 · 计算机科学 2019-07-02 Jiawei Wu , Xin Wang , William Yang Wang

As conversational AI-based dialogue management has increasingly become a trending topic, the need for a standardized and reliable evaluation procedure grows even more pressing. The current state of affairs suggests various evaluation…

计算与语言 · 计算机科学 2020-06-12 Sarah E. Finch , Jinho D. Choi

Large language models (LLMs) are being increasingly tuned to power complex generation tasks such as writing, fact-seeking, querying and reasoning. Traditionally, human or model feedback for evaluating and further tuning LLM performance has…

计算与语言 · 计算机科学 2024-04-09 Yukti Makhija , Priyanka Agrawal , Rishi Saket , Aravindan Raghuveer

Recent advancements in reference-free learned metrics for open-domain dialogue evaluation have been driven by the progress in pre-trained language models and the availability of dialogue data with high-quality human annotations. However,…

计算与语言 · 计算机科学 2023-10-16 Chen Zhang , Luis Fernando D'Haro , Chengguang Tang , Ke Shi , Guohua Tang , Haizhou Li

We describe a two-step approach for dialogue management in task-oriented spoken dialogue systems. A unified neural network framework is proposed to enable the system to first learn by supervision from a set of dialogue data and then…

An open challenge in constructing dialogue systems is developing methods for automatically learning dialogue strategies from large amounts of unlabelled data. Recent work has proposed Next-Utterance-Classification (NUC) as a surrogate task…

计算与语言 · 计算机科学 2016-07-26 Ryan Lowe , Iulian V. Serban , Mike Noseworthy , Laurent Charlin , Joelle Pineau

Discourse coherence plays an important role in the translation of one text. However, the previous reported models most focus on improving performance over individual sentence while ignoring cross-sentence links and dependencies, which…

计算与语言 · 计算机科学 2018-11-15 Hao Xiong , Zhongjun He , Hua Wu , Haifeng Wang

Natural language analysis of human collaborative chat dialogues is an understudied domain with many unique challenges: a large number of dialogue act labels, underspecified and dynamic tasks, interleaved topics, and long-range contextual…

计算与语言 · 计算机科学 2023-12-12 Ian Perera , Matthew Johnson , Carson Wilber

We present a method for rewriting an input sentence to match specific values of nontrivial linguistic features, such as dependency depth. In contrast to earlier work, our method uses in-context learning rather than finetuning, making it…

计算与语言 · 计算机科学 2024-06-18 Sarubi Thillainathan , Alexander Koller

Personalized dialogue generation aims to leverage persona profiles and dialogue history to generate persona-relevant and consistent responses. Mainstream models typically rely on token-level language model training with persona dialogue…

计算与语言 · 计算机科学 2025-11-14 Guanrong Li , Xinyu Liu , Zhen Wu , Xinyu Dai

Speech enhancement attenuates interfering sounds in speech signals but may introduce artifacts that perceivably deteriorate the output signal. We propose a method for controlling the trade-off between the attenuation of the interfering…

音频与语音处理 · 电气工程与系统科学 2021-07-23 Christian Uhle , Matteo Torcoli , Jouni Paulus

Identifying breakdowns in ongoing dialogues helps to improve communication effectiveness. Most prior work on this topic relies on human annotated data and data augmentation to learn a classification model. While quality labeled dialogue…

计算与语言 · 计算机科学 2022-04-20 Qian Lin , Hwee Tou Ng

Large language models (LLMs) are powerful dialogue agents, but specializing them towards fulfilling a specific function can be challenging. Instructing tuning, i.e. tuning models on instruction and sample responses generated by humans…

计算与语言 · 计算机科学 2024-01-11 Dennis Ulmer , Elman Mansimov , Kaixiang Lin , Justin Sun , Xibin Gao , Yi Zhang

In this paper, we introduce the task of learning unsupervised dialogue embeddings. Trivial approaches such as combining pre-trained word or sentence embeddings and encoding through pre-trained language models (PLMs) have been shown to be…

计算与语言 · 计算机科学 2022-10-28 Che Liu , Rui Wang , Junfeng Jiang , Yongbin Li , Fei Huang

Emotion Recognition in Conversation (ERC) has become a fundamental capability for large language models (LLMs) in human-centric interaction. Beyond accurate recognition, coherent emotional expression is also crucial, yet both are limited by…

人工智能 · 计算机科学 2026-04-21 Shaowei Zhang , Faqiang Qian , Yan Chen , Ziliang Wang , Kang An , Yong Dai , Mengya Gao , Yichao Wu

Automatically evaluating dialogue coherence is a challenging but high-demand ability for developing high-quality open-domain dialogue systems. However, current evaluation metrics consider only surface features or utterance-level semantics,…

计算与语言 · 计算机科学 2020-10-09 Lishan Huang , Zheng Ye , Jinghui Qin , Liang Lin , Xiaodan Liang

An intelligent dialogue system in a multi-turn setting should not only generate the responses which are of good quality, but it should also generate the responses which can lead to long-term success of the dialogue. Although, the current…

计算与语言 · 计算机科学 2023-01-12 Anant Khandelwal