中文
相关论文

相关论文: ECoh: Turn-level Coherence Evaluation for Multilin…

200 篇论文

In this work, we investigate the human perception of coherence in open-domain dialogues. In particular, we address the problem of annotating and modeling the coherence of next-turn candidates while considering the entire history of the…

计算与语言 · 计算机科学 2020-06-19 Alessandra Cervone , Giuseppe Riccardi

End-to-end spoken dialogue models such as GPT-4o-audio have recently garnered significant attention in the speech domain. However, the evaluation of spoken dialogue models' conversational performance has largely been overlooked. This is…

音频与语音处理 · 电气工程与系统科学 2025-09-24 Shengpeng Ji , Tianle Liang , Yangzhuo Li , Jialong Zuo , Minghui Fang , Jinzheng He , Yifu Chen , Zhengqing Liu , Ziyue Jiang , Xize Cheng , Siqi Zheng , Jin Xu , Junyang Lin , Zhou Zhao

Multilingual Large Language Models (LLMs) develop cross-lingual abilities despite being trained on limited parallel data. However, they often struggle to generate responses in the intended language, favoring high-resource languages such as…

计算与语言 · 计算机科学 2025-06-02 Elnaz Rahmati , Alireza S. Ziabari , Morteza Dehghani

Designing task-oriented dialogue systems is a challenging research topic, since it needs not only to generate utterances fulfilling user requests but also to guarantee the comprehensibility. Many previous works trained end-to-end (E2E)…

计算与语言 · 计算机科学 2021-02-22 Jianhong Wang , Yuan Zhang , Tae-Kyun Kim , Yunjie Gu

Large-scale generative language models such as GPT-3 are competitive few-shot learners. While these models are known to be able to jointly represent many different languages, their training data is dominated by English, potentially limiting…

Coherent discourse is distinguished from a mere collection of utterances by the satisfaction of a diverse set of constraints, for example choice of expression, logical relation between denoted events, and implicit compatibility with…

计算与语言 · 计算机科学 2021-05-11 Anne Beyer , Sharid Loáiciga , David Schlangen

In the context of today's high-pressure, aging society, the demand for large-scale emotional models capable of providing empathetic support is more critical than ever. However, existing benchmarks fail to simultaneously achieve ecological…

计算与语言 · 计算机科学 2026-05-12 Pengze Guo , Jingxi Liang , Zhiwen Xie , Qifeng Wang , Derek F. Wong

The widespread use of social media necessitates reliable and efficient detection of offensive content to mitigate harmful effects. Although sophisticated models perform well on individual datasets, they often fail to generalize due to…

计算与语言 · 计算机科学 2024-10-08 Huy Nghiem , Hal Daumé

In this paper, a novel Generation-Evaluation framework is developed for multi-turn conversations with the objective of letting both participants know more about each other. For the sake of rational knowledge utilization and coherent…

计算与语言 · 计算机科学 2019-06-04 Siqi Bao , Huang He , Fan Wang , Rongzhong Lian , Hua Wu

Generative AI models have shown impressive performance on many Natural Language Processing tasks such as language understanding, reasoning, and language generation. An important question being asked by the AI community today is about the…

Handling multi-party dialogues represents a significant step for advancing spoken dialogue systems, necessitating the development of tasks specific to multi-party interactions. To address this challenge, we are constructing a multi-modal…

计算与语言 · 计算机科学 2025-03-19 Koji Inoue , Divesh Lala , Mikey Elmers , Keiko Ochi , Tatsuya Kawahara

Emotional Intelligence (EI) is a critical yet underexplored dimension in the development of human-aligned LLMs. To address this gap, we introduce a unified, psychologically grounded four-layer taxonomy of EI tailored for large language…

计算与语言 · 计算机科学 2025-08-11 Nizi Nazar , Ehsaneddin Asgari

Crowdsourced dialogue corpora are usually limited in scale and topic coverage due to the expensive cost of data curation. This would hinder the generalization of downstream dialogue models to open-domain topics. In this work, we leverage…

计算与语言 · 计算机科学 2023-05-19 Chujie Zheng , Sahand Sabour , Jiaxin Wen , Zheng Zhang , Minlie Huang

Since its launch in November 2022, ChatGPT has had a transformative effect on education where students are using it to help with homework assignments and teachers are actively employing it in their teaching practices. This includes using…

计算与语言 · 计算机科学 2023-10-11 Su-Youn Yoon , Eva Miszoglad , Lisa R. Pierce

Recent advances in speech language models, such as GPT-4o Voice Mode and Gemini Live, have demonstrated promising speech generation capabilities. Nevertheless, the aesthetic naturalness of the synthesized audio still lags behind that of…

Language model (LM) agents deployed in novel environments often exhibit poor sample efficiency when learning from sequential interactions. This significantly hinders the usefulness of such agents in environments where interaction is costly…

机器学习 · 计算机科学 2026-01-06 Michael Y. Hu , Benjamin Van Durme , Jacob Andreas , Harsh Jhamtani

Response diversity has become an important criterion for evaluating the quality of open-domain dialogue generation models. However, current evaluation metrics for response diversity often fail to capture the semantic diversity of generated…

计算与语言 · 计算机科学 2022-10-25 Seungju Han , Beomsu Kim , Buru Chang

Generative seq2seq dialogue systems are trained to predict the next word in dialogues that have already occurred. They can learn from large unlabeled conversation datasets, build a deeper understanding of conversational context, and…

计算与语言 · 计算机科学 2019-11-21 Sam Shleifer , Manish Chablani , Anitha Kannan , Namit Katariya , Xavier Amatriain

Generative agent models specifically tailored for smart education are critical, yet remain relatively underdeveloped. A key challenge stems from the inherent complexity of educational contexts: learners are human beings with various…

人工智能 · 计算机科学 2025-08-06 Wen-Xi Yang , Tian-Fang Zhao

The integration of generative AI in education is expanding, yet empirical analyses of large-scale, real-world interactions between students and AI systems still remain limited. In this study, we present ChEDDAR, ChatGPT & EFL Learner's…

计算与语言 · 计算机科学 2024-03-21 Jieun Han , Haneul Yoo , Junho Myung , Minsun Kim , Tak Yeon Lee , So-Yeon Ahn , Alice Oh