中文
相关论文

相关论文: DIAL-SUMMER: A Structured Evaluation Framework of …

200 篇论文

Code-switching (CS) poses a significant challenge for Large Language Models (LLMs), yet its comprehensibility remains underexplored in LLMs. We introduce CS-Sum, to evaluate the comprehensibility of CS by the LLMs through CS dialogue to…

计算与语言 · 计算机科学 2025-05-21 Sathya Krishnan Suresh , Tanmay Surana , Lim Zhi Hao , Eng Siong Chng

Hierarchical Merging is a technique commonly used to summarize very long texts ($>$100K tokens) by breaking down the input into smaller sections, summarizing those sections individually, and then merging or combining those summaries into a…

计算与语言 · 计算机科学 2025-08-11 Litu Ou , Mirella Lapata

Autonomous systems conducting schema-grounded information-gathering dialogues face an instrumentation gap, lacking turn-level observables for monitoring acquisition efficiency and detecting when questioning becomes unproductive. We…

计算与语言 · 计算机科学 2026-01-15 Dimitris Panagopoulos , Adolfo Perrusquia , Weisi Guo

Detecting factual inconsistency for long document summarization remains challenging, given the complex structure of the source article and long summary length. In this work, we study factual inconsistency errors and connect them with a line…

计算与语言 · 计算机科学 2025-02-11 Yang Zhong , Diane Litman

Building robust and general dialogue models for spoken conversations is challenging due to the gap in distributions of spoken and written data. This paper presents our approach to build generalized models for the Knowledge-grounded…

计算与语言 · 计算机科学 2022-03-09 Ruijie Yan , Shuang Peng , Haitao Mi , Liang Jiang , Shihui Yang , Yuchi Zhang , Jiajun Li , Liangrui Peng , Yongliang Wang , Zujie Wen

Reasoning is essential for effective communication and decision-making. While recent advances in LLMs and MLLMs have shown that incorporating explicit reasoning significantly improves understanding and generalization, reasoning in LSMs…

计算与语言 · 计算机科学 2025-09-23 Zhifei Xie , Ziyang Ma , Zihang Liu , Kaiyu Pang , Hongyu Li , Jialin Zhang , Yue Liao , Deheng Ye , Chunyan Miao , Shuicheng Yan

Customer-service question answering (QA) systems increasingly rely on conversational language understanding. While Large Language Models (LLMs) achieve strong performance, their high computational cost and deployment constraints limit…

计算与语言 · 计算机科学 2026-05-04 Lakshan Cooray , Deshan Sumanathilaka , Pattigadapa Venkatesh Raju

Existing long-document question answering systems typically process texts as flat sequences or use heuristic chunking, which overlook the discourse structures that naturally guide human comprehension. We present a discourse-aware…

信息检索 · 计算机科学 2026-05-08 Huiyao Chen , Yi Yang , Yinghui Li , Meishan Zhang , Baotian Hu , Min Zhang

Large Language Models (LLMs) excel at text summarization, a task that requires models to select content based on its importance. However, the exact notion of salience that LLMs have internalized remains unclear. To bridge this gap, we…

计算与语言 · 计算机科学 2025-05-28 Jan Trienes , Jörg Schlötterer , Junyi Jessy Li , Christin Seifert

In this work, we propose a novel framework that integrates large language models (LLMs) with an RL-based dialogue manager for open-ended dialogue with a specific goal. By leveraging hierarchical reinforcement learning to model the…

计算与语言 · 计算机科学 2025-07-09 Lucie Galland , Catherine Pelachaud , Florian Pecune

User simulation has long played a vital role in computer science due to its potential to support a wide range of applications. Language, as the primary medium of human communication, forms the foundation of social interaction and behavior.…

Recent advances in large language models (LLMs) have substantially improved single-turn task performance, yet real-world applications increasingly demand sophisticated multi-turn interactions. This survey provides a comprehensive review of…

计算与语言 · 计算机科学 2026-04-21 Yubo Li , Xiaobin Shen , Yidi Miao , Xinyu Yao , Xueying Ding , Ramayya Krishnan , Rema Padman

Dialogue plays a crucial role in educational settings, yet existing evaluation methods for educational applications of large language models (LLMs) primarily focus on technical performance or learning outcomes, often neglecting attention to…

计算与语言 · 计算机科学 2025-10-21 Liqun He , Manolis Mavrikis , Mutlu Cukurova

Contextual causal reasoning is a critical yet challenging capability for Large Language Models (LLMs). Existing benchmarks, however, often evaluate this skill in fragmented settings, failing to ensure context consistency or cover the full…

计算与语言 · 计算机科学 2026-04-17 Pengfeng Li , Chen Huang , Chaoqun Hao , Hongyao Chen , Xiao-Yong Wei , Wenqiang Lei , See-Kiong Ng

Text documents are structured on multiple levels of detail: individual words are related by syntax, but larger units of text are related by discourse structure. Existing language models generally fail to account for discourse structure, but…

计算与语言 · 计算机科学 2016-02-23 Yangfeng Ji , Trevor Cohn , Lingpeng Kong , Chris Dyer , Jacob Eisenstein

Dialogue assessment plays a critical role in the development of open-domain dialogue systems. Existing work are uncapable of providing an end-to-end and human-epistemic assessment dataset, while they only provide sub-metrics like coherence…

计算与语言 · 计算机科学 2023-10-26 Yukun Zhao , Lingyong Yan , Weiwei Sun , Chong Meng , Shuaiqiang Wang , Zhicong Cheng , Zhaochun Ren , Dawei Yin

Large Language Models (LLMs) have gained significant attention but also raised concerns due to the risk of misuse. Jailbreak prompts, a popular type of adversarial attack towards LLMs, have appeared and constantly evolved to breach the…

人机交互 · 计算机科学 2024-07-04 Zhihua Jin , Shiyi Liu , Haotian Li , Xun Zhao , Huamin Qu

This paper presents a novel knowledge distillation method for dialogue sequence labeling. Dialogue sequence labeling is a supervised learning task that estimates labels for each utterance in the target dialogue document, and is useful for…

Word clouds are a common way to summarize qualitative interviews, yet traditional frequency-based methods often fail in conversational contexts: they surface filler words, ignore paraphrase, and fragment semantically related ideas. This…

计算与语言 · 计算机科学 2025-08-12 Joseph T. Colonel , Baihan Lin

With the rapid advancement of Natural Language Processing in recent years, numerous studies have shown that generic summaries generated by Large Language Models (LLMs) can sometimes surpass those annotated by experts, such as journalists,…