中文
相关论文

相关论文: DIAL-SUMMER: A Structured Evaluation Framework of …

200 篇论文

Pre-trained language models (PrLM) has been shown powerful in enhancing a broad range of downstream tasks including various dialogue related ones. However, PrLMs are usually trained on general plain text with common language model (LM)…

计算与语言 · 计算机科学 2021-08-03 Yi Xu , Hai Zhao

Efficiently navigating and understanding academic papers is crucial for scientific progress. Traditional linear formats like PDF and HTML can cause cognitive overload and obscure a paper's hierarchical structure, making it difficult to…

人机交互 · 计算机科学 2025-07-28 Zijian Zhang , Pan Chen , Fangshi Du , Runlong Ye , Oliver Huang , Michael Liut , Alán Aspuru-Guzik

Although human evaluation remains the gold standard for open-domain dialogue evaluation, the growing popularity of automated evaluation using Large Language Models (LLMs) has also extended to dialogue. However, most frameworks leverage…

计算与语言 · 计算机科学 2024-10-07 John Mendonça , Isabel Trancoso , Alon Lavie

Text summarization is one of the most challenging and interesting problems in NLP. Although much attention has been paid to summarizing structured text like news reports or encyclopedia articles, summarizing conversations---an essential…

计算与语言 · 计算机科学 2020-10-06 Jiaao Chen , Diyi Yang

High-quality, multi-turn instructional dialogues between novices and experts are essential for developing AI systems that support teaching, learning, and decision-making. These dialogues often involve scaffolding -- the process by which an…

人工智能 · 计算机科学 2026-02-05 Si Chen , Izzy Molnar , Ting Hua , Peiyu Li , Le Huy Khiem , G. Alex Ambrose , Jim Lang , Ronald Metoyer , Nitesh V. Chawla

Large language models (LLMs) are increasingly deployed as customer-facing agents, yet evaluating their reliability remains challenging due to stochastic, multi-turn interactions. Current evaluation protocols rely on linear Monte Carlo…

人工智能 · 计算机科学 2026-04-24 Itay Nakash , George Kour , Ateret Anaby-Tavor

This paper introduces CaseSumm, a novel dataset for long-context summarization in the legal domain that addresses the need for longer and more complex datasets for summarization evaluation. We collect 25.6K U.S. Supreme Court (SCOTUS)…

计算与语言 · 计算机科学 2025-01-03 Mourad Heddaya , Kyle MacMillan , Anup Malani , Hongyuan Mei , Chenhao Tan

Disentanglement is a problem in which multiple conversations occur in the same channel simultaneously, and the listener should decide which utterance is part of the conversation he will respond to. We propose a new model, named Dialogue…

计算与语言 · 计算机科学 2021-09-14 Tianda Li , Jia-Chen Gu , Xiaodan Zhu , Quan Liu , Zhen-Hua Ling , Zhiming Su , Si Wei

Spoken dialogues with and between voice agents are becoming increasingly common, yet assessing them for their socially harmful content such as violence, harassment, and hate remains text-centric and fails to account for audio-specific cues…

音频与语音处理 · 电气工程与系统科学 2026-02-05 Amir Ivry , Shinji Watanabe

Dialogue related Machine Reading Comprehension requires language models to effectively decouple and model multi-turn dialogue passages. As a dialogue development goes after the intentions of participants, its topic may not keep constant…

计算与语言 · 计算机科学 2023-09-19 Xinbei Ma , Yi Xu , Hai Zhao , Zhuosheng Zhang

Large language models (LLMs) have shown remarkable capabilities in generating user summaries from a long list of raw user activity data. These summaries capture essential user information such as preferences and interests, and therefore are…

机器学习 · 计算机科学 2024-09-09 Chao Wang , Neo Wu , Lin Ning , Jiaxing Wu , Luyang Liu , Jun Xie , Shawn O'Banion , Bradley Green

The future of conversational agents will provide users with personalized information responses. However, a significant challenge in developing models is the lack of large-scale dialogue datasets that span multiple sessions and reflect…

信息检索 · 计算机科学 2024-05-07 Hideaki Joko , Shubham Chatterjee , Andrew Ramsay , Arjen P. de Vries , Jeff Dalton , Faegheh Hasibi

Structured data offers a sophisticated mechanism for the organization of information. Existing methodologies for the text-serialization of structured data in the context of large language models fail to adequately address the heterogeneity…

计算与语言 · 计算机科学 2024-02-20 YiQiu Guo , Yuchen Yang , Ya Zhang , Yu Wang , Yanfeng Wang

Conversational search enables multi-turn interactions between users and systems to fulfill users' complex information needs. During this interaction, the system should understand the users' search intent within the conversational context…

信息检索 · 计算机科学 2025-06-13 Fengran Mo , Chuan Meng , Mohammad Aliannejadi , Jian-Yun Nie

Spoken dialogue modeling poses challenges beyond text-based language modeling, requiring real-time interaction, turn-taking, and backchanneling. While most Spoken Dialogue Models (SDMs) operate in half-duplex mode-processing one turn at a…

计算与语言 · 计算机科学 2025-08-19 Guan-Ting Lin , Jiachen Lian , Tingle Li , Qirui Wang , Gopala Anumanchipalli , Alexander H. Liu , Hung-yi Lee

Abstractive dialogue summarization is the task of distilling conversations into informative and concise summaries. Although reviews have been conducted on this topic, there is a lack of comprehensive work detailing the challenges of…

计算与语言 · 计算机科学 2025-04-25 Frederic Kirstein , Jan Philip Wahle , Bela Gipp , Terry Ruas

Large Language Models (LLMs) have demonstrated remarkable capabilities in understanding and generating human-like text, yet they largely operate as reactive agents, responding only when directly prompted. This passivity creates an…

计算与语言 · 计算机科学 2026-05-18 Deep Anil Patel , Iain Melvin , Christopher Malon , Martin Renqiang Min

In second language learning, scenario-based conversation practice is important for language learners to achieve fluency in speaking, but students often lack sufficient opportunities to practice their conversational skills with qualified…

计算与语言 · 计算机科学 2024-04-01 Shuyao Xu , Long Qin , Tianyang Chen , Zhenzhou Zha , Bingxue Qiu , Weizhi Wang

Online conversations have become more prevalent on public discussion platforms (e.g. Reddit). With growing controversial topics, it is desirable to summarize not only diverse arguments, but also their rationale and justification. Early…

计算与语言 · 计算机科学 2025-11-24 An Quang Tang , Xiuzhen Zhang , Minh Ngoc Dinh , Zhuang Li

We introduce Drivelology, a unique linguistic phenomenon characterised as "nonsense with depth" - utterances that are syntactically coherent yet pragmatically paradoxical, emotionally loaded, or rhetorically subversive. While such…

计算与语言 · 计算机科学 2025-10-17 Yang Wang , Chenghao Xiao , Chia-Yi Hsiao , Zi Yan Chang , Chi-Li Chen , Tyler Loakman , Chenghua Lin