English
Related papers

Related papers: DIAL-SUMMER: A Structured Evaluation Framework of …

200 papers

Pre-trained language models (PrLM) has been shown powerful in enhancing a broad range of downstream tasks including various dialogue related ones. However, PrLMs are usually trained on general plain text with common language model (LM)…

Computation and Language · Computer Science 2021-08-03 Yi Xu , Hai Zhao

Efficiently navigating and understanding academic papers is crucial for scientific progress. Traditional linear formats like PDF and HTML can cause cognitive overload and obscure a paper's hierarchical structure, making it difficult to…

Human-Computer Interaction · Computer Science 2025-07-28 Zijian Zhang , Pan Chen , Fangshi Du , Runlong Ye , Oliver Huang , Michael Liut , Alán Aspuru-Guzik

Although human evaluation remains the gold standard for open-domain dialogue evaluation, the growing popularity of automated evaluation using Large Language Models (LLMs) has also extended to dialogue. However, most frameworks leverage…

Computation and Language · Computer Science 2024-10-07 John Mendonça , Isabel Trancoso , Alon Lavie

Text summarization is one of the most challenging and interesting problems in NLP. Although much attention has been paid to summarizing structured text like news reports or encyclopedia articles, summarizing conversations---an essential…

Computation and Language · Computer Science 2020-10-06 Jiaao Chen , Diyi Yang

High-quality, multi-turn instructional dialogues between novices and experts are essential for developing AI systems that support teaching, learning, and decision-making. These dialogues often involve scaffolding -- the process by which an…

Artificial Intelligence · Computer Science 2026-02-05 Si Chen , Izzy Molnar , Ting Hua , Peiyu Li , Le Huy Khiem , G. Alex Ambrose , Jim Lang , Ronald Metoyer , Nitesh V. Chawla

Large language models (LLMs) are increasingly deployed as customer-facing agents, yet evaluating their reliability remains challenging due to stochastic, multi-turn interactions. Current evaluation protocols rely on linear Monte Carlo…

Artificial Intelligence · Computer Science 2026-04-24 Itay Nakash , George Kour , Ateret Anaby-Tavor

This paper introduces CaseSumm, a novel dataset for long-context summarization in the legal domain that addresses the need for longer and more complex datasets for summarization evaluation. We collect 25.6K U.S. Supreme Court (SCOTUS)…

Computation and Language · Computer Science 2025-01-03 Mourad Heddaya , Kyle MacMillan , Anup Malani , Hongyuan Mei , Chenhao Tan

Disentanglement is a problem in which multiple conversations occur in the same channel simultaneously, and the listener should decide which utterance is part of the conversation he will respond to. We propose a new model, named Dialogue…

Computation and Language · Computer Science 2021-09-14 Tianda Li , Jia-Chen Gu , Xiaodan Zhu , Quan Liu , Zhen-Hua Ling , Zhiming Su , Si Wei

Spoken dialogues with and between voice agents are becoming increasingly common, yet assessing them for their socially harmful content such as violence, harassment, and hate remains text-centric and fails to account for audio-specific cues…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-05 Amir Ivry , Shinji Watanabe

Dialogue related Machine Reading Comprehension requires language models to effectively decouple and model multi-turn dialogue passages. As a dialogue development goes after the intentions of participants, its topic may not keep constant…

Computation and Language · Computer Science 2023-09-19 Xinbei Ma , Yi Xu , Hai Zhao , Zhuosheng Zhang

Large language models (LLMs) have shown remarkable capabilities in generating user summaries from a long list of raw user activity data. These summaries capture essential user information such as preferences and interests, and therefore are…

Machine Learning · Computer Science 2024-09-09 Chao Wang , Neo Wu , Lin Ning , Jiaxing Wu , Luyang Liu , Jun Xie , Shawn O'Banion , Bradley Green

The future of conversational agents will provide users with personalized information responses. However, a significant challenge in developing models is the lack of large-scale dialogue datasets that span multiple sessions and reflect…

Information Retrieval · Computer Science 2024-05-07 Hideaki Joko , Shubham Chatterjee , Andrew Ramsay , Arjen P. de Vries , Jeff Dalton , Faegheh Hasibi

Structured data offers a sophisticated mechanism for the organization of information. Existing methodologies for the text-serialization of structured data in the context of large language models fail to adequately address the heterogeneity…

Computation and Language · Computer Science 2024-02-20 YiQiu Guo , Yuchen Yang , Ya Zhang , Yu Wang , Yanfeng Wang

Conversational search enables multi-turn interactions between users and systems to fulfill users' complex information needs. During this interaction, the system should understand the users' search intent within the conversational context…

Information Retrieval · Computer Science 2025-06-13 Fengran Mo , Chuan Meng , Mohammad Aliannejadi , Jian-Yun Nie

Spoken dialogue modeling poses challenges beyond text-based language modeling, requiring real-time interaction, turn-taking, and backchanneling. While most Spoken Dialogue Models (SDMs) operate in half-duplex mode-processing one turn at a…

Computation and Language · Computer Science 2025-08-19 Guan-Ting Lin , Jiachen Lian , Tingle Li , Qirui Wang , Gopala Anumanchipalli , Alexander H. Liu , Hung-yi Lee

Abstractive dialogue summarization is the task of distilling conversations into informative and concise summaries. Although reviews have been conducted on this topic, there is a lack of comprehensive work detailing the challenges of…

Computation and Language · Computer Science 2025-04-25 Frederic Kirstein , Jan Philip Wahle , Bela Gipp , Terry Ruas

Large Language Models (LLMs) have demonstrated remarkable capabilities in understanding and generating human-like text, yet they largely operate as reactive agents, responding only when directly prompted. This passivity creates an…

Computation and Language · Computer Science 2026-05-18 Deep Anil Patel , Iain Melvin , Christopher Malon , Martin Renqiang Min

In second language learning, scenario-based conversation practice is important for language learners to achieve fluency in speaking, but students often lack sufficient opportunities to practice their conversational skills with qualified…

Computation and Language · Computer Science 2024-04-01 Shuyao Xu , Long Qin , Tianyang Chen , Zhenzhou Zha , Bingxue Qiu , Weizhi Wang

Online conversations have become more prevalent on public discussion platforms (e.g. Reddit). With growing controversial topics, it is desirable to summarize not only diverse arguments, but also their rationale and justification. Early…

Computation and Language · Computer Science 2025-11-24 An Quang Tang , Xiuzhen Zhang , Minh Ngoc Dinh , Zhuang Li

We introduce Drivelology, a unique linguistic phenomenon characterised as "nonsense with depth" - utterances that are syntactically coherent yet pragmatically paradoxical, emotionally loaded, or rhetorically subversive. While such…

Computation and Language · Computer Science 2025-10-17 Yang Wang , Chenghao Xiao , Chia-Yi Hsiao , Zi Yan Chang , Chi-Li Chen , Tyler Loakman , Chenghua Lin