English
Related papers

Related papers: A Focused Study on Sequence Length for Dialogue Su…

200 papers

We carry out experiments with deep learning models of summarization across the domains of news, personal stories, meetings, and medical articles in order to understand how content selection is performed. We find that many sophisticated…

Computation and Language · Computer Science 2019-02-20 Chris Kedzie , Kathleen McKeown , Hal Daume

Transformer language models typically operate with a fixed-length context window, which has grown in step with large-scale pretraining datasets. In the BabyLM Challenge, however, many past submissions have defaulted to using much shorter…

Computation and Language · Computer Science 2025-10-23 Suchir Salhan , Richard Diehl Martinez , Zébulon Goriely , Paula Buttery

Abstractive Speech Summarization (SSum) aims to generate human-like text summaries from spoken content. It encounters difficulties in handling long speech input and capturing the intricate cross-modal mapping between long speech inputs and…

Computation and Language · Computer Science 2024-07-03 Hengchao Shang , Zongyao Li , Jiaxin Guo , Shaojun Li , Zhiqiang Rao , Yuanchang Luo , Daimeng Wei , Hao Yang

We propose a new length-controllable abstractive summarization model. Recent state-of-the-art abstractive summarization models based on encoder-decoder models generate only one summary per source text. However, controllable summarization,…

Computation and Language · Computer Science 2020-01-22 Itsumi Saito , Kyosuke Nishida , Kosuke Nishida , Atsushi Otsuka , Hisako Asano , Junji Tomita , Hiroyuki Shindo , Yuji Matsumoto

Meeting summarization is a challenging task due to its dynamic interaction nature among multiple speakers and lack of sufficient training data. Existing methods view the meeting as a linear sequence of utterances while ignoring the diverse…

Computation and Language · Computer Science 2021-05-20 Xiachong Feng , Xiaocheng Feng , Bing Qin , Xinwei Geng

User simulation is essential for generating enough data to train a statistical spoken dialogue system. Previous models for user simulation suffer from several drawbacks, such as the inability to take dialogue history into account, the need…

Computation and Language · Computer Science 2016-07-04 Layla El Asri , Jing He , Kaheer Suleman

Pre-trained language models (PrLM) has been shown powerful in enhancing a broad range of downstream tasks including various dialogue related ones. However, PrLMs are usually trained on general plain text with common language model (LM)…

Computation and Language · Computer Science 2021-08-03 Yi Xu , Hai Zhao

Dialogue summarization aims to condense a given dialogue into a simple and focused summary text. Typically, both the roles' viewpoints and conversational topics change in the dialogue stream. Thus how to effectively handle the shifting…

Computation and Language · Computer Science 2023-01-31 Xinnian Liang , Shuangzhi Wu , Chenhao Cui , Jiaqi Bai , Chao Bian , Zhoujun Li

Despite recent improvements in open-domain dialogue models, state of the art models are trained and evaluated on short conversations with little context. In contrast, the long-term conversation setting has hardly been studied. In this work…

Computation and Language · Computer Science 2021-07-19 Jing Xu , Arthur Szlam , Jason Weston

We study improving social conversational agents by learning from natural dialogue between users and a deployed model, without extra annotations. To implicitly measure the quality of a machine-generated utterance, we leverage signals like…

Computation and Language · Computer Science 2024-02-02 Richard Yuanzhe Pang , Stephen Roller , Kyunghyun Cho , He He , Jason Weston

This paper provides results of evaluating some text summarisation techniques for the purpose of producing call summaries for contact centre solutions. We specifically focus on extractive summarisation methods, as they do not require any…

Computation and Language · Computer Science 2022-09-07 Alexandra N. Uma , Dmitry Sityaev

This research investigates the effect of prompt design on dialogue evaluation using large language models (LLMs). While LLMs are increasingly used for scoring various inputs, creating effective prompts for dialogue evaluation remains…

Computation and Language · Computer Science 2024-06-06 Yi-Pei Chen , KuanChao Chu , Hideki Nakayama

Many organizations require their customer-care agents to manually summarize their conversations with customers. These summaries are vital for decision making purposes of the organizations. The perspective of the summary that is required to…

Computation and Language · Computer Science 2022-03-31 Benjamin Sznajder , Chulaka Gunasekara , Guy Lev , Sachin Joshi , Eyal Shnarch , Noam Slonim

Abstractive summarization models typically generate content unfaithful to the input, thus highlighting the significance of evaluating the faithfulness of generated summaries. Most faithfulness metrics are only evaluated on news domain, can…

Computation and Language · Computer Science 2022-11-17 Sicong Huang , Asli Celikyilmaz , Haoran Li

Summarization is an important application of large language models (LLMs). Most previous evaluation of summarization models has focused on their content selection, faithfulness, grammaticality and coherence. However, it is well known that…

Computation and Language · Computer Science 2024-06-07 Julius Steen , Katja Markert

Text segmentation is important for signaling a document's structure. Without segmenting a long document into topically coherent sections, it is difficult for readers to comprehend the text, let alone find important information. The problem…

Computation and Language · Computer Science 2022-11-01 Sangwoo Cho , Kaiqiang Song , Xiaoyang Wang , Fei Liu , Dong Yu

Discourse processing suffers from data sparsity, especially for dialogues. As a result, we explore approaches to build discourse structures for dialogues, based on attention matrices from Pre-trained Language Models (PLMs). We investigate…

Computation and Language · Computer Science 2023-06-27 Chuyuan Li , Patrick Huber , Wen Xiao , Maxime Amblard , Chloé Braud , Giuseppe Carenini

Recent progress in large language models (LLMs) has enabled the automated processing of lengthy documents even without supervised training on a task-specific dataset. Yet, their zero-shot performance in complex tasks as opposed to…

Computation and Language · Computer Science 2025-11-12 WonJin Yoon , Boyu Ren , Spencer Thomas , Chanhwi Kim , Guergana Savova , Mei-Hua Hall , Timothy Miller

Large language models (LLMs) have achieved impressive performance in text summarization, yet their performance often falls short when applied to specialized domains that differ from their original pre-training distribution. While…

Computation and Language · Computer Science 2025-10-10 Xue-Yong Fu , Elena Khasanova , Md Tahmid Rahman Laskar , Harsh Saini , Shashi Bhushan TN

We present a novel summarization framework for reviews of products and services by selecting informative and concise text segments from the reviews. Our method consists of two major steps. First, we identify five frequently occurring…

Information Retrieval · Computer Science 2012-11-26 Trung V. Nguyen , Alice H. Oh