English
Related papers

Related papers: Absformer: Transformer-based Model for Unsupervise…

200 papers

State-of-the-art extractive multi-document summarization systems are usually designed without any concern about privacy issues, meaning that all documents are open to third parties. In this paper we propose a privacy-preserving approach to…

Progress in sentence simplification has been hindered by a lack of labeled parallel simplification data, particularly in languages other than English. We introduce MUSS, a Multilingual Unsupervised Sentence Simplification system that does…

Computation and Language · Computer Science 2021-04-19 Louis Martin , Angela Fan , Éric de la Clergerie , Antoine Bordes , Benoît Sagot

Although many studies have investigated and reduced hallucinations in large language models (LLMs) for single-document tasks, research on hallucination in multi-document summarization (MDS) tasks remains largely unexplored. Specifically, it…

Computation and Language · Computer Science 2025-04-29 Catarina G. Belem , Pouya Pezeshkpour , Hayate Iso , Seiji Maekawa , Nikita Bhutani , Estevam Hruschka

Speech summarization is a critical component of spoken content understanding, particularly in the era of rapidly growing spoken and audiovisual data. Recent advances in multi-modal large language models (MLLMs), leveraging the power of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-25 Shaoshi Ling , Gang Liu , Guoli Ye , Jinyu Li

Prior work in document summarization has mainly focused on generating short summaries of a document. While this type of summary helps get a high-level view of a given document, it is desirable in some cases to know more detailed information…

Computation and Language · Computer Science 2020-12-29 Sajad Sotudeh , Arman Cohan , Nazli Goharian

We introduce PRIMERA, a pre-trained model for multi-document representation with a focus on summarization that reduces the need for dataset-specific architectures and large amounts of fine-tuning labeled data. PRIMERA uses our newly…

Computation and Language · Computer Science 2022-03-18 Wen Xiao , Iz Beltagy , Giuseppe Carenini , Arman Cohan

Unsupervised summarization is a powerful technique that enables training summarizing models without requiring labeled datasets. This survey covers different recent techniques and models used for unsupervised summarization. We cover…

Computation and Language · Computer Science 2024-09-27 Mohammad Khosravani , Amine Trabelsi

To generate summaries that include multiple aspects or topics for text documents, most approaches use clustering or topic modeling to group relevant sentences and then generate a summary for each group. These approaches struggle to optimize…

Artificial Intelligence · Computer Science 2024-05-30 Xiaobo Guo , Jay Desai , Srinivasan H. Sengamedu

Abstractive summarization aims to generate a shorter version of the document covering all the salient points in a compact and coherent fashion. On the other hand, query-based summarization highlights those points that are relevant in the…

Computation and Language · Computer Science 2018-07-16 Preksha Nema , Mitesh Khapra , Anirban Laha , Balaraman Ravindran

Previous abstractive methods apply sequence-to-sequence structures to generate summary without a module to assist the system to detect vital mentions and relationships within a document. To address this problem, we utilize semantic graph to…

Computation and Language · Computer Science 2021-09-14 Qiwei Bi , Haoyuan Li , Kun Lu , Hanfang Yang

We propose a new length-controllable abstractive summarization model. Recent state-of-the-art abstractive summarization models based on encoder-decoder models generate only one summary per source text. However, controllable summarization,…

Computation and Language · Computer Science 2020-01-22 Itsumi Saito , Kyosuke Nishida , Kosuke Nishida , Atsushi Otsuka , Hisako Asano , Junji Tomita , Hiroyuki Shindo , Yuji Matsumoto

Extreme Multimodal Summarization with Multimodal Output (XMSMO) becomes an attractive summarization approach by integrating various types of information to create extremely concise yet informative summaries for individual modalities.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Sicheng Liu , Lintao Wang , Xiaogang Zhu , Xuequan Lu , Zhiyong Wang , Kun Hu

Parallel cross-lingual summarization data is scarce, requiring models to better use the limited available cross-lingual resources. Existing methods to do so often adopt sequence-to-sequence networks with multi-task frameworks. Such…

Computation and Language · Computer Science 2021-06-15 Yu Bai , Yang Gao , Heyan Huang

We introduce a new approach for abstractive text summarization, Topic-Guided Abstractive Summarization, which calibrates long-range dependencies from topic-level features with globally salient content. The idea is to incorporate neural…

Computation and Language · Computer Science 2021-08-31 Chujie Zheng , Kunpeng Zhang , Harry Jiannan Wang , Ling Fan , Zhe Wang

Abstractive dialogue summarization is the task of distilling conversations into informative and concise summaries. Although reviews have been conducted on this topic, there is a lack of comprehensive work detailing the challenges of…

Computation and Language · Computer Science 2025-04-25 Frederic Kirstein , Jan Philip Wahle , Bela Gipp , Terry Ruas

Different from general documents, it is recognised that the ease with which people can understand a biomedical text is eminently varied, owing to the highly technical nature of biomedical documents and the variance of readers' domain…

Computation and Language · Computer Science 2023-05-02 Zheheng Luo , Qianqian Xie , Sophia Ananiadou

The evaluation of summary quality encompasses diverse dimensions such as consistency, coherence, relevance, and fluency. However, existing summarization methods often target a specific dimension, facing challenges in generating…

Computation and Language · Computer Science 2024-06-04 Sangwon Ryu , Heejin Do , Yunsu Kim , Gary Geunbae Lee , Jungseul Ok

The rapid proliferation of online content necessitates effective summarization methods, among which dynamic aspect-based summarization stands out. Unlike its traditional counterpart, which assumes a fixed set of known aspects, this approach…

Computation and Language · Computer Science 2024-06-19 Xiaobo Guo , Soroush Vosoughi

Sequence-to-sequence (s2s) models are the basis for extensive work in natural language processing. However, some applications, such as multi-document summarization, multi-modal machine translation, and the automatic post-editing of machine…

Computation and Language · Computer Science 2020-06-17 Chris Hokamp , Demian Gholipour Ghalandari , Nghia The Pham , John Glover

Text simplification (TS) rephrases long sentences into simplified variants while preserving inherent semantics. Traditional sequence-to-sequence models heavily rely on the quantity and quality of parallel sentences, which limits their…

Computation and Language · Computer Science 2020-05-01 Yanbin Zhao , Lu Chen , Zhi Chen , Kai Yu