English
Related papers

Related papers: Learning to Control Summaries with Score Ranking

200 papers

Factual inconsistencies in generated summaries severely limit the practical applications of abstractive dialogue summarization. Although significant progress has been achieved by using pre-trained models, substantial amounts of hallucinated…

Computation and Language · Computer Science 2023-05-10 Xiangru Tang , Arjun Nair , Borui Wang , Bingyao Wang , Jai Desai , Aaron Wade , Haoran Li , Asli Celikyilmaz , Yashar Mehdad , Dragomir Radev

Cross-lingual summarization (CLS) is a sophisticated branch in Natural Language Processing that demands models to accurately translate and summarize articles from different source languages. Despite the improvement of the subsequent…

Computation and Language · Computer Science 2024-11-27 Sanzana Karim Lora , M. Sohel Rahman , Rifat Shahriyar

This paper describes an investigation of the robustness of large language models (LLMs) for retrieval augmented generation (RAG)-based summarization tasks. While LLMs provide summarization capabilities, their performance in complex,…

Computation and Language · Computer Science 2024-04-01 Shengjie Liu , Jing Wu , Jingyuan Bao , Wenyi Wang , Naira Hovakimyan , Christopher G Healey

Extractive summarization can produce faithful summaries but often requires additional constraints such as a desired summary length. Traditional sentence compression models do not typically consider the constraints because of their…

Computation and Language · Computer Science 2024-06-21 Juseon-Do , Jingun Kwon , Hidetaka Kamigaito , Manabu Okumura

Code summarization aims to generate concise natural language descriptions for source code. Deep learning has been used more and more recently in software engineering, particularly for tasks like code creation and summarization.…

Software Engineering · Computer Science 2025-01-27 Md. Ahnaf Akib , Md. Muktadir Mazumder , Salman Ahsan

Conventional dialogue summarization methods directly generate summaries and do not consider user's specific interests. This poses challenges in cases where the users are more focused on particular topics or aspects. With the advancement of…

Computation and Language · Computer Science 2024-08-02 Bin Wang , Zhengyuan Liu , Nancy F. Chen

We address the problem of unsupervised abstractive summarization of collections of user generated reviews with self-supervision and control. We propose a self-supervised setup that considers an individual document as a target summary for a…

Computation and Language · Computer Science 2020-05-04 Hady Elsahar , Maximin Coavoux , Matthias Gallé , Jos Rozen

Evaluating the quality of generated text automatically remains a significant challenge. Conventional reference-based metrics have been shown to exhibit relatively weak correlation with human evaluations. Recent research advocates the use of…

Computation and Language · Computer Science 2025-11-25 Xiao Wang , Daniil Larionov , Siwei Wu , Yiqi Liu , Steffen Eger , Nafise Sadat Moosavi , Chenghua Lin

Unsupervised extractive summarization is an important technique in information extraction and retrieval. Compared with supervised method, it does not require high-quality human-labelled summaries for training and thus can be easily applied…

Artificial Intelligence · Computer Science 2023-12-19 Renlong Jie , Xiaojun Meng , Xin Jiang , Qun Liu

Prompts with different control signals (e.g., length, keywords, etc.) can be used to control text summarization. When control signals are available, they can control the properties of generated summaries and potentially improve…

Computation and Language · Computer Science 2022-12-20 Yubo Zhang , Xingxing Zhang , Xun Wang , Si-qing Chen , Furu Wei

Large Language Models (LLMs) often suffer from hallucinations: output content that is not grounded in the input context, when performing long-form text generation tasks such as summarization. Prior works have shown that hallucinations can…

Computation and Language · Computer Science 2025-12-23 Ting-Yao Hu , Hema Swetha Koppula , Hadi Pouransari , Cem Koc , Oncel Tuzel , Raviteja Vemulapalli

Recent advances in summary evaluation are based on model-based metrics to assess quality dimensions, such as completeness, conciseness, and faithfulness. However, these methods often require large language models, and predicted scores are…

Computation and Language · Computer Science 2026-04-21 Hongye Liu , Dhanajit Brahma , Ricardo Henao

Improving the quality of model-generated summaries, especially factuality, the accuracy of a summary with respect to its source content, remains a challenge. While reranking could select the optimal output from multiple generated…

Computation and Language · Computer Science 2026-05-29 Riza Setiawan Soetedjo , Yusuke Sakai , Hidetaka Kamigaito , Jingun Kwon , Manabu Okumura , Taro Watanabe

Lack of factual correctness is an issue that still plagues state-of-the-art summarization systems despite their impressive progress on generating seemingly fluent summaries. In this paper, we show that factual inconsistency can be caused by…

Computation and Language · Computer Science 2024-01-22 Asish Ghoshal , Arash Einolghozati , Ankit Arun , Haoran Li , Lili Yu , Vera Gor , Yashar Mehdad , Scott Wen-tau Yih , Asli Celikyilmaz

In recent years, automatic text summarization has witnessed significant advancement, particularly with the development of transformer-based models. However, the challenge of controlling the readability level of generated summaries remains…

Computation and Language · Computer Science 2025-03-17 Mehmet Samet Duran , Tevfik Aytekin

Lay summarisation aims to produce summaries of scientific articles that are comprehensible to non-expert audiences. However, previous work assumes a one-size-fits-all approach, where the content and style of the produced summary are…

Computation and Language · Computer Science 2024-06-11 Zhihao Zhang , Tomas Goldsack , Carolina Scarton , Chenghua Lin

Despite recent advancements in automatic summarization, state-of-the-art models do not summarize all documents equally well, raising the question: why? While prior research has extensively analyzed summarization models, little attention has…

Computation and Language · Computer Science 2025-04-09 Steven Koniaev , Ori Ernst , Jackie Chi Kit Cheung

Online reviews play a pivotal role in influencing consumer decisions across various domains, from purchasing products to selecting hotels or restaurants. However, the sheer volume of reviews -- often containing repetitive or irrelevant…

Computation and Language · Computer Science 2024-10-18 Mir Tafseer Nayeem , Davood Rafiei

This study presents a controllable abstract summary generation method for large language models based on prompt engineering. To address the issues of summary quality and controllability in traditional methods, we design a multi-stage prompt…

Computation and Language · Computer Science 2025-10-20 Xiangchen Song , Yuchen Liu , Yaxuan Luan , Jinxu Guo , Xiaofan Guo

The scarcity of comprehensive up-to-date studies on evaluation metrics for text summarization and the lack of consensus regarding evaluation protocols continue to inhibit progress. We address the existing shortcomings of summarization…

Computation and Language · Computer Science 2021-02-03 Alexander R. Fabbri , Wojciech Kryściński , Bryan McCann , Caiming Xiong , Richard Socher , Dragomir Radev