English
Related papers

Related papers: SueNes: A Weakly Supervised Approach to Evaluating…

200 papers

Reinforcement learning with evaluation metrics as rewards is widely used to enhance specific capabilities of language models. However, for tasks such as factually consistent summarisation, existing metrics remain underdeveloped, limiting…

Computation and Language · Computer Science 2026-05-27 Yuxuan Ye , Raul Santos-Rodriguez , Edwin Simpson

Neural abstractive summarization methods often require large quantities of labeled training data. However, labeling large amounts of summarization data is often prohibitive due to time, financial, and expertise constraints, which has…

Computation and Language · Computer Science 2022-02-09 Junnan Liu , Qianren Mao , Bang Liu , Hao Peng , Hongdong Zhu , Jianxin Li

Scientific peer review is essential for the quality of academic publications. However, the increasing number of paper submissions to conferences has strained the reviewing process. This surge poses a burden on area chairs who have to…

Computation and Language · Computer Science 2024-06-12 Maxime Darrin , Ines Arous , Pablo Piantanida , Jackie CK Cheung

Multi-document summarization aims to obtain core information from a collection of documents written on the same topic. This paper proposes a new holistic framework for unsupervised multi-document extractive summarization. Our method…

Computation and Language · Computer Science 2023-09-11 Haopeng Zhang , Sangwoo Cho , Kaiqiang Song , Xiaoyang Wang , Hongwei Wang , Jiawei Zhang , Dong Yu

Unsupervised extractive summarization is an important technique in information extraction and retrieval. Compared with supervised method, it does not require high-quality human-labelled summaries for training and thus can be easily applied…

Artificial Intelligence · Computer Science 2023-12-19 Renlong Jie , Xiaojun Meng , Xin Jiang , Qun Liu

Current abstractive summarization systems present important weaknesses which prevent their deployment in real-world applications, such as the omission of relevant information and the generation of factual inconsistencies (also known as…

Computation and Language · Computer Science 2022-11-08 Diogo Pernes , Afonso Mendes , André F. T. Martins

Currently, machine learning techniques have seen significant success across various applications. Most of these techniques rely on supervision from human-generated labels or a mixture of noisy and imprecise labels from multiple sources.…

Computation and Language · Computer Science 2024-09-04 Yanbo Wang , Wenyu Chen , Shimin Shan

Automatic text summarization has achieved high performance in high-resourced languages like English, but comparatively less attention has been given to summarization in less-resourced languages. This work compares a variety of different…

Computation and Language · Computer Science 2026-01-01 Chester Palen-Michel , Constantine Lignos

Despite some recent advances, automatic text summarization remains unreliable, elusive, and of limited practical use in applications. Two main problems with current summarization methods are well known: evaluation and factual consistency.…

Computation and Language · Computer Science 2022-04-12 Jay Ahn , Foaad Khosmood

Summarizing texts is not a straightforward task. Before even considering text summarization, one should determine what kind of summary is expected. How much should the information be compressed? Is it relevant to reformulate or should the…

Computation and Language · Computer Science 2020-07-16 Paul Tardy , David Janiszek , Yannick Estève , Vincent Nguyen

Automatic summarization of natural language is a current topic in computer science research and industry, studied for decades because of its usefulness across multiple domains. For example, summarization is necessary to create reviews such…

Computation and Language · Computer Science 2018-12-31 Marc Everett Johnson

Query-focused Summarization (QfS) deals with systems that generate summaries from document(s) based on a query. Motivated by the insight that Reinforcement Learning (RL) provides a generalization to Supervised Learning (SL) for Natural…

Computation and Language · Computer Science 2023-11-30 Swaroop Nath , Harshad Khadilkar , Pushpak Bhattacharyya

We address the problem of unsupervised abstractive summarization of collections of user generated reviews with self-supervision and control. We propose a self-supervised setup that considers an individual document as a target summary for a…

Computation and Language · Computer Science 2020-05-04 Hady Elsahar , Maximin Coavoux , Matthias Gallé , Jos Rozen

Human language production exhibits remarkable richness and variation, reflecting diverse communication styles and intents. However, this variation is often overlooked in summarization evaluation. While having multiple reference summaries is…

Computation and Language · Computer Science 2025-09-17 Silvia Casola , Yang Janet Liu , Siyao Peng , Oliver Kraus , Albert Gatt , Barbara Plank

Supervised approaches for Neural Abstractive Summarization require large annotated corpora that are costly to build. We present a French meeting summarization task where reports are predicted based on the automatic transcription of the…

Computation and Language · Computer Science 2020-09-18 Paul Tardy , Louis de Seynes , François Hernandez , Vincent Nguyen , David Janiszek , Yannick Estève

Text summarization aims to generate a short summary for an input text. In this work, we propose a Non-Autoregressive Unsupervised Summarization (NAUS) approach, which does not require parallel data for training. Our NAUS first performs…

Computation and Language · Computer Science 2022-05-31 Puyuan Liu , Chenyang Huang , Lili Mou

Automated evaluation is crucial for streamlining text summarization benchmarking and model development, given the costly and time-consuming nature of human evaluation. Traditional methods like ROUGE do not correlate well with human…

Computation and Language · Computer Science 2024-07-23 Hwanjun Song , Hang Su , Igor Shalyminov , Jason Cai , Saab Mansour

Automatic summary assessment is useful for both machine-generated and human-produced summaries. Automatically evaluating the summary text given the document enables, for example, summary generation system development and detection of…

Computation and Language · Computer Science 2022-08-30 Potsawee Manakul , Mark J. F. Gales

We present a neural framework for opinion summarization from online product reviews which is knowledge-lean and only requires light supervision (e.g., in the form of product domain labels and user-provided ratings). Our method combines two…

Computation and Language · Computer Science 2018-08-28 Stefanos Angelidis , Mirella Lapata

Natural Language Processing is booming with its applications in the real world, one of which is Text Summarization for large texts including news articles. This research paper provides an extensive comparative evaluation of extractive and…

Computation and Language · Computer Science 2023-10-19 Kavach Dheer , Arpit Dhankhar