English
Related papers

Related papers: Discourse-Driven Evaluation: Unveiling Factual Inc…

200 papers

Despite the recent progress in language generation models, their outputs may not always meet user expectations. In this work, we study whether informational feedback in natural language can be leveraged to improve generation quality and…

Computation and Language · Computer Science 2023-10-17 Yixin Liu , Budhaditya Deb , Milagro Teruel , Aaron Halfaker , Dragomir Radev , Ahmed H. Awadallah

Long-form generations from large language models (LLMs) contain a mix of factual and non-factual claims, making evaluating factuality difficult. Prior works evaluate the factuality of a long paragraph by decomposing it into multiple facts,…

Computation and Language · Computer Science 2024-06-10 Cheng-Han Chiang , Hung-yi Lee

We propose an unsupervised graph-based ranking model for extractive summarization of long scientific documents. Our method assumes a two-level hierarchical graph representation of the source document, and exploits asymmetrical positional…

Computation and Language · Computer Science 2021-01-14 Yue Dong , Andrei Mircea , Jackie C. K. Cheung

Lay summaries for scientific documents typically include explanations to help readers grasp sophisticated concepts or arguments. However, current automatic summarization methods do not explicitly model explanations, which makes it difficult…

Computation and Language · Computer Science 2025-10-17 Dongqi Liu , Xi Yu , Vera Demberg , Mirella Lapata

Extracting summaries from long documents can be regarded as sentence classification using the structural information of the documents. How to use such structural information to summarize a document is challenging. In this paper, we propose…

Computation and Language · Computer Science 2023-01-23 Junyi Bian , Xiaodi Huang , Hong Zhou , Shanfeng Zhu

Factual inconsistencies in generated summaries severely limit the practical applications of abstractive dialogue summarization. Although significant progress has been achieved by using pre-trained models, substantial amounts of hallucinated…

Computation and Language · Computer Science 2023-05-10 Xiangru Tang , Arjun Nair , Borui Wang , Bingyao Wang , Jai Desai , Aaron Wade , Haoran Li , Asli Celikyilmaz , Yashar Mehdad , Dragomir Radev

Prior work in document summarization has mainly focused on generating short summaries of a document. While this type of summary helps get a high-level view of a given document, it is desirable in some cases to know more detailed information…

Computation and Language · Computer Science 2020-12-29 Sajad Sotudeh , Arman Cohan , Nazli Goharian

Long document summarization poses a significant challenge in natural language processing due to input lengths that exceed the capacity of most state-of-the-art pre-trained language models. This study proposes a hierarchical framework that…

Computation and Language · Computer Science 2024-10-10 Yuan-Jhe Yin , Bo-Yu Chen , Berlin Chen

Recent advancements in text summarization, particularly with the advent of Large Language Models (LLMs), have shown remarkable performance. However, a notable challenge persists as a substantial number of automatically-generated summaries…

Computation and Language · Computer Science 2024-09-04 Alessandro Scirè , Karim Ghonim , Roberto Navigli

Multi-document summarization is the process of automatically generating a concise summary of multiple documents related to the same topic. This summary can help users quickly understand the key information from a large collection of…

Computation and Language · Computer Science 2023-12-20 Charles Rajan , Nishit Asnani , Shreya Singh

Dialog summarization has become increasingly important in managing and comprehending large-scale conversations across various domains. This task presents unique challenges in capturing the key points, context, and nuances of multi-turn long…

Computation and Language · Computer Science 2024-02-28 Ankan Mullick , Ayan Kumar Bhowmick , Raghav R , Ravi Kokku , Prasenjit Dey , Pawan Goyal , Niloy Ganguly

This paper proposes a text summarization approach for factual reports using a deep learning model. This approach consists of three phases: feature extraction, feature enhancement, and summary generation, which work together to assimilate…

Computation and Language · Computer Science 2019-01-10 Sukriti Verma , Vagisha Nidhi

Text segmentation is important for signaling a document's structure. Without segmenting a long document into topically coherent sections, it is difficult for readers to comprehend the text, let alone find important information. The problem…

Computation and Language · Computer Science 2022-11-01 Sangwoo Cho , Kaiqiang Song , Xiaoyang Wang , Fei Liu , Dong Yu

Automated simplification models aim to make input texts more readable. Such methods have the potential to make complex information accessible to a wider audience, e.g., providing access to recent medical literature which might otherwise be…

Computation and Language · Computer Science 2022-04-18 Ashwin Devaraj , William Sheffield , Byron C. Wallace , Junyi Jessy Li

Dialogue summarization aims to provide a concise and coherent summary of conversations between multiple speakers. While recent advancements in language models have enhanced this process, summarizing dialogues accurately and faithfully…

Computation and Language · Computer Science 2024-09-17 Eunice Akani , Benoit Favre , Frederic Bechet , Romain Gemignani

Pre-trained neural abstractive summarization systems have dominated extractive strategies on news summarization performance, at least in terms of ROUGE. However, system-generated abstractive summaries often face the pitfall of factual…

Computation and Language · Computer Science 2020-10-07 Yue Dong , Shuohang Wang , Zhe Gan , Yu Cheng , Jackie Chi Kit Cheung , Jingjing Liu

The performance of text summarization has been greatly boosted by pre-trained language models. A main concern of existing methods is that most generated summaries are not factually inconsistent with their source documents. To alleviate the…

Computation and Language · Computer Science 2023-04-14 Zheheng Luo , Qianqian Xie , Sophia Ananiadou

Matching for causal inference is a well-studied problem, but standard methods fail when the units to match are text documents: the high-dimensional and rich nature of the data renders exact matching infeasible, causes propensity scores to…

Methodology · Statistics 2019-03-15 Reagan Mozer , Luke Miratrix , Aaron Russell Kaufman , L. Jason Anastasopoulos

Automatic sentence summarization produces a shorter version of a sentence, while preserving its most important information. A good summary is characterized by language fluency and high information overlap with the source sentence. We model…

Computation and Language · Computer Science 2020-05-06 Raphael Schumann , Lili Mou , Yao Lu , Olga Vechtomova , Katja Markert

Huge volumes of textual information has been produced every single day. In order to organize and understand such large datasets, in recent years, summarization techniques have become popular. These techniques aims at finding relevant,…

Computation and Language · Computer Science 2018-03-26 Jorge V. Tohalino , Diego R. Amancio