English
Related papers

Related papers: Utilizing GPT to Enhance Text Summarization: A Str…

200 papers

Sentiment analysis is a crucial task in natural language processing (NLP) that enables the extraction of meaningful insights from textual data, particularly from dynamic platforms like Twitter and IMDB. This study explores a hybrid…

Computation and Language · Computer Science 2026-03-02 Aish Albladi , Md Kaosar Uddin , Minarul Islam , Cheryl Seals

Plan-guided summarization attempts to reduce hallucinations in small language models (SLMs) by grounding generated summaries to the source text, typically by targeting fine-grained details such as dates or named entities. In this work, we…

Computation and Language · Computer Science 2025-08-25 Matt Grenander , Siddharth Varia , Paula Czarnowska , Yogarshi Vyas , Kishaloy Halder , Bonan Min

Text summarization is a downstream natural language processing (NLP) task that challenges the understanding and generation capabilities of language models. Considerable progress has been made in automatically summarizing short texts, such…

Computation and Language · Computer Science 2023-06-05 Guang Lu , Sylvia B. Larcher , Tu Tran

Text summarization has been a crucial problem in natural language processing (NLP) for several decades. It aims to condense lengthy documents into shorter versions while retaining the most critical information. Various methods have been…

Computation and Language · Computer Science 2023-02-17 Xianjun Yang , Yan Li , Xinlu Zhang , Haifeng Chen , Wei Cheng

In inference problems, we often have domain knowledge which allows us to define summary statistics that capture most of the information content in a dataset. In this paper, we present a hybrid approach, where such physics-based summaries…

Cosmology and Nongalactic Astrophysics · Physics 2025-04-24 T. Lucas Makinen , Alan Heavens , Natalia Porqueres , Tom Charnock , Axel Lapel , Benjamin D. Wandelt

Deep learning has led to significant improvement in text summarization with various methods investigated and improved ROUGE scores reported over the years. However, gaps still exist between summaries produced by automatic summarizers and…

Computation and Language · Computer Science 2020-10-12 Dandan Huang , Leyang Cui , Sen Yang , Guangsheng Bao , Kun Wang , Jun Xie , Yue Zhang

This paper proposes a methodology for generating and perturbing detailed derivations of equations at scale, aided by a symbolic engine, to evaluate the generalisability of Transformers to out-of-distribution mathematical reasoning problems.…

Computation and Language · Computer Science 2024-04-09 Jordan Meadows , Marco Valentino , Damien Teney , Andre Freitas

We investigate automatic interlinear glossing in low-resource settings. We augment a hard-attentional neural model with embedded translation information extracted from interlinear glossed text. After encoding these translations using large…

Computation and Language · Computer Science 2024-03-14 Changbing Yang , Garrett Nicolai , Miikka Silfverberg

Recently developed large language models have achieved remarkable success in generating fluent and coherent text. However, these models often tend to 'hallucinate' which critically hampers their reliability. In this work, we address this…

Computation and Language · Computer Science 2023-08-15 Neeraj Varshney , Wenlin Yao , Hongming Zhang , Jianshu Chen , Dong Yu

One of the challenges of developing a summarization model arises from the difficulty in measuring the factual inconsistency of the generated text. In this study, we reinterpret the decoder overconfidence-regularizing objective suggested in…

Computation and Language · Computer Science 2022-11-28 Seonil Son , Junsoo Park , Jeong-in Hwang , Junghwa Lee , Hyungjong Noh , Yeonsoo Lee

Methods for improving deep neural network training times and model generalizability consist of various data augmentation, regularization, and optimization approaches, which tend to be sensitive to hyperparameter settings and make…

Machine Learning · Computer Science 2022-11-02 Masud An-Nur Islam Fahim , Jani Boutellier

Hallucination, the generation of factually incorrect content, is a growing challenge in Large Language Models (LLMs). Existing detection and mitigation methods are often isolated and insufficient for domain-specific needs, lacking a…

Computation and Language · Computer Science 2025-01-22 Mengfei Liang , Archish Arun , Zekun Wu , Cristian Munoz , Jonathan Lutch , Emre Kazim , Adriano Koshiyama , Philip Treleaven

In this paper, we describe our methodology for the CLEF 2025 SimpleText Task 2, which focuses on detecting and evaluating creative generation and information distortion in scientific text simplification. Our solution integrates multiple…

Computation and Language · Computer Science 2025-08-19 Krishna Chaitanya Marturi , Heba H. Elwazzan

Text summarizing is a critical Natural Language Processing (NLP) task with applications ranging from information retrieval to content generation. Large Language Models (LLMs) have shown remarkable promise in generating fluent abstractive…

Computation and Language · Computer Science 2025-03-03 Colleen Gilhuly , Haleh Shahzad

One of the most challenging aspects of current single-document news summarization is that the summary often contains 'extrinsic hallucinations', i.e., facts that are not present in the source document, which are often derived via world…

Computation and Language · Computer Science 2021-09-23 Xinnuo Xu , Ondřej Dušek , Shashi Narayan , Verena Rieser , Ioannis Konstas

Recent advancements in large language models (LLMs) have considerably advanced the capabilities of summarization systems. However, they continue to face concerns about hallucinations. While prior work has evaluated LLMs extensively in news…

Computation and Language · Computer Science 2024-06-06 Sanjana Ramprasad , Elisa Ferracane , Zachary C. Lipton

Large Language Models (LLMs) have shown propensity to generate hallucinated outputs, i.e., texts that are factually incorrect or unsupported. Existing methods for alleviating hallucinations typically require costly human annotations to…

Computation and Language · Computer Science 2024-04-03 Yu Xia , Xu Liu , Tong Yu , Sungchul Kim , Ryan A. Rossi , Anup Rao , Tung Mai , Shuai Li

This review examines the development of abstractive NLP-based text summarization approaches and compares them to existing techniques for extractive summarization. A brief history of text summarization from the 1950s to the introduction of…

Computation and Language · Computer Science 2024-11-19 Leon Kopitar , Primoz Kocbek , Lucija Gosak , Gregor Stiglic

Although many studies have investigated and reduced hallucinations in large language models (LLMs) for single-document tasks, research on hallucination in multi-document summarization (MDS) tasks remains largely unexplored. Specifically, it…

Computation and Language · Computer Science 2025-04-29 Catarina G. Belem , Pouya Pezeshkpour , Hayate Iso , Seiji Maekawa , Nikita Bhutani , Estevam Hruschka

Summarization for scientific text has shown significant benefits both for the research community and human society. Given the fact that the nature of scientific text is distinctive and the input of the multi-document summarization task is…

Computation and Language · Computer Science 2024-09-30 Huy Quoc To , Ming Liu , Guangyan Huang , Hung-Nghiep Tran , Andr'e Greiner-Petter , Felix Beierle , Akiko Aizawa