English
Related papers

Related papers: A Novel LLM-based Two-stage Summarization Approach…

200 papers

We present a method to produce abstractive summaries of long documents that exceed several thousand words via neural abstractive summarization. We perform a simple extractive step before generating a summary, which is then used to condition…

Computation and Language · Computer Science 2020-04-29 Sandeep Subramanian , Raymond Li , Jonathan Pilault , Christopher Pal

Summarization of legal case judgement documents is a challenging problem in Legal NLP. However, not much analyses exist on how different families of summarization models (e.g., extractive vs. abstractive) perform when applied to legal case…

Computation and Language · Computer Science 2022-10-17 Abhay Shukla , Paheli Bhattacharya , Soham Poddar , Rajdeep Mukherjee , Kripabandhu Ghosh , Pawan Goyal , Saptarshi Ghosh

Large Language Models (LLMs) have been widely applied in summarization due to their speedy and high-quality text generation. Summarization for sensemaking involves information compression and insight extraction. Human guidance in…

Human-Computer Interaction · Computer Science 2024-09-27 Xuxin Tang , Eric Krokos , Can Liu , Kylie Davidson , Kirsten Whitley , Naren Ramakrishnan , Chris North

Large Language Models (LLMs) have shown promising performance in summary evaluation tasks, yet they face challenges such as high computational costs and the Lost-in-the-Middle problem where important information in the middle of long…

Computation and Language · Computer Science 2024-01-19 Yunshu Wu , Hayate Iso , Pouya Pezeshkpour , Nikita Bhutani , Estevam Hruschka

Dialogue summarization aims to condense the original dialogue into a shorter version covering salient information, which is a crucial way to reduce dialogue data overload. Recently, the promising achievements in both dialogue systems and…

Computation and Language · Computer Science 2022-04-29 Xiachong Feng , Xiaocheng Feng , Bing Qin

Large language models (LLMs) have achieved impressive performance in text summarization, yet their performance often falls short when applied to specialized domains that differ from their original pre-training distribution. While…

Computation and Language · Computer Science 2025-10-10 Xue-Yong Fu , Elena Khasanova , Md Tahmid Rahman Laskar , Harsh Saini , Shashi Bhushan TN

Existing long-document question answering systems typically process texts as flat sequences or use heuristic chunking, which overlook the discourse structures that naturally guide human comprehension. We present a discourse-aware…

Information Retrieval · Computer Science 2026-05-08 Huiyao Chen , Yi Yang , Yinghui Li , Meishan Zhang , Baotian Hu , Min Zhang

Evaluating text summarization has been a challenging task in natural language processing (NLP). Automatic metrics which heavily rely on reference summaries are not suitable in many situations, while human evaluation is time-consuming and…

Computation and Language · Computer Science 2024-07-02 Huyen Nguyen , Haihua Chen , Lavanya Pobbathi , Junhua Ding

Personalization, the ability to tailor a system to individual users, is an essential factor in user experience with natural language processing (NLP) systems. With the emergence of Large Language Models (LLMs), a key question is how to…

Computation and Language · Computer Science 2023-11-01 Chris Richardson , Yao Zhang , Kellen Gillespie , Sudipta Kar , Arshdeep Singh , Zeynab Raeesy , Omar Zia Khan , Abhinav Sethy

We introduce a novel approach for long context summarisation, highlight-guided generation, that leverages sentence-level information as a content plan to improve the traceability and faithfulness of generated summaries. Our framework…

Computation and Language · Computer Science 2025-12-22 Xiaotang Du , Rohit Saxena , Laura Perez-Beltrachini , Pasquale Minervini , Ivan Titov

We address the task of evidence retrieval for long document question answering, which involves locating relevant paragraphs within a document to answer a question. We aim to assess the applicability of large language models (LLMs) in the…

Computation and Language · Computer Science 2023-11-23 Inderjeet Nair , Shwetha Somasundaram , Apoorv Saxena , Koustava Goswami

Dialogue summarization is a challenging task with significant practical value in customer service, meeting analysis, and conversational AI. Although large language models (LLMs) have achieved substantial progress in summarization tasks, the…

Computation and Language · Computer Science 2025-07-04 Keyan Jin , Yapeng Wang , Leonel Santos , Tao Fang , Xu Yang , Sio Kei Im , Hugo Gonçalo Oliveira

Text summarization is a fundamental task in natural language processing (NLP), and the information explosion has made long-document processing increasingly demanding, making summarization essential. Existing research mainly focuses on model…

Summarizing long-form narratives--such as books, movies, and TV scripts--requires capturing intricate plotlines, character interactions, and thematic coherence, a task that remains challenging for existing LLMs. We introduce NexusSum, a…

Computation and Language · Computer Science 2025-06-02 Hyuntak Kim , Byung-Hak Kim

Text summarization research has undergone several significant transformations with the advent of deep neural networks, pre-trained language models (PLMs), and recent large language models (LLMs). This survey thus provides a comprehensive…

Computation and Language · Computer Science 2024-06-18 Haopeng Zhang , Philip S. Yu , Jiawei Zhang

Summarization is a core task in Natural Language Processing (NLP). Recent advances in Large Language Models (LLMs) and the introduction of large context windows reaching millions of tokens make it possible to process entire books in a…

Computation and Language · Computer Science 2026-03-12 Tairan Fu , Javier Conde , Pedro Reviriego , Javier Coronado-Blázquez , Nina Melero , Elena Merino-Gómez

Recent advances in Large Language Models (LLMs) have been changing the paradigm of Recommender Systems (RS). However, when items in the recommendation scenarios contain rich textual information, such as product descriptions in online…

Information Retrieval · Computer Science 2024-03-21 Zhi Zheng , Wenshuo Chao , Zhaopeng Qiu , Hengshu Zhu , Hui Xiong

Large Language Models (LLMs) are increasingly deployed across edge and cloud platforms for real-time question-answering and retrieval-augmented generation. However, processing lengthy contexts in distributed systems incurs high…

Computation and Language · Computer Science 2025-05-19 Camille Couturier , Spyros Mastorakis , Haiying Shen , Saravan Rajmohan , Victor Rühle

The rapid advancement of Large Language Models (LLMs) has inaugurated a transformative epoch in natural language processing, fostering unprecedented proficiency in text generation, comprehension, and contextual scrutiny. Nevertheless,…

Machine Learning · Computer Science 2024-04-22 Cangqing Wang , Yutian Yang , Ruisi Li , Dan Sun , Ruicong Cai , Yuzhu Zhang , Chengqian Fu , Lillian Floyd

Text summarizing is a critical Natural Language Processing (NLP) task with applications ranging from information retrieval to content generation. Large Language Models (LLMs) have shown remarkable promise in generating fluent abstractive…

Computation and Language · Computer Science 2025-03-03 Colleen Gilhuly , Haleh Shahzad