English
Related papers

Related papers: UMSE: Unified Multi-scenario Summarization Evaluat…

200 papers

Recent studies have found that summaries generated by large language models (LLMs) are favored by human annotators over the original reference summaries in commonly used summarization datasets. Therefore, we study an LLM-as-reference…

Computation and Language · Computer Science 2024-07-19 Yixin Liu , Kejian Shi , Katherine S He , Longtian Ye , Alexander R. Fabbri , Pengfei Liu , Dragomir Radev , Arman Cohan

While the NLP community has produced numerous summarization benchmarks, none provide the rich annotations required to simultaneously address many important problems related to control and reliability. We introduce a Wikipedia-derived…

Computation and Language · Computer Science 2023-12-05 Kundan Krishna , Prakhar Gupta , Sanjana Ramprasad , Byron C. Wallace , Jeffrey P. Bigham , Zachary C. Lipton

Automatic video summarization is still an unsolved problem due to several challenges. We take steps towards making automatic video summarization more realistic by addressing them. Firstly, the currently available datasets either have very…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Vishal Kaushal , Suraj Kothawade , Rishabh Iyer , Ganesh Ramakrishnan

Since the amount of information on the internet is growing rapidly, it is not easy for a user to find relevant information for his/her query. To tackle this issue, much attention has been paid to Automatic Document Summarization. The key…

Computation and Language · Computer Science 2019-02-05 Kamal Al-Sabahi , Zhang Zuping , Yang Kang

The core challenge faced by multi-document summarization is the complexity of relationships among documents and the presence of information redundancy. Graph clustering is an effective paradigm for addressing this issue, as it models the…

Computation and Language · Computer Science 2025-08-01 Yongbing Zhang , Fang Nan , Shengxiang Gao , Yuxin Huang , Kaiwen Tan , Zhengtao Yu

With more and more advanced data analysis techniques emerging, people will expect these techniques to be applied in more complex tasks and solve problems in our daily lives. Text Summarization is one of famous applications in Natural…

Computation and Language · Computer Science 2024-02-13 Chen Jia-Chen , Guillem Senabre , Allane Caron

We present CrossSum, a large-scale cross-lingual summarization dataset comprising 1.68 million article-summary samples in 1,500+ language pairs. We create CrossSum by aligning parallel articles written in different languages via…

Computation and Language · Computer Science 2023-05-29 Abhik Bhattacharjee , Tahmid Hasan , Wasi Uddin Ahmad , Yuan-Fang Li , Yong-Bin Kang , Rifat Shahriyar

We develop an abstractive summarization framework independent of labeled data for multiple heterogeneous documents. Unlike existing multi-document summarization methods, our framework processes documents telling different stories instead of…

Computation and Language · Computer Science 2022-05-03 Ning Wang , Han Liu , Diego Klabjan

Unsupervised summarization is a powerful technique that enables training summarizing models without requiring labeled datasets. This survey covers different recent techniques and models used for unsupervised summarization. We cover…

Computation and Language · Computer Science 2024-09-27 Mohammad Khosravani , Amine Trabelsi

Multi-document summarization is the process of automatically generating a concise summary of multiple documents related to the same topic. This summary can help users quickly understand the key information from a large collection of…

Computation and Language · Computer Science 2023-12-20 Charles Rajan , Nishit Asnani , Shreya Singh

Multimodal summarization integrating information from diverse data modalities presents a promising solution to aid the understanding of information within various processes. However, the application and advantages of multimodal…

Software Engineering · Computer Science 2025-03-07 Nenad Petrovic , Yurui Zhang , Moaad Maaroufi , Kuo-Yi Chao , Lukasz Mazur , Fengjunjie Pan , Vahid Zolfaghari , Alois Knoll

Despite the successes of language models, their evaluation remains a daunting challenge for new and existing tasks. We consider the task of text simplification, commonly used to improve information accessibility, where evaluation faces two…

Computation and Language · Computer Science 2025-04-17 Joseph Liu , Yoonsoo Nam , Xinyue Cui , Swabha Swayamdipta

Existing works typically focus on presentation generation under isolated input settings, whereas real-world use cases span diverse scenarios, including vague user prompts, long documents, multimodal materials, and multiple heterogeneous…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Bo Zhao , Maosheng Pang , Chen Zhang , Huan Yang , Yixin Cao , Wei Ji

The availability of large-scale datasets has driven the development of neural models that create summaries from single documents, for generic purposes. When using a summarization system, users often have specific intents with various…

Computation and Language · Computer Science 2021-06-02 Yumo Xu , Mirella Lapata

With the development of Semantic Web, entity summarization has become an emerging task to generate concrete summaries for real world entities. To solve this problem, we propose an approach named MPSUM that extends a probabilistic topic…

Information Retrieval · Computer Science 2020-05-26 Dongjun Wei , Shiyuan Gao , Yaxin Liu , Zhibing Liu , Longtao Hang

Summarizing texts is not a straightforward task. Before even considering text summarization, one should determine what kind of summary is expected. How much should the information be compressed? Is it relevant to reformulate or should the…

Computation and Language · Computer Science 2020-07-16 Paul Tardy , David Janiszek , Yannick Estève , Vincent Nguyen

Effective summarisation evaluation metrics enable researchers and practitioners to compare different summarisation systems efficiently. Estimating the effectiveness of an automatic evaluation metric, termed meta-evaluation, is a critically…

Computation and Language · Computer Science 2024-10-01 Xiang Dai , Sarvnaz Karimi , Biaoyan Fang

Video summarization is a technique to create a short skim of the original video while preserving the main stories/content. There exists a substantial interest in automatizing this process due to the rapid growth of the available material.…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Mayu Otani , Yuta Nakashima , Esa Rahtu , Janne Heikkilä

The quality of meeting summaries generated by natural language generation (NLG) systems is hard to measure automatically. Established metrics such as ROUGE and BERTScore have a relatively low correlation with human judgments and fail to…

Computation and Language · Computer Science 2025-02-19 Frederic Kirstein , Terry Ruas , Bela Gipp

Context engineering has emerged as a pivotal paradigm for unlocking the potential of Large Language Models (LLMs) in Software Engineering (SE) tasks, enabling performance gains at test time without model fine-tuning. Despite its success,…

Software Engineering · Computer Science 2026-04-07 Haichuan Hu , Quanjun Zhang , Ye Shang , Guoqing Xie , Chunrong Fang , Zhenyu Chen , Liang Xiao