中文
相关论文

相关论文: GUMSum: Multi-Genre Data and Evaluation for Englis…

200 篇论文

How well can large language models (LLMs) generate summaries? We develop new datasets and conduct human evaluation experiments to evaluate the zero-shot generation capability of LLMs across five distinct summarization tasks. Our findings…

计算与语言 · 计算机科学 2023-09-19 Xiao Pu , Mingqi Gao , Xiaojun Wan

People from different social and demographic groups express diverse perspectives and conflicting opinions on a broad set of topics such as product reviews, healthcare, law, and politics. A fair summary should provide a comprehensive…

Large language models (LLMs) have shown promise for automatic summarization but the reasons behind their successes are poorly understood. By conducting a human evaluation on ten LLMs across different pretraining methods, prompts, and model…

计算与语言 · 计算机科学 2023-02-01 Tianyi Zhang , Faisal Ladhak , Esin Durmus , Percy Liang , Kathleen McKeown , Tatsunori B. Hashimoto

While large language models (LLMs) can already achieve strong performance on standard generic summarization benchmarks, their performance on more complex summarization task settings is less studied. Therefore, we benchmark LLMs on…

We explore the need for more comprehensive and precise evaluation techniques for generative artificial intelligence (GenAI) in text summarization tasks, specifically in the area of opinion summarization. Traditional methods, which leverage…

计算与语言 · 计算机科学 2026-02-10 Leandro Anghinoni , Jorge Sanchez

Prompt tuning (PT), a parameter-efficient technique that only tunes the additional prompt embeddings while keeping the backbone pre-trained language model (PLM) frozen, has shown promising results in language understanding tasks, especially…

计算与语言 · 计算机科学 2023-08-08 Mathieu Ravaut , Hailin Chen , Ruochen Zhao , Chengwei Qin , Shafiq Joty , Nancy Chen

While the reasoning capabilities of Large Language Models (LLMs) excel in analytical tasks such as mathematics and code generation, their utility for abstractive summarization remains widely assumed but largely unverified. To bridge this…

计算与语言 · 计算机科学 2025-12-10 Haohan Yuan , Haopeng Zhang

Large Language Models (LLMs) like the GPT and LLaMA families have demonstrated exceptional capabilities in capturing and condensing critical contextual information and achieving state-of-the-art performance in the summarization task.…

计算与语言 · 计算机科学 2023-11-06 Prakamya Mishra , Zonghai Yao , Shuwei Chen , Beining Wang , Rohan Mittal , Hong Yu

Determining and ranking the most salient entities in a text is critical for user-facing systems, especially as users increasingly rely on models to interpret long documents they only partially read. Graded entity salience addresses this…

计算与语言 · 计算机科学 2025-06-02 Jessica Lin , Amir Zeldes

Abstractive dialogue summarization is the task of distilling conversations into informative and concise summaries. Although reviews have been conducted on this topic, there is a lack of comprehensive work detailing the challenges of…

计算与语言 · 计算机科学 2025-04-25 Frederic Kirstein , Jan Philip Wahle , Bela Gipp , Terry Ruas

Contemporary works on abstractive text summarization have focused primarily on high-resource languages like English, mostly due to the limited availability of datasets for low/mid-resource ones. In this work, we present XL-Sum, a…

Large language models have shown impressive performance across a wide variety of tasks, including text summarization. In this paper, we show that this strong performance extends to opinion summarization. We explore several pipeline methods…

计算与语言 · 计算机科学 2023-05-24 Adithya Bhaskar , Alexander R. Fabbri , Greg Durrett

Text summarizing is a critical Natural Language Processing (NLP) task with applications ranging from information retrieval to content generation. Large Language Models (LLMs) have shown remarkable promise in generating fluent abstractive…

计算与语言 · 计算机科学 2025-03-03 Colleen Gilhuly , Haleh Shahzad

Evaluating text summarization has been a challenging task in natural language processing (NLP). Automatic metrics which heavily rely on reference summaries are not suitable in many situations, while human evaluation is time-consuming and…

计算与语言 · 计算机科学 2024-07-02 Huyen Nguyen , Haihua Chen , Lavanya Pobbathi , Junhua Ding

Most existing cross-lingual summarization (CLS) work constructs CLS corpora by simply and directly translating pre-annotated summaries from one language to another, which can contain errors from both summarization and translation processes.…

计算与语言 · 计算机科学 2023-07-11 Yulong Chen , Huajian Zhang , Yijie Zhou , Xuefeng Bai , Yueguan Wang , Ming Zhong , Jianhao Yan , Yafu Li , Judy Li , Michael Zhu , Yue Zhang

Cross-lingual science journalism generates popular science stories of scientific articles different from the source language for a non-expert audience. Hence, a cross-lingual popular summary must contain the salient content of the input…

计算与语言 · 计算机科学 2023-04-05 Mehwish Fatima , Tim Kolber , Katja Markert , Michael Strube

With the rising human-like precision of Large Language Models (LLMs) in numerous tasks, their utilization in a variety of real-world applications is becoming more prevalent. Several studies have shown that LLMs excel on many standard NLP…

计算与语言 · 计算机科学 2024-04-03 Rishav Hada , Varun Gumma , Mohamed Ahmed , Kalika Bali , Sunayana Sitaram

News summarization in today's global scene can be daunting with its flood of multilingual content and varied viewpoints from different sources. However, current studies often neglect such real-world scenarios as they tend to focus solely on…

计算与语言 · 计算机科学 2024-10-08 Yangfan Ye , Xiachong Feng , Xiaocheng Feng , Weitao Ma , Libo Qin , Dongliang Xu , Qing Yang , Hongtao Liu , Bing Qin

Automatic chart to text summarization is an effective tool for the visually impaired people along with providing precise insights of tabular data in natural language to the user. A large and well-structured dataset is always a key part for…

It is well known that the standard likelihood training and approximate decoding objectives in neural text generation models lead to less human-like responses for open-ended tasks such as language modeling and story generation. In this paper…

计算与语言 · 计算机科学 2020-05-05 Joshua Maynez , Shashi Narayan , Bernd Bohnet , Ryan McDonald