English
Related papers

Related papers: CNNSum: Exploring Long-Context Summarization with …

200 papers

Large Language Models (LLMs) have demonstrated remarkable performance across diverse tasks but are constrained by their small context window sizes. Various efforts have been proposed to expand the context window to accommodate even up to…

Computation and Language · Computer Science 2024-04-09 Xuanfan Ni , Hengyi Cai , Xiaochi Wei , Shuaiqiang Wang , Dawei Yin , Piji Li

Long video summarization presents significant challenges for current multimodal large language models (MLLMs), particularly in maintaining temporal fidelity over extended durations and producing summaries that are both semantically and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Alkesh Patel , Melis Ozyildirim , Ying-Chang Cheng , Ganesh Nagarajan

The advent of Large Language Models (LLMs) represents a notable breakthrough in Natural Language Processing (NLP), contributing to substantial progress in both text comprehension and generation. However, amidst these advancements, it is…

Computation and Language · Computer Science 2024-01-17 Saurav Pawar , S. M Towhidul Islam Tonmoy , S M Mehedi Zaman , Vinija Jain , Aman Chadha , Amitava Das

We evaluate recent Large Language Models (LLMs) on the challenging task of summarizing short stories, which can be lengthy, and include nuanced subtext or scrambled timelines. Importantly, we work directly with authors to ensure that the…

Computation and Language · Computer Science 2024-07-15 Melanie Subbiah , Sean Zhang , Lydia B. Chilton , Kathleen McKeown

Obtaining valuable information from massive data efficiently has become our research goal in the era of Big Data. Text summarization technology has been continuously developed to meet this demand. Recent work has also shown that…

Computation and Language · Computer Science 2025-03-10 Yu Zhao , Songping Huang , Dongsheng Zhou , Zhaoyun Ding , Fei Wang , Aixin Nian

As the capabilities of large language models (LLMs) continue to advance, evaluating their performance becomes increasingly crucial and challenging. This paper aims to bridge this gap by introducing CMMLU, a comprehensive Chinese benchmark…

Computation and Language · Computer Science 2024-01-19 Haonan Li , Yixuan Zhang , Fajri Koto , Yifei Yang , Hai Zhao , Yeyun Gong , Nan Duan , Timothy Baldwin

We study the efficacy of fine-tuning Large Language Models (LLMs) for the specific task of report (government archives, news, intelligence reports) summarization. While this topic is being very actively researched - our specific application…

Recent studies have found that summaries generated by large language models (LLMs) are favored by human annotators over the original reference summaries in commonly used summarization datasets. Therefore, we study an LLM-as-reference…

Computation and Language · Computer Science 2024-07-19 Yixin Liu , Kejian Shi , Katherine S He , Longtian Ye , Alexander R. Fabbri , Pengfei Liu , Dragomir Radev , Arman Cohan

Large Language Models (LLMs) exhibit powerful summarization abilities. However, their capabilities on conversational summarization remains under explored. In this work we evaluate LLMs (approx. 10 billion parameters) on conversational…

Computation and Language · Computer Science 2023-12-01 Ramesh Manuvinakurike , Saurav Sahay , Sangeeta Manepalli , Lama Nachman

Online reviews play a pivotal role in influencing consumer decisions across various domains, from purchasing products to selecting hotels or restaurants. However, the sheer volume of reviews -- often containing repetitive or irrelevant…

Computation and Language · Computer Science 2024-10-18 Mir Tafseer Nayeem , Davood Rafiei

Analyzing vast textual data and summarizing key information from electronic health records imposes a substantial burden on how clinicians allocate their time. Although large language models (LLMs) have shown promise in natural language…

Large language models (LLMs) based on Transformer have been widely applied in the filed of natural language processing (NLP), demonstrating strong performance, particularly in handling short text tasks. However, when it comes to long…

Computation and Language · Computer Science 2025-07-09 Yijun Liu , Jinzheng Yu , Yang Xu , Zhongyang Li , Qingfu Zhu

The recent success of Large Language Models (LLMs) has garnered significant attention in both academia and industry. Prior research on LLMs has primarily focused on enhancing or leveraging their generalization capabilities in zero- and…

Computation and Language · Computer Science 2024-04-01 Shulin Liu , Chengcheng Xu , Hao Liu , Tinghao Yu , Tao Yang

Long Context Understanding (LCU) is a critical area for exploration in current large language models (LLMs). However, due to the inherently lengthy nature of long-text data, existing LCU benchmarks for LLMs often result in prohibitively…

Computation and Language · Computer Science 2025-07-31 Zhongzhan Huang , Guoming Ling , Shanshan Zhong , Hefeng Wu , Liang Lin

Large language models (LLMs) have shown strong performance in zero-shot summarization, but often struggle to model document structure and identify salient information in long texts. In this work, we introduce StrucSum, a training-free…

Computation and Language · Computer Science 2026-01-22 Haohan Yuan , Sukhwa Hong , Haopeng Zhang

Large language models (LLMs) with extended context windows enable tasks requiring extensive information integration but are limited by the scarcity of high-quality, diverse datasets for long-context instruction tuning. Existing data…

Computation and Language · Computer Science 2025-02-25 Jiaxi Li , Xingxing Zhang , Xun Wang , Xiaolong Huang , Li Dong , Liang Wang , Si-Qing Chen , Wei Lu , Furu Wei

Curation of literature in life sciences is a growing challenge. The continued increase in the rate of publication, coupled with the relatively fixed number of curators worldwide presents a major challenge to developers of biomedical…

Large language models (LLMs) have revolutionized NLP research. Notably, in-context learning enables their use as evaluation metrics for natural language generation, making them particularly advantageous in low-resource scenarios and…

Computation and Language · Computer Science 2024-11-19 Christoph Leiter , Steffen Eger

Citizen reporting platforms help the public and authorities stay informed about sexual harassment incidents. However, the high volume of data shared on these platforms makes reviewing each individual case challenging. Therefore, a…

Computation and Language · Computer Science 2026-04-20 Garima Chhikara , Anurag Sharma , V. Gurucharan , Kripabandhu Ghosh , Abhijnan Chakraborty

Recent advancements in Large Language Models (LLMs) and Prompt Engineering have made chatbot customization more accessible, significantly reducing barriers to tasks that previously required programming skills. However, prompt evaluation,…

Human-Computer Interaction · Computer Science 2025-08-13 Sam Yu-Te Lee , Aryaman Bahukhandi , Dongyu Liu , Kwan-Liu Ma