English
Related papers

Related papers: Scaling Up Video Summarization Pretraining with La…

200 papers

Most of the existing methods for video understanding primarily focus on videos only lasting tens of seconds, with limited exploration of techniques for handling long videos. The increased number of frames in long videos poses two main…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Ziyu Ma , Chenhui Gou , Hengcan Shi , Bin Sun , Shutao Li , Hamid Rezatofighi , Jianfei Cai

Large language models (LLMs) have been well-researched in various long-context tasks. However, the scarcity of long-context summarization datasets hinders progress in this area. To address this, we introduce CNNSum, a multi-scale…

Computation and Language · Computer Science 2025-06-03 Lingxiao Wei , He Yan , Xiangju Lu , Junmin Zhu , Jun Wang , Wei Zhang

Video summarization is among challenging tasks in computer vision, which aims at identifying highlight frames or shots over a lengthy video input. In this paper, we propose an novel attention-based framework for video summarization with…

Computer Vision and Pattern Recognition · Computer Science 2020-06-04 Yen-Ting Liu , Yu-Jhe Li , Yu-Chiang Frank Wang

Training multimodal large language models (MLLMs) for video understanding requires large-scale annotated data spanning diverse tasks such as object counting, question answering, and segmentation. However, collecting and annotating…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Tanzila Rahman , Renjie Liao , Leonid Sigal

Despite advances in Large Multi-modal Models, applying them to long and untrimmed video content remains challenging due to limitations in context length and substantial memory overhead. These constraints often lead to significant…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Junho Kim , Hyunjun Kim , Hosu Lee , Yong Man Ro

Text summarization is crucial for mitigating information overload across domains like journalism, medicine, and business. This research evaluates summarization performance across 17 large language models (OpenAI, Google, Anthropic,…

Computation and Language · Computer Science 2025-04-08 Anantharaman Janakiraman , Behnaz Ghoraani

Recent pre-trained language models (PLMs) achieve promising results in existing abstractive summarization datasets. However, existing summarization benchmarks overlap in time with the standard pre-training corpora and finetuning datasets.…

Computation and Language · Computer Science 2023-11-03 Chi Seng Cheang , Hou Pong Chan , Derek F. Wong , Xuebo Liu , Zhaocong Li , Yanming Sun , Shudong Liu , Lidia S. Chao

Summarization is one of the key features of human intelligence. It plays an important role in understanding and representation. With rapid and continual expansion of texts, pictures and videos in cyberspace, automatic summarization becomes…

Computation and Language · Computer Science 2015-07-02 Hai Zhuge

Recent advances in vision-language models have led to impressive progress in caption generation for images and short video clips. However, these models remain constrained by their limited temporal receptive fields, making it difficult to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Sanghyeok Chu , Seonguk Seo , Bohyung Han

Pre-trained vision-language models (VLMs) have enabled significant progress in open vocabulary computer vision tasks such as image classification, object detection and image segmentation. Some recent works have focused on extending VLMs to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Rohit Gupta , Mamshad Nayeem Rizve , Jayakrishnan Unnikrishnan , Ashish Tawari , Son Tran , Mubarak Shah , Benjamin Yao , Trishul Chilimbi

Recent progress in large language models (LLMs) has enabled the automated processing of lengthy documents even without supervised training on a task-specific dataset. Yet, their zero-shot performance in complex tasks as opposed to…

Computation and Language · Computer Science 2025-11-12 WonJin Yoon , Boyu Ren , Spencer Thomas , Chanhwi Kim , Guergana Savova , Mei-Hua Hall , Timothy Miller

Large language model (LLM) approaches to tabular summarization rely on extensive prompt engineering, decomposition pipelines, or entity-level intermediate representations to achieve strong performance. While effective, these strategies are…

Computation and Language · Computer Science 2026-03-24 Ritam Upadhyay , Naman Ahuja , Rishabh Baral , Aparna Garimella , Vivek Gupta

Multi-turn dialogues are characterized by their extended length and the presence of turn-taking conversations. Traditional language models often overlook the distinct features of these dialogues by treating them as regular text. In this…

Computation and Language · Computer Science 2024-02-01 Sangwoo Cho , Kaiqiang Song , Chao Zhao , Xiaoyang Wang , Dong Yu

This paper introduces QCaption, a novel video captioning and Q&A pipeline that enhances video analytics by fusing three models: key frame extraction, a Large Multimodal Model (LMM) for image-text analysis, and a Large Language Model (LLM)…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Jiale Wang , Gee Wah Ng , Lee Onn Mak , Randall Cher , Ng Ding Hei Ryan , Davis Wang

Generating unbiased summaries in real-world settings such as political perspective summarization remains a crucial application of Large Language Models (LLMs). Yet, existing evaluation frameworks rely on traditional metrics for measuring…

Computation and Language · Computer Science 2025-06-23 Narutatsu Ri , Nicholas Deas , Kathleen McKeown

Recent advances in Large Language Models (LLMs) have enabled the development of Video-LLMs, advancing multimodal learning by bridging video data with language tasks. However, current video understanding models struggle with processing long…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Haomiao Xiong , Zongxin Yang , Jiazuo Yu , Yunzhi Zhuge , Lu Zhang , Jiawen Zhu , Huchuan Lu

Driven by the wave of large language models, Video-Language Models (VLMs) have become a significant yet challenging technology to bridge the gap between videos and texts. Although previous VLM works have made significant progress, almost…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Xiang Fang , Wanlong Fang , Changshuo Wang , Xiaoye Qu , Daizong Liu

Automating code documentation through explanatory text can prove highly beneficial in code understanding. Large Language Models (LLMs) have made remarkable strides in Natural Language Processing, especially within software engineering tasks…

In this work, we introduce the task of script-driven video summarization, which aims to produce a summary of the full-length video by selecting the parts that are most relevant to a user-provided script outlining the visual content of the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Manolis Mylonas , Evlampios Apostolidis , Vasileios Mezaris

Recent advances in audio-language models have demonstrated remarkable success on short, segment-level speech tasks. However, real-world applications such as meeting transcription, spoken document understanding, and conversational analysis…