English
Related papers

Related papers: Unsupervised Transcript-assisted Video Summarizati…

200 papers

Current video summarization methods rely heavily on supervised computer vision techniques, which demands time-consuming and subjective manual annotations. To overcome these limitations, we investigated self-supervised video summarization.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Tomoya Sugihara , Shuntaro Masuda , Ling Xiao , Toshihiko Yamasaki

Video summarization has unprecedented importance to help us digest, browse, and search today's ever-growing video collections. We propose a novel subset selection technique that leverages supervision in the form of human-created summaries…

Computer Vision and Pattern Recognition · Computer Science 2016-05-02 Ke Zhang , Wei-Lun Chao , Fei Sha , Kristen Grauman

The rapid growth of video content across domains such as surveillance, education, and social media has made efficient content understanding increasingly critical. Video summarization addresses this challenge by generating concise yet…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Pritam Mishra , Coloma Ballester , Dimosthenis Karatzas

Video summarization is among challenging tasks in computer vision, which aims at identifying highlight frames or shots over a lengthy video input. In this paper, we propose an novel attention-based framework for video summarization with…

Computer Vision and Pattern Recognition · Computer Science 2020-06-04 Yen-Ting Liu , Yu-Jhe Li , Yu-Chiang Frank Wang

Video summarization aims to extract keyframes/shots from a long video. Previous methods mainly take diversity and representativeness of generated summaries as prior knowledge in algorithm design. In this paper, we formulate video…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Yudong Jiang , Kaixu Cui , Bo Peng , Changliang Xu

Video moment retrieval aims to localize the target moment in an video according to the given sentence. The weak-supervised setting only provides the video-level sentence annotations during training. Most existing weak-supervised methods…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Zhu Zhang , Zhijie Lin , Zhou Zhao , Jieming Zhu , Xiuqiang He

Current video retrieval systems, especially those used in competitions, primarily focus on querying individual keyframes or images rather than encoding an entire clip or video segment. However, queries often describe an action or event over…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Quoc-Bao Nguyen-Le , Thanh-Huy Le-Nguyen

Vision-Language Models (VLMs) are able to process increasingly longer videos. Yet, important visual information is easily lost throughout the entire context and missed by VLMs. Also, it is important to design tools that enable…

Computation and Language · Computer Science 2026-01-09 Galann Pennec , Zhengyuan Liu , Nicholas Asher , Philippe Muller , Nancy F. Chen

Most traditional video summarization methods are designed to generate effective summaries for single-view videos, and thus they cannot fully exploit the complicated intra and inter-view correlations in summarizing multi-view videos in a…

Computer Vision and Pattern Recognition · Computer Science 2017-06-13 Rameswar Panda , Amit K. Roy-Chowdhury

Multimodal abstractive summarization for videos (MAS) requires generating a concise textual summary to describe the highlights of a video according to multimodal resources, in our case, the video content and its transcript. Inspired by the…

Computation and Language · Computer Science 2023-05-09 Zenan Xu , Xiaojun Meng , Yasheng Wang , Qinliang Su , Zexuan Qiu , Xin Jiang , Qun Liu

With the growing popularity of short-form video sharing platforms such as \em{Instagram} and \em{Vine}, there has been an increasing need for techniques that automatically extract highlights from video. Whereas prior works have approached…

Computer Vision and Pattern Recognition · Computer Science 2015-10-07 Huan Yang , Baoyuan Wang , Stephen Lin , David Wipf , Minyi Guo , Baining Guo

Among numerous videos shared on the web, well-edited ones always attract more attention. However, it is difficult for inexperienced users to make well-edited videos because it requires professional expertise and immense manual labor. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Yu Xiong , Fabian Caba Heilbron , Dahua Lin

This paper addresses the problem of video summarization. Given an input video, the goal is to select a subset of the frames to create a summary video that optimally captures the important information of the input video. With the large…

Computer Vision and Pattern Recognition · Computer Science 2018-09-03 Mrigank Rochan , Linwei Ye , Yang Wang

In this paper, we propose an integrated framework for multi-granular explanation of video summarization. This framework integrates methods for producing explanations both at the fragment level (indicating which video fragments influenced…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Konstantinos Tsigos , Evlampios Apostolidis , Vasileios Mezaris

The exponential increase in video content poses significant challenges in terms of efficient navigation, search, and retrieval, thus requiring advanced video summarization techniques. Existing video summarization methods, which heavily rely…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Min Jung Lee , Dayoung Gong , Minsu Cho

Long-form video content constitutes a significant portion of internet traffic, making automated video summarization an essential research problem. However, existing video summarization datasets are notably limited in their size,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Dawit Mureja Argaw , Seunghyun Yoon , Fabian Caba Heilbron , Hanieh Deilamsalehy , Trung Bui , Zhaowen Wang , Franck Dernoncourt , Joon Son Chung

Video summarisation can be posed as the task of extracting important parts of a video in order to create an informative summary of what occurred in the video. In this paper we introduce SummaryNet as a supervised learning framework for…

Computer Vision and Pattern Recognition · Computer Science 2020-02-24 Ziyad Jappie , David Torpey , Turgay Celik

Conventional video summarization approaches based on reinforcement learning have the problem that the reward can only be received after the whole summary is generated. Such kind of reward is sparse and it makes reinforcement learning hard…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Yiyan Chen , Li Tao , Xueting Wang , Toshihiko Yamasaki

Video summarization aims at choosing parts of a video that narrate a story as close as possible to the original one. Most of the existing video summarization approaches focus on hand-crafted labels. As the number of videos grows…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Ivan Sosnovik , Artem Moskalev , Cees Kaandorp , Arnold Smeulders

Although video summarization has achieved tremendous success benefiting from Recurrent Neural Networks (RNN), RNN-based methods neglect the global dependencies and multi-hop relationships among video frames, which limits the performance.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-23 Bin Zhao , Maoguo Gong , Xuelong Li