English
Related papers

Related papers: Summarizing Videos with Attention

200 papers

Recent years have witnessed a resurgence of interest in video summarization. However, one of the main obstacles to the research on video summarization is the user subjectivity - users have various preferences over the summaries. The…

Computer Vision and Pattern Recognition · Computer Science 2017-07-18 Aidean Sharghi , Jacob S. Laurel , Boqing Gong

In this paper, we address the problem of unsupervised video summarization that automatically extracts key-shots from an input video. Specifically, we tackle two critical issues based on our empirical observations: (i) Ineffective feature…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Yunjae Jung , Donghyeon Cho , Dahun Kim , Sanghyun Woo , In So Kweon

Video Captioning and Summarization have become very popular in the recent years due to advancements in Sequence Modelling, with the resurgence of Long-Short Term Memory networks (LSTMs) and introduction of Gated Recurrent Units (GRUs).…

Computer Vision and Pattern Recognition · Computer Science 2019-06-10 Manjot Bilkhu , Siyang Wang , Tushar Dobhal

This paper proposes an efficient video summarization framework that will give a gist of the entire video in a few key-frames or video skims. Existing video summarization frameworks are based on algorithms that utilize computer vision…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Sai Sukruth Bezugam , Swatilekha Majumdar , Chetan Ralekar , Tapan Kumar Gandhi

This paper proposes a novel lightweight thumbnail container-based summarization (LTC-SUM) framework for full feature-length videos. This framework generates a personalized keyshot summary for concurrent users by using the computational…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Ghulam Mujtaba , Adeel Malik , Eun-Seok Ryu

We propose a soft attention based model for the task of action recognition in videos. We use multi-layered Recurrent Neural Networks (RNNs) with Long Short-Term Memory (LSTM) units which are deep both spatially and temporally. Our model…

Machine Learning · Computer Science 2016-02-16 Shikhar Sharma , Ryan Kiros , Ruslan Salakhutdinov

Video summarization aims at generating concise video summaries from the lengthy videos, to achieve better user watching experience. Due to the subjectivity, purely supervised methods for video summarization may bring the inherent errors…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Tianyu Liu

Vision-Language Models (VLMs) are able to process increasingly longer videos. Yet, important visual information is easily lost throughout the entire context and missed by VLMs. Also, it is important to design tools that enable…

Computation and Language · Computer Science 2026-01-09 Galann Pennec , Zhengyuan Liu , Nicholas Asher , Philippe Muller , Nancy F. Chen

Video summarization aims to distill the most important information from a source video to produce either an abridged clip or a textual narrative. Traditionally, different methods have been proposed depending on whether the output is a video…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Jingyang Lin , Hang Hua , Ming Chen , Yikang Li , Jenhao Hsiao , Chiuman Ho , Jiebo Luo

Modern video summarization methods are based on deep neural networks that require a large amount of annotated data for training. However, existing datasets for video summarization are small-scale, easily leading to over-fitting of the deep…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Li Haopeng , Ke Qiuhong , Gong Mingming , Tom Drummond

Previous approaches for video summarization mainly concentrate on finding the most diverse and representative visual contents as video summary without considering the user's preference. This paper addresses the task of query-focused video…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Shuwen Xiao , Zhou Zhao , Zijian Zhang , Xiaohui Yan , Min Yang

Automatic keyframe detection from videos is an exercise in selecting scenes that can best summarize the content for long videos. Providing a summary of the video is an important task to facilitate quick browsing and content summarization.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Samed Arslan , Senem Tanberk

The quadratic time and memory complexity of the attention mechanism in modern Transformer based video generators makes end-to-end training for ultra high resolution videos prohibitively expensive. Motivated by this limitation, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Yunfeng Wu , Jiayi Song , Zhenxiong Tan , Zihao He , Songhua Liu

Video summarization methods are usually classified into shot-level or frame-level methods, which are individually used in a general way. This paper investigates the underlying complementarity between the frame-level and shot-level methods,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Yubo An , Shenghui Zhao , Guoqiang Zhang

Most existing video summarisation methods are based on either supervised or unsupervised learning. In this paper, we propose a reinforcement learning-based weakly supervised method that exploits easy-to-obtain, video-level category labels…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Kaiyang Zhou , Tao Xiang , Andrea Cavallaro

Video summarization is a crucial research area that aims to efficiently browse and retrieve relevant information from the vast amount of video content available today. With the exponential growth of multimedia data, the ability to extract…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Hai-Dang Huynh-Lam , Ngoc-Phuong Ho-Thi , Minh-Triet Tran , Trung-Nghia Le

Video is one of the robust sources of information and the consumption of online and offline videos has reached an unprecedented level in the last few years. A fundamental challenge of extracting information from videos is a viewer has to go…

Information Retrieval · Computer Science 2020-11-17 Shruti Jadon , Mahmood Jasim

This paper proposes an automatic subtitle generation and semantic video summarization technique. The importance of automatic video summarization is vast in the present era of big data. Video summarization helps in efficient storage and also…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 VB Aswin , Mohammed Javed , Parag Parihar , K Aswanth , CR Druval , Anpam Dagar , CV Aravinda

Current video summarization methods rely heavily on supervised computer vision techniques, which demands time-consuming and subjective manual annotations. To overcome these limitations, we investigated self-supervised video summarization.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Tomoya Sugihara , Shuntaro Masuda , Ling Xiao , Toshihiko Yamasaki

YouTube users looking for instructions for a specific task may spend a long time browsing content trying to find the right video that matches their needs. Creating a visual summary (abridged version of a video) provides viewers with a quick…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Medhini Narasimhan , Arsha Nagrani , Chen Sun , Michael Rubinstein , Trevor Darrell , Anna Rohrbach , Cordelia Schmid