English
Related papers

Related papers: Query-controllable Video Summarization

200 papers

Video summarization techniques have been proven to improve the overall user experience when it comes to accessing and comprehending video content. If the user's preference is known, video summarization can identify significant information…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Brian Chen , Xiangyuan Zhao , Yingnan Zhu

Generating a concise and informative video summary from a long video is important, yet subjective due to varying scene importance. Users' ability to specify scene importance through text queries enhances the relevance of such summaries.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Nirav Patel , Payal Prajapati , Maitrik Shah

Previous approaches for video summarization mainly concentrate on finding the most diverse and representative visual contents as video summary without considering the user's preference. This paper addresses the task of query-focused video…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Shuwen Xiao , Zhou Zhao , Zijian Zhang , Xiaohui Yan , Min Yang

Summarization of multimedia data becomes increasingly significant as it is the basis for many real-world applications, such as question answering, Web search, and so forth. Most existing multi-modal summarization works however have used…

Computation and Language · Computer Science 2020-09-18 Xiyan Fu , Jun Wang , Zhenglu Yang

Video summarization plays an important role in video understanding by selecting key frames/shots. Traditionally, it aims to find the most representative and diverse contents in a video as short summaries. Recently, a more generalized task,…

Computer Vision and Pattern Recognition · Computer Science 2018-07-19 Yujia Zhang , Michael Kampffmeyer , Xiaodan Liang , Min Tan , Eric P. Xing

Video summarization remains a huge challenge in computer vision due to the size of the input videos to be summarized. We propose an efficient, language-only video summarizer that achieves competitive accuracy with high data efficiency.…

Artificial Intelligence · Computer Science 2023-09-19 Yoonsoo Nam , Adam Lehavi , Daniel Yang , Digbalay Bose , Swabha Swayamdipta , Shrikanth Narayanan

Automatic video summarization is still an unsolved problem due to several challenges. The currently available datasets either have very short videos or have few long videos of only a particular type. We introduce a new benchmarking video…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Vishal Kaushal , Suraj Kothawade , Anshul Tomar , Rishabh Iyer , Ganesh Ramakrishnan

Video transcript summarization is a fundamental task for video understanding. Conventional approaches for transcript summarization are usually built upon the summarization data for written language such as news articles, while the domain…

Computation and Language · Computer Science 2021-07-16 Tengchao Lv , Lei Cui , Momcilo Vasilijevic , Furu Wei

We propose a novel supervised learning technique for summarizing videos by automatically selecting keyframes or key subshots. Casting the problem as a structured prediction problem on sequential data, our main idea is to use Long Short-Term…

Computer Vision and Pattern Recognition · Computer Science 2016-08-01 Ke Zhang , Wei-Lun Chao , Fei Sha , Kristen Grauman

Video summarization aims to facilitate large-scale video browsing by producing short, concise summaries that are diverse and representative of original videos. In this paper, we formulate video summarization as a sequential decision-making…

Computer Vision and Pattern Recognition · Computer Science 2018-02-15 Kaiyang Zhou , Yu Qiao , Tao Xiang

Video summarization aims at generating a compact yet representative visual summary that conveys the essence of the original video. The advantage of unsupervised approaches is that they do not require human annotations to learn the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-27 Hussain Kanafani , Junaid Ahmed Ghauri , Sherzod Hakimov , Ralph Ewerth

Long-form video content constitutes a significant portion of internet traffic, making automated video summarization an essential research problem. However, existing video summarization datasets are notably limited in their size,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Dawit Mureja Argaw , Seunghyun Yoon , Fabian Caba Heilbron , Hanieh Deilamsalehy , Trung Bui , Zhaowen Wang , Franck Dernoncourt , Joon Son Chung

In this paper we present VideoSET, a method for Video Summary Evaluation through Text that can evaluate how well a video summary is able to retain the semantic information contained in its original video. We observe that semantics is most…

Computer Vision and Pattern Recognition · Computer Science 2014-06-24 Serena Yeung , Alireza Fathi , Li Fei-Fei

Compact keyframe-based video summaries are a popular way of generating viewership on video sharing platforms. Yet, creating relevant and compelling summaries for arbitrarily long videos with a small number of keyframes is a challenging…

Computer Vision and Pattern Recognition · Computer Science 2015-02-02 Olivier Morère , Hanlin Goh , Antoine Veillard , Vijay Chandrasekhar , Jie Lin

Video summarization is a task of shortening a video by choosing a subset of frames while preserving its essential moments. Despite the innate subjectivity of the task, previous works have deterministically regressed to an averaged frame…

Machine Learning · Computer Science 2025-10-10 Kwanseok Kim , Jaehoon Hahm , Sumin Kim , Jinhwan Sul , Byunghak Kim , Joonseok Lee

Video summarization aims to select keyframes that are visually diverse and can represent the whole story of a given video. Previous approaches have focused on global interlinkability between frames in a video by temporal modeling. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Jungin Park , Jiyoung Lee , Kwanghoon Sohn

Automatic video summarization is still an unsolved problem due to several challenges. We take steps towards making automatic video summarization more realistic by addressing them. Firstly, the currently available datasets either have very…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Vishal Kaushal , Suraj Kothawade , Rishabh Iyer , Ganesh Ramakrishnan

We present a method for creating video summaries in real-time on commodity hardware. Real-time here refers to the fact that the time required for video summarization is less than the duration of the input video. First, low-level features…

Computer Vision and Pattern Recognition · Computer Science 2019-01-29 Wesley Taylor , Faisal Z. Qureshi

In this work, we present a method and two large-scale datasets for Script-Driven Multimodal Video Summarization. The proposed method, SD-MVSum, builds on our earlier SD-VSum method for script-driven video summarization, which considered…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Manolis Mylonas , Charalampia Zerva , Evlampios Apostolidis , Vasileios Mezaris

The recent growth of web video sharing platforms has increased the demand for systems that can efficiently browse, retrieve and summarize video content. Query-aware multi-video summarization is a promising technique that caters to this…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Safa Messaoud , Ismini Lourentzou , Assma Boughoula , Mona Zehni , Zhizhen Zhao , Chengxiang Zhai , Alexander G. Schwing