English
Related papers

Related papers: SummDiff: Generative Modeling of Video Summarizati…

200 papers

With the broad growth of video capturing devices and applications on the web, it is more demanding to provide desired video content for users efficiently. Video summarization facilitates quickly grasping video content by creating a compact…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Mayu Otani , Yale Song , Yang Wang

Advertisers commonly need multiple versions of the same advertisement (ad) at varying durations for a single campaign. The traditional approach involves manually selecting and re-editing shots from longer video ads to create shorter…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Wen Xie , Yanjun Zhu , Gijs Overgoor , Yakov Bart , Agata Lapedriza Garcia , Sarah Ostadabbas

Multimodal summarization with multimodal output (MSMO) has emerged as a promising research direction. Nonetheless, numerous limitations exist within existing public MSMO datasets, including insufficient maintenance, data inaccessibility,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Jielin Qiu , Jiacheng Zhu , William Han , Aditesh Kumar , Karthik Mittal , Claire Jin , Zhengyuan Yang , Linjie Li , Jianfeng Wang , Ding Zhao , Bo Li , Lijuan Wang

Video summarization aims to distill the most important information from a source video to produce either an abridged clip or a textual narrative. Traditionally, different methods have been proposed depending on whether the output is a video…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Jingyang Lin , Hang Hua , Ming Chen , Yikang Li , Jenhao Hsiao , Chiuman Ho , Jiebo Luo

Video summarization aims to produce a compact representation of a long video by selecting a subset of temporally important segments that best reflect human preferences. This task is inherently difficult due to strong annotation subjectivity…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Omer Tariq , Syed Muhammad Raza , Jeongbae Son

The goal of video summarization is to automatically shorten videos such that it conveys the overall story without losing relevant information. In many application scenarios, improper video summarization can have a large impact. For example…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Jia-Hong Huang , Chao-Han Huck Yang , Pin-Yu Chen , Min-Hung Chen , Marcel Worring

The rapid proliferation of online video content necessitates effective video summarization techniques. Traditional methods, often relying on a single modality (typically visual), struggle to capture the full semantic richness of videos.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Shuo wang , Jihao Zhang

Video summarization aims to facilitate large-scale video browsing by producing short, concise summaries that are diverse and representative of original videos. In this paper, we formulate video summarization as a sequential decision-making…

Computer Vision and Pattern Recognition · Computer Science 2018-02-15 Kaiyang Zhou , Yu Qiao , Tao Xiang

Recent years have witnessed a resurgence of interest in video summarization. However, one of the main obstacles to the research on video summarization is the user subjectivity - users have various preferences over the summaries. The…

Computer Vision and Pattern Recognition · Computer Science 2017-07-18 Aidean Sharghi , Jacob S. Laurel , Boqing Gong

Modern video codecs and learning-based approaches struggle for semantic reconstruction at extremely low bit-rates due to reliance on low-level spatiotemporal redundancies. Generative models, especially diffusion models, offer a new paradigm…

Image and Video Processing · Electrical Eng. & Systems 2026-02-06 Maojun Zhang , Haotian Wu , Richeng Jin , Deniz Gunduz , Krystian Mikolajczyk

This paper presents a video summarization technique for an Internet video to provide a quick way to overview its content. This is a challenging problem because finding important or informative parts of the original video requires to…

Computer Vision and Pattern Recognition · Computer Science 2016-09-29 Mayu Otani , Yuta Nakashima , Esa Rahtu , Janne Heikkilä , Naokazu Yokoya

Generating temporally coherent high fidelity video is an important milestone in generative modeling research. We make progress towards this milestone by proposing a diffusion model for video generation that shows very promising initial…

Computer Vision and Pattern Recognition · Computer Science 2022-06-24 Jonathan Ho , Tim Salimans , Alexey Gritsenko , William Chan , Mohammad Norouzi , David J. Fleet

A generic video summary is an abridged version of a video that conveys the whole story and features the most important scenes. Yet the importance of scenes in a video is often subjective, and users should have the option of customizing the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-09 Medhini Narasimhan , Anna Rohrbach , Trevor Darrell

We consider the problem of video summarization. Given an input raw video, the goal is to select a small subset of key frames from the input video to create a shorter summary video that best describes the content of the original video. Most…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Mrigank Rochan , Yang Wang

We propose a graph-based representation learning framework for video summarization. First, we convert an input video to a graph where nodes correspond to each of the video frames. Then, we impose sparsity on the graph by connecting only…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Jose M. Rojas Chaves , Subarna Tripathi

The rapid expansion of video content across a variety of industries, including social media, education, entertainment, and surveillance, has made video summarization an essential field of study. The current work is a survey that explores…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Toqa Alaa , Ahmad Mongy , Assem Bakr , Mariam Diab , Walid Gomaa

To automatically produce a brief yet expressive summary of a long video, an automatic algorithm should start by resembling the human process of summary generation. Prior work proposed supervised and unsupervised algorithms to train models…

Computer Vision and Pattern Recognition · Computer Science 2019-03-04 Mohamed Elfeki , Ali Borji

Video summarization creates an abridged version (i.e., a summary) that provides a quick overview of the video while retaining pertinent information. In this work, we focus on summarizing instructional videos and propose a method for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Apoorva Beedu , Irfan Essa

It is now much easier than ever before to produce videos. While the ubiquitous video data is a great source for information discovery and extraction, the computational challenges are unparalleled. Automatically summarizing the videos has…

Machine Learning · Computer Science 2018-10-26 Aidean Sharghi , Ali Borji , Chengtao Li , Tianbao Yang , Boqing Gong

While most existing video summarization approaches aim to extract an informative summary of a single video, we propose a novel framework for summarizing multi-view videos by exploiting both intra- and inter-view content correlations in a…

Computer Vision and Pattern Recognition · Computer Science 2016-08-02 Rameswar Panda , Abir Das , Amit K. Roy-Chowdhury