English
Related papers

Related papers: SummDiff: Generative Modeling of Video Summarizati…

200 papers

Most traditional video summarization methods are designed to generate effective summaries for single-view videos, and thus they cannot fully exploit the complicated intra and inter-view correlations in summarizing multi-view videos in a…

Computer Vision and Pattern Recognition · Computer Science 2017-06-13 Rameswar Panda , Amit K. Roy-Chowdhury

Video summarization methods are usually classified into shot-level or frame-level methods, which are individually used in a general way. This paper investigates the underlying complementarity between the frame-level and shot-level methods,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Yubo An , Shenghui Zhao , Guoqiang Zhang

As the number of video content has mushroomed in recent years, automatic video summarization has come useful when we want to just peek at the content of the video. However, there are two underlying limitations in generic video summarization…

Machine Learning · Computer Science 2023-01-23 Jeiyoon Park , Kiho Kwoun , Chanhee Lee , Heuiseok Lim

Video summarization, by selecting the most informative and/or user-relevant parts of original videos to create concise summary videos, has high research value and consumer demand in today's video proliferation era. Multi-modal video…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Yaowei Guo , Jiazheng Xing , Xiaojun Hou , Shuo Xin , Juntao Jiang , Demetri Terzopoulos , Chenfanfu Jiang , Yong Liu

This paper proposes a practical multimodal video summarization task setting and a dataset to train and evaluate the task. The target task involves summarizing a given video into a predefined number of keyframe-caption pairs and displaying…

Computation and Language · Computer Science 2023-12-05 Keito Kudo , Haruki Nagasawa , Jun Suzuki , Nobuyuki Shimizu

Video summarization aims to select representative frames to retain high-level information, which is usually solved by predicting the segment-wise importance score via a softmax function. However, softmax function suffers in retaining…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Junyan Wang , Yang Bai , Yang Long , Bingzhang Hu , Zhenhua Chai , Yu Guan , Xiaolin Wei

Diffusion models have achieved significant success in image and video generation. This motivates a growing interest in video editing tasks, where videos are edited according to provided text descriptions. However, most existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Zhen Xing , Qi Dai , Zihao Zhang , Hui Zhang , Han Hu , Zuxuan Wu , Yu-Gang Jiang

When video collections become huge, how to explore both within and across videos efficiently is challenging. Video summarization is one of the ways to tackle this issue. Traditional summarization approaches limit the effectiveness of video…

Information Retrieval · Computer Science 2020-04-09 Jia-Hong Huang , Marcel Worring

Automatic summarization generation of sports video content has been object of great interest for many years. Although semantic descriptions techniques have been proposed, many of the approaches still rely on low-level video descriptors that…

Information Retrieval · Computer Science 2014-11-25 Arnau Raventos , Raul Quijada , Luis Torres , Francesc Tarres

Summarization of multimedia data becomes increasingly significant as it is the basis for many real-world applications, such as question answering, Web search, and so forth. Most existing multi-modal summarization works however have used…

Computation and Language · Computer Science 2020-09-18 Xiyan Fu , Jun Wang , Zhenglu Yang

Video summarization plays an important role in video understanding by selecting key frames/shots. Traditionally, it aims to find the most representative and diverse contents in a video as short summaries. Recently, a more generalized task,…

Computer Vision and Pattern Recognition · Computer Science 2018-07-19 Yujia Zhang , Michael Kampffmeyer , Xiaodan Liang , Min Tan , Eric P. Xing

Current state-of-the-art methods for video inpainting typically rely on optical flow or attention-based approaches to inpaint masked regions by propagating visual information across frames. While such approaches have led to significant…

Opinion summarization is the task of automatically creating summaries that reflect subjective information expressed in multiple documents, such as product reviews. While the majority of previous work has focused on the extractive setting,…

Computation and Language · Computer Science 2020-04-21 Arthur Bražinskas , Mirella Lapata , Ivan Titov

Opinion summarization is the automatic creation of text reflecting subjective information expressed in multiple documents, such as user reviews of a product. The task is practically important and has attracted a lot of attention. However,…

Machine Learning · Computer Science 2020-10-13 Arthur Bražinskas , Mirella Lapata , Ivan Titov

YouTube users looking for instructions for a specific task may spend a long time browsing content trying to find the right video that matches their needs. Creating a visual summary (abridged version of a video) provides viewers with a quick…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Medhini Narasimhan , Arsha Nagrani , Chen Sun , Michael Rubinstein , Trevor Darrell , Anna Rohrbach , Cordelia Schmid

Summarization is one of the key features of human intelligence. It plays an important role in understanding and representation. With rapid and continual expansion of texts, pictures and videos in cyberspace, automatic summarization becomes…

Computation and Language · Computer Science 2015-07-02 Hai Zhuge

In this work, we introduce the task of script-driven video summarization, which aims to produce a summary of the full-length video by selecting the parts that are most relevant to a user-provided script outlining the visual content of the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Manolis Mylonas , Evlampios Apostolidis , Vasileios Mezaris

Automatic video summarization is still an unsolved problem due to several challenges. The currently available datasets either have very short videos or have few long videos of only a particular type. We introduce a new benchmarking video…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Vishal Kaushal , Suraj Kothawade , Anshul Tomar , Rishabh Iyer , Ganesh Ramakrishnan

Multimodal video summarization requires visual features that align semantically with language generation. Traditional approaches rely on CNN features trained for object classification, which represent visual concepts as discrete categories…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Maham Nazir , Muhammad Aqeel , Richong Zhang , Francesco Setti

This paper addresses automatic summarization of videos in a unified manner. In particular, we propose a framework for multi-faceted summarization for extractive, query base and entity summarization (summarization at the level of entities…

Computer Vision and Pattern Recognition · Computer Science 2019-01-07 Vishal Kaushal , Rishabh Iyer , Khoshrav Doctor , Anurag Sahoo , Pratik Dubal , Suraj Kothawade , Rohan Mahadev , Kunal Dargan , Ganesh Ramakrishnan