English
Related papers

Related papers: Compare and Select: Video Summarization with Multi…

200 papers

Video summarization aims to automatically generate a diverse and concise summary which is useful in large-scale video processing. Most of the methods tend to adopt self-attention mechanism across video frames, which fails to model the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yingchao Pan , Ouhan Huang , Qinghao Ye , Zhongjin Li , Wenjiang Wang , Guodun Li , Yuxing Chen

We consider the problem of video summarization. Given an input raw video, the goal is to select a small subset of key frames from the input video to create a shorter summary video that best describes the content of the original video. Most…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Mrigank Rochan , Yang Wang

Intelligent video summarization algorithms allow to quickly convey the most relevant information in videos through the identification of the most essential and explanatory content while removing redundant video frames. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Tianrui Liu , Qingjie Meng , Jun-Jie Huang , Athanasios Vlontzos , Daniel Rueckert , Bernhard Kainz

Video summarization methods are usually classified into shot-level or frame-level methods, which are individually used in a general way. This paper investigates the underlying complementarity between the frame-level and shot-level methods,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Yubo An , Shenghui Zhao , Guoqiang Zhang

AI agents are being developed to support high stakes decision-making processes from driving cars to prescribing drugs, making it increasingly important for human users to understand their behavior. Policy summarization methods aim to convey…

Machine Learning · Computer Science 2019-06-03 Isaac Lage , Daphna Lifschitz , Finale Doshi-Velez , Ofra Amir

When video collections become huge, how to explore both within and across videos efficiently is challenging. Video summarization is one of the ways to tackle this issue. Traditional summarization approaches limit the effectiveness of video…

Information Retrieval · Computer Science 2020-04-09 Jia-Hong Huang , Marcel Worring

The rapid expansion of video content across a variety of industries, including social media, education, entertainment, and surveillance, has made video summarization an essential field of study. The current work is a survey that explores…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Toqa Alaa , Ahmad Mongy , Assem Bakr , Mariam Diab , Walid Gomaa

Automatically generating a summary of sports video poses the challenge of detecting interesting moments, or highlights, of a game. Traditional sports video summarization methods leverage editing conventions of broadcast sports video that…

Computer Vision and Pattern Recognition · Computer Science 2018-04-16 Antonio Tejero-de-Pablos , Yuta Nakashima , Tomokazu Sato , Naokazu Yokoya , Marko Linna , Esa Rahtu

This paper proposes an efficient video summarization framework that will give a gist of the entire video in a few key-frames or video skims. Existing video summarization frameworks are based on algorithms that utilize computer vision…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Sai Sukruth Bezugam , Swatilekha Majumdar , Chetan Ralekar , Tapan Kumar Gandhi

With Artificial Intelligence on the rise, human interaction with autonomous agents becomes more frequent. Effective human-agent collaboration requires users to understand the agent's behavior, as failing to do so may cause reduced…

Artificial Intelligence · Computer Science 2021-12-03 Yotam Amitai , Ofra Amir

Most traditional video summarization methods are designed to generate effective summaries for single-view videos, and thus they cannot fully exploit the complicated intra and inter-view correlations in summarizing multi-view videos in a…

Computer Vision and Pattern Recognition · Computer Science 2017-06-13 Rameswar Panda , Amit K. Roy-Chowdhury

Traditional video summarization methods generate fixed video representations regardless of user interest. Therefore such methods limit users' expectations in content search and exploration scenarios. Multi-modal video summarization is one…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Jia-Hong Huang , Luka Murn , Marta Mrak , Marcel Worring

This paper introduces a new, unsupervised method for automatic video summarization using ideas from generative adversarial networks but eliminating the discriminator, having a simple loss function, and separating training of different parts…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Hanqing Li , Diego Klabjan , Jean Utke

This paper presents a novel approach for unsupervised video summarization using reinforcement learning (RL), addressing limitations like unstable adversarial training and reliance on heuristic-based reward functions. The method operates on…

Multimedia · Computer Science 2025-12-24 Mehryar Abbasi , Hadi Hadizadeh , Parvaneh Saeedi

This paper addresses automatic summarization of videos in a unified manner. In particular, we propose a framework for multi-faceted summarization for extractive, query base and entity summarization (summarization at the level of entities…

Computer Vision and Pattern Recognition · Computer Science 2019-01-07 Vishal Kaushal , Rishabh Iyer , Khoshrav Doctor , Anurag Sahoo , Pratik Dubal , Suraj Kothawade , Rohan Mahadev , Kunal Dargan , Ganesh Ramakrishnan

Video consumption is being shifted from sit-and-watch to selective skimming. Existing video player interfaces, however, only provide indirect manipulation to support this emerging behavior. Video summarization alleviates this issue to some…

Multimedia · Computer Science 2017-08-24 Haojian Jin , Yale Song , Koji Yatani

Humans are remarkably efficient at forming spatial understanding from just a few visual observations. When browsing real estate or navigating unfamiliar spaces, they intuitively select a small set of views that summarize the spatial layout.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Chao Chen , Mingzhi Zhu , Ankush Pratap Singh , Yu Yan , Felix Juefei-Xu , Chen Feng

As advances in artificial intelligence enable increasingly capable learning-based autonomous agents, it becomes more challenging for human observers to efficiently construct a mental model of the agent's behaviour. In order to successfully…

Robotics · Computer Science 2023-04-04 Peter Du , Surya Murthy , Katherine Driggs-Campbell

In the light of exponentially increasing video content, video summarization has attracted a lot of attention recently due to its ability to optimize time and storage. Characteristics of a good summary of a video depend on the particular…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Vishal Kaushal , Sandeep Subramanian , Suraj Kothawade , Rishabh Iyer , Ganesh Ramakrishnan

Generating a concise and informative video summary from a long video is important, yet subjective due to varying scene importance. Users' ability to specify scene importance through text queries enhances the relevance of such summaries.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Nirav Patel , Payal Prajapati , Maitrik Shah