English
Related papers

Related papers: Summarizing Videos with Attention

200 papers

In this work we propose a multi-task spatio-temporal network, called SUSiNet, that can jointly tackle the spatio-temporal problems of saliency estimation, action recognition and video summarization. Our approach employs a single network…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Petros Koutras , Petros Maragos

The aim of video summarization is to shorten videos automatically while retaining the key information necessary to convey the overall story. Video summarization methods mainly rely on visual factors, such as visual consecutiveness and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Jia-Hong Huang , Chao-Han Huck Yang , Pin-Yu Chen , Min-Hung Chen , Marcel Worring

Video summaries come in many forms, from traditional single-image thumbnails, animated thumbnails, storyboards, to trailer-like video summaries. Content creators use the summaries to display the most attractive portion of their videos; the…

Multimedia · Computer Science 2018-08-03 Hongxiang Gu , Viswanathan Swaminathan

Humans are remarkably efficient at forming spatial understanding from just a few visual observations. When browsing real estate or navigating unfamiliar spaces, they intuitively select a small set of views that summarize the spatial layout.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Chao Chen , Mingzhi Zhu , Ankush Pratap Singh , Yu Yan , Felix Juefei-Xu , Chen Feng

With the broad growth of video capturing devices and applications on the web, it is more demanding to provide desired video content for users efficiently. Video summarization facilitates quickly grasping video content by creating a compact…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Mayu Otani , Yale Song , Yang Wang

In this work, we introduce the task of script-driven video summarization, which aims to produce a summary of the full-length video by selecting the parts that are most relevant to a user-provided script outlining the visual content of the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Manolis Mylonas , Evlampios Apostolidis , Vasileios Mezaris

This paper introduces a novel method for real-time exercise classification using a Bidirectional Long Short-Term Memory (BiLSTM) neural network. Existing exercise recognition approaches often rely on synthetic datasets, raw coordinate…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Riccardo Riccio

Keyframe extraction aims to sum up a video's semantics with the minimum number of its frames. This paper puts forward a Large Model based Sequential Keyframe Extraction for video summarization, dubbed LMSKE, which contains three stages as…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Kailong Tan , Yuxiang Zhou , Qianchen Xia , Rui Liu , Yong Chen

Video summarization technologies aim to create a concise and complete synopsis by selecting the most informative parts of the video content. Several approaches have been developed over the last couple of decades and the current state of the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Evlampios Apostolidis , Eleni Adamantidou , Alexandros I. Metsai , Vasileios Mezaris , Ioannis Patras

EdgeVidSum is a lightweight method that generates personalized, fast-forward summaries of long-form videos directly on edge devices. The proposed approach enables real-time video summarization while safeguarding user privacy through local…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Ghulam Mujtaba , Eun-Seok Ryu

Advertisers commonly need multiple versions of the same advertisement (ad) at varying durations for a single campaign. The traditional approach involves manually selecting and re-editing shots from longer video ads to create shorter…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Wen Xie , Yanjun Zhu , Gijs Overgoor , Yakov Bart , Agata Lapedriza Garcia , Sarah Ostadabbas

This paper presents a video summarization technique for an Internet video to provide a quick way to overview its content. This is a challenging problem because finding important or informative parts of the original video requires to…

Computer Vision and Pattern Recognition · Computer Science 2016-09-29 Mayu Otani , Yuta Nakashima , Esa Rahtu , Janne Heikkilä , Naokazu Yokoya

While most existing video summarization approaches aim to extract an informative summary of a single video, we propose a novel framework for summarizing multi-view videos by exploiting both intra- and inter-view content correlations in a…

Computer Vision and Pattern Recognition · Computer Science 2016-08-02 Rameswar Panda , Abir Das , Amit K. Roy-Chowdhury

This paper addresses automatic summarization and search in visual data comprising of videos, live streams and image collections in a unified manner. In particular, we propose a framework for multi-faceted summarization which extracts…

Computer Vision and Pattern Recognition · Computer Science 2017-04-06 Anurag Sahoo , Vishal Kaushal , Khoshrav Doctor , Suyash Shetty , Rishabh Iyer , Ganesh Ramakrishnan

Video Large Language Models (Video-LLMs) excel at understanding videos in-context, provided they have full access to the video when answering queries. However, these models face challenges in streaming scenarios where hour-long videos must…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Vaggelis Dorovatas , Soroush Seifi , Gunshi Gupta , Rahaf Aljundi

Although the problem of automatic video summarization has recently received a lot of attention, the problem of creating a video summary that also highlights elements relevant to a search query has been less studied. We address this problem…

Computer Vision and Pattern Recognition · Computer Science 2017-09-29 Arun Balajee Vasudevan , Michael Gygli , Anna Volokitin , Luc Van Gool

Video summarization has become an increasingly important task in the field of computer vision due to the vast amount of video content available on the internet. In this project, we propose a new method for natural language query based joint…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Richard Luo , Austin Peng , Heidi Yap , Koby Beard

Audio and vision are two main modalities in video data. Multimodal learning, especially for audiovisual learning, has drawn considerable attention recently, which can boost the performance of various computer vision tasks. However, in video…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Bin Zhao , Maoguo Gong , Xuelong Li

This paper describes a system developed to help University students get more from their online lectures, tutorials, laboratory and other live sessions. We do this by logging their attention levels on their laptops during live Zoom sessions…

Multimedia · Computer Science 2021-01-19 Hyowon Lee , Mingming Liu , Hamza Riaz , Navaneethan Rajasekaren , Michael Scriney , Alan F. Smeaton

The explosive growth of video data intensified the need for flexible user-controllable summarization tools that operate without training data. Existing methods either rely on domain-specific datasets, limiting generalization, or cannot…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Mario Barbara , Alaa Maalouf