English
Related papers

Related papers: Uncertainty-Aware and Decoder-Aligned Learning for…

200 papers

Video summarization attracts attention for efficient video representation, retrieval, and browsing to ease volume and traffic surge problems. Although video summarization mostly uses the visual channel for compaction, the benefits of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Ibrahim Shoer , Berkay Kopru , Engin Erzin

YouTube users looking for instructions for a specific task may spend a long time browsing content trying to find the right video that matches their needs. Creating a visual summary (abridged version of a video) provides viewers with a quick…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Medhini Narasimhan , Arsha Nagrani , Chen Sun , Michael Rubinstein , Trevor Darrell , Anna Rohrbach , Cordelia Schmid

Multimodal summarization requires models to jointly understand textual and visual inputs to generate concise, semantically coherent summaries. Existing methods often inject shallow visual features into deep language models, leading to…

Artificial Intelligence · Computer Science 2026-05-13 Abid Ali , Diego Molla-Aliod , Usman Naseem

Video summarization aims to extract keyframes/shots from a long video. Previous methods mainly take diversity and representativeness of generated summaries as prior knowledge in algorithm design. In this paper, we formulate video…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Yudong Jiang , Kaixu Cui , Bo Peng , Changliang Xu

Multimodal abstractive summarization for videos (MAS) requires generating a concise textual summary to describe the highlights of a video according to multimodal resources, in our case, the video content and its transcript. Inspired by the…

Computation and Language · Computer Science 2023-05-09 Zenan Xu , Xiaojun Meng , Yasheng Wang , Qinliang Su , Zexuan Qiu , Xin Jiang , Qun Liu

Given the explosive growth of online videos, it is becoming increasingly important to relieve the tedious work of browsing and managing the video content of interest. Video summarization aims at providing such a technique by transforming…

Computer Vision and Pattern Recognition · Computer Science 2017-07-14 Zhong Ji , Yaru Ma , Yanwei Pang , Xuelong Li

The huge amount of video data produced daily by camera-based systems, such as surveilance, medical and telecommunication systems, emerges the need for effective video summarization (VS) methods. These methods should be capable of creating…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 George Pantazis , George Dimas , Dimitris K. Iakovidis

Advertisers commonly need multiple versions of the same advertisement (ad) at varying durations for a single campaign. The traditional approach involves manually selecting and re-editing shots from longer video ads to create shorter…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Wen Xie , Yanjun Zhu , Gijs Overgoor , Yakov Bart , Agata Lapedriza Garcia , Sarah Ostadabbas

Humans are remarkably efficient at forming spatial understanding from just a few visual observations. When browsing real estate or navigating unfamiliar spaces, they intuitively select a small set of views that summarize the spatial layout.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Chao Chen , Mingzhi Zhu , Ankush Pratap Singh , Yu Yan , Felix Juefei-Xu , Chen Feng

Video summarisation can be posed as the task of extracting important parts of a video in order to create an informative summary of what occurred in the video. In this paper we introduce SummaryNet as a supervised learning framework for…

Computer Vision and Pattern Recognition · Computer Science 2020-02-24 Ziyad Jappie , David Torpey , Turgay Celik

Recently, video summarization has been proposed as a method to help video exploration. However, traditional video summarization models only generate a fixed video summary which is usually independent of user-specific needs and hence limits…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Jia-Hong Huang , Chao-Han Huck Yang , Pin-Yu Chen , Andrew Brown , Marcel Worring

The proliferation of video content on platforms like YouTube and Vimeo presents significant challenges in efficiently locating relevant information. Automatic video summarization aims to address this by extracting and presenting key content…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Jia-Hong Huang

The recent growth of web video sharing platforms has increased the demand for systems that can efficiently browse, retrieve and summarize video content. Query-aware multi-video summarization is a promising technique that caters to this…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Safa Messaoud , Ismini Lourentzou , Assma Boughoula , Mona Zehni , Zhizhen Zhao , Chengxiang Zhai , Alexander G. Schwing

The goal of video summarization is to automatically shorten videos such that it conveys the overall story without losing relevant information. In many application scenarios, improper video summarization can have a large impact. For example…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Jia-Hong Huang , Chao-Han Huck Yang , Pin-Yu Chen , Min-Hung Chen , Marcel Worring

We introduce ViSMap: Unsupervised Video Summarisation by Meta Prompting, a system to summarise hour long videos with no-supervision. Most existing video understanding models work well on short videos of pre-segmented events, yet they…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Jian Hu , Dimitrios Korkinof , Shaogang Gong , Mariano Beguerisse-Diaz

As the number of video content has mushroomed in recent years, automatic video summarization has come useful when we want to just peek at the content of the video. However, there are two underlying limitations in generic video summarization…

Machine Learning · Computer Science 2023-01-23 Jeiyoon Park , Kiho Kwoun , Chanhee Lee , Heuiseok Lim

This paper introduces a novel variant of video summarization, namely building a summary that depends on the particular aspect of a video the viewer focuses on. We refer to this as $\textit{viewpoint}$. To infer what the desired…

Computer Vision and Pattern Recognition · Computer Science 2018-04-11 Atsushi Kanehira , Luc Van Gool , Yoshitaka Ushiku , Tatsuya Harada

Video summarization aims to generate a concise representation of a video, capturing its essential content and key moments while reducing its overall length. Although several methods employ attention mechanisms to handle long-term…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Jaewon Son , Jaehun Park , Kwangsu Kim

In this paper, we present a novel unsupervised video summarization model that requires no manual annotation. The proposed model termed Cycle-SUM adopts a new cycle-consistent adversarial LSTM architecture that can effectively maximize the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Li Yuan , Francis EH Tay , Ping Li , Li Zhou , Jiashi Feng

In recent years, data selection has emerged as a core issue for large-scale visual-language model pretraining, especially on noisy web-curated datasets. One widely adopted strategy assigns quality scores such as CLIP similarity for each…

Machine Learning · Computer Science 2024-02-06 Yiping Wang , Yifang Chen , Wendan Yan , Kevin Jamieson , Simon Shaolei Du