English
Related papers

Related papers: Image Conditioned Keyframe-Based Video Summarizati…

200 papers

Video highlight or summarization is among interesting topics in computer vision, which benefits a variety of applications like viewing, searching, or storage. However, most existing studies rely on training data of third-person videos,…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Hsuan-I Ho , Wei-Chen Chiu , Yu-Chiang Frank Wang

A generic video summary is an abridged version of a video that conveys the whole story and features the most important scenes. Yet the importance of scenes in a video is often subjective, and users should have the option of customizing the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-09 Medhini Narasimhan , Anna Rohrbach , Trevor Darrell

YouTube users looking for instructions for a specific task may spend a long time browsing content trying to find the right video that matches their needs. Creating a visual summary (abridged version of a video) provides viewers with a quick…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Medhini Narasimhan , Arsha Nagrani , Chen Sun , Michael Rubinstein , Trevor Darrell , Anna Rohrbach , Cordelia Schmid

Video summarization aims at choosing parts of a video that narrate a story as close as possible to the original one. Most of the existing video summarization approaches focus on hand-crafted labels. As the number of videos grows…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Ivan Sosnovik , Artem Moskalev , Cees Kaandorp , Arnold Smeulders

Video summarization remains a huge challenge in computer vision due to the size of the input videos to be summarized. We propose an efficient, language-only video summarizer that achieves competitive accuracy with high data efficiency.…

Artificial Intelligence · Computer Science 2023-09-19 Yoonsoo Nam , Adam Lehavi , Daniel Yang , Digbalay Bose , Swabha Swayamdipta , Shrikanth Narayanan

The assignment of importance scores to particular frames or (short) segments in a video is crucial for summarization, but also a difficult task. Previous work utilizes only one source of visual features. In this paper, we suggest a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Junaid Ahmed Ghauri , Sherzod Hakimov , Ralph Ewerth

This paper deals with the problem of localizing objects in image and video datasets from visual exemplars. In particular, we focus on the challenging problem of egocentric visual query localization. We first identify grave implicit biases…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Mengmeng Xu , Yanghao Li , Cheng-Yang Fu , Bernard Ghanem , Tao Xiang , Juan-Manuel Perez-Rua

As the number of video content has mushroomed in recent years, automatic video summarization has come useful when we want to just peek at the content of the video. However, there are two underlying limitations in generic video summarization…

Machine Learning · Computer Science 2023-01-23 Jeiyoon Park , Kiho Kwoun , Chanhee Lee , Heuiseok Lim

The emergence of low-cost personal mobiles devices and wearable cameras and the increasing storage capacity of video-sharing websites have pushed forward a growing interest towards first-person videos. Since most of the recorded videos…

Computer Vision and Pattern Recognition · Computer Science 2017-08-17 Michel Melo Silva , Washington Luis Souza Ramos , Joao Pedro Klock Ferreira , Mario Fernando Montenegro Campos , Erickson Rangel Nascimento

Existing approaches in video captioning concentrate on exploring global frame features in the uncompressed videos, while the free of charge and critical saliency information already encoded in the compressed videos is generally neglected.…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Mingjian Zhu , Chenrui Duan , Changbin Yu

Most existing video moment retrieval methods rely on temporal sequences of frame- or clip-level features that primarily encode global visual and semantic information. However, such representations often fail to capture fine-grained object…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Zongyao Li , Yongkang Wong , Satoshi Yamazaki , Jianquan Liu , Mohan Kankanhalli

Large collections of videos are grouped into clusters by a topic keyword, such as Eiffel Tower or Surfing, with many important visual concepts repeating across them. Such a topically close set of videos have mutual influence on each other,…

Computer Vision and Pattern Recognition · Computer Science 2017-06-13 Rameswar Panda , Amit K. Roy-Chowdhury

Current video summarization methods rely heavily on supervised computer vision techniques, which demands time-consuming and subjective manual annotations. To overcome these limitations, we investigated self-supervised video summarization.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Tomoya Sugihara , Shuntaro Masuda , Ling Xiao , Toshihiko Yamasaki

Video synopsis, summarizing a video to generate a shorter video by exploiting the spatial and temporal redundancies, is important for surveillance and archiving. Existing trajectory-based video synopsis algorithms will not able to work in…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Anton Jeran Ratnarajah , Sahani Goonetilleke , Dumindu Tissera , Kapilan Balagopalan , Ranga Rodrigo

This paper introduces a novel variant of video summarization, namely building a summary that depends on the particular aspect of a video the viewer focuses on. We refer to this as $\textit{viewpoint}$. To infer what the desired…

Computer Vision and Pattern Recognition · Computer Science 2018-04-11 Atsushi Kanehira , Luc Van Gool , Yoshitaka Ushiku , Tatsuya Harada

Existing video captioning approaches typically require to first sample video frames from a decoded video and then conduct a subsequent process (e.g., feature extraction and/or captioning model learning). In this pipeline, manual frame…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Yaojie Shen , Xin Gu , Kai Xu , Heng Fan , Longyin Wen , Libo Zhang

In the Internet, ubiquitous presence of redundant, unedited, raw videos has made video summarization an important problem. Traditional methods of video summarization employ a heuristic set of hand-crafted features, which in many cases fail…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Mohaiminul Al Nahian , A. S. M. Iftekhar , Mohammad Tariqul Islam , S. M. Mahbubur Rahman , Dimitrios Hatzinakos

Video summarization aims to distill the most important information from a source video to produce either an abridged clip or a textual narrative. Traditionally, different methods have been proposed depending on whether the output is a video…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Jingyang Lin , Hang Hua , Ming Chen , Yikang Li , Jenhao Hsiao , Chiuman Ho , Jiebo Luo

Video Question Answering is a challenging task, which requires the model to reason over multiple frames and understand the interaction between different objects to answer questions based on the context provided within the video, especially…

Artificial Intelligence · Computer Science 2024-07-31 Bhanu Prakash Reddy Guda , Tanmay Kulkarni , Adithya Sampath , Swarnashree Mysore Sathyendra

Recently, video summarization has been proposed as a method to help video exploration. However, traditional video summarization models only generate a fixed video summary which is usually independent of user-specific needs and hence limits…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Jia-Hong Huang , Chao-Han Huck Yang , Pin-Yu Chen , Andrew Brown , Marcel Worring