English
Related papers

Related papers: CLIP-It! Language-Guided Video Summarization

200 papers

Video skimming, also known as dynamic video summarization, generates a temporally abridged version of a given video. Skimming can be achieved by identifying significant components either in uni-modal or multi-modal features extracted from…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Vivekraj V. K. , Debashis Sen , Balasubramanian Raman

The rapid expansion of video content across a variety of industries, including social media, education, entertainment, and surveillance, has made video summarization an essential field of study. The current work is a survey that explores…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Toqa Alaa , Ahmad Mongy , Assem Bakr , Mariam Diab , Walid Gomaa

This paper addresses automatic summarization of videos in a unified manner. In particular, we propose a framework for multi-faceted summarization for extractive, query base and entity summarization (summarization at the level of entities…

Computer Vision and Pattern Recognition · Computer Science 2019-01-07 Vishal Kaushal , Rishabh Iyer , Khoshrav Doctor , Anurag Sahoo , Pratik Dubal , Suraj Kothawade , Rohan Mahadev , Kunal Dargan , Ganesh Ramakrishnan

Long-form video content constitutes a significant portion of internet traffic, making automated video summarization an essential research problem. However, existing video summarization datasets are notably limited in their size,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Dawit Mureja Argaw , Seunghyun Yoon , Fabian Caba Heilbron , Hanieh Deilamsalehy , Trung Bui , Zhaowen Wang , Franck Dernoncourt , Joon Son Chung

As the number of video content has mushroomed in recent years, automatic video summarization has come useful when we want to just peek at the content of the video. However, there are two underlying limitations in generic video summarization…

Machine Learning · Computer Science 2023-01-23 Jeiyoon Park , Kiho Kwoun , Chanhee Lee , Heuiseok Lim

Video captioning is a challenging task since it requires generating sentences describing various diverse and complex videos. Existing video captioning models lack adequate visual representation due to the neglect of the existence of gaps…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Mingkang Tang , Zhanyu Wang , Zhenhua Liu , Fengyun Rao , Dian Li , Xiu Li

The target of automatic video summarization is to create a short skim of the original long video while preserving the major content/events. There is a growing interest in the integration of user queries into video summarization or…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Guande Wu , Jianzhe Lin , Claudio T. Silva

Text summarization systems have made significant progress in recent years, but typically generate summaries in one single step. However, the one-shot summarization setting is sometimes inadequate, as the generated summary may contain…

Computation and Language · Computer Science 2023-10-10 Haopeng Zhang , Xiao Liu , Jiawei Zhang

A comparative study of various techniques which can be used for summarization of Videos i.e. Video to Video conversion is presented along with respective architecture, results, strengths and shortcomings. In all approaches, a lengthy video…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Ravi Raj , Varad Bhatnagar , Aman Kumar Singh , Sneha Mane , Nilima Walde

Large-scale multi-modal training with image-text pairs imparts strong generalization to CLIP model. Since training on a similar scale for videos is infeasible, recent approaches focus on the effective transfer of image-based CLIP to the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Hanoona Rasheed , Muhammad Uzair Khattak , Muhammad Maaz , Salman Khan , Fahad Shahbaz Khan

Video transcript summarization is a fundamental task for video understanding. Conventional approaches for transcript summarization are usually built upon the summarization data for written language such as news articles, while the domain…

Computation and Language · Computer Science 2021-07-16 Tengchao Lv , Lei Cui , Momcilo Vasilijevic , Furu Wei

This paper proposes an efficient video summarization framework that will give a gist of the entire video in a few key-frames or video skims. Existing video summarization frameworks are based on algorithms that utilize computer vision…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Sai Sukruth Bezugam , Swatilekha Majumdar , Chetan Ralekar , Tapan Kumar Gandhi

Video-based movie genre classification has garnered considerable attention due to its various applications in recommendation systems. Prior work has typically addressed this task by adapting models from traditional video classification…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Zhongping Zhang , Yiwen Gu , Bryan A. Plummer , Xin Miao , Jiayi Liu , Huayan Wang

In the light of exponentially increasing video content, video summarization has attracted a lot of attention recently due to its ability to optimize time and storage. Characteristics of a good summary of a video depend on the particular…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Vishal Kaushal , Sandeep Subramanian , Suraj Kothawade , Rishabh Iyer , Ganesh Ramakrishnan

Video summarization aims at generating a compact yet representative visual summary that conveys the essence of the original video. The advantage of unsupervised approaches is that they do not require human annotations to learn the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-27 Hussain Kanafani , Junaid Ahmed Ghauri , Sherzod Hakimov , Ralph Ewerth

Video summarization aims to automatically generate a diverse and concise summary which is useful in large-scale video processing. Most of the methods tend to adopt self-attention mechanism across video frames, which fails to model the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yingchao Pan , Ouhan Huang , Qinghao Ye , Zhongjin Li , Wenjiang Wang , Guodun Li , Yuxing Chen

Video summarization, by selecting the most informative and/or user-relevant parts of original videos to create concise summary videos, has high research value and consumer demand in today's video proliferation era. Multi-modal video…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Yaowei Guo , Jiazheng Xing , Xiaojun Hou , Shuo Xin , Juntao Jiang , Demetri Terzopoulos , Chenfanfu Jiang , Yong Liu

Video summarization is among challenging tasks in computer vision, which aims at identifying highlight frames or shots over a lengthy video input. In this paper, we propose an novel attention-based framework for video summarization with…

Computer Vision and Pattern Recognition · Computer Science 2020-06-04 Yen-Ting Liu , Yu-Jhe Li , Yu-Chiang Frank Wang

Video is one of the robust sources of information and the consumption of online and offline videos has reached an unprecedented level in the last few years. A fundamental challenge of extracting information from videos is a viewer has to go…

Information Retrieval · Computer Science 2020-11-17 Shruti Jadon , Mahmood Jasim

Gaze estimation methods often experience significant performance degradation when evaluated across different domains, due to the domain gap between the testing and training data. Existing methods try to address this issue using various…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Pengwei Yin , Guanzhong Zeng , Jingjing Wang , Di Xie