English
Related papers

Related papers: Personalized Video Summarization by Multimodal Vid…

200 papers

We consider the problem of video summarization. Given an input raw video, the goal is to select a small subset of key frames from the input video to create a shorter summary video that best describes the content of the original video. Most…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Mrigank Rochan , Yang Wang

Video summarization aims at generating a compact yet representative visual summary that conveys the essence of the original video. The advantage of unsupervised approaches is that they do not require human annotations to learn the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-27 Hussain Kanafani , Junaid Ahmed Ghauri , Sherzod Hakimov , Ralph Ewerth

This paper addresses the problem of video summarization. Given an input video, the goal is to select a subset of the frames to create a summary video that optimally captures the important information of the input video. With the large…

Computer Vision and Pattern Recognition · Computer Science 2018-09-03 Mrigank Rochan , Linwei Ye , Yang Wang

Video summarization aims to extract keyframes/shots from a long video. Previous methods mainly take diversity and representativeness of generated summaries as prior knowledge in algorithm design. In this paper, we formulate video…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Yudong Jiang , Kaixu Cui , Bo Peng , Changliang Xu

Vision-Language Models (VLMs) are able to process increasingly longer videos. Yet, important visual information is easily lost throughout the entire context and missed by VLMs. Also, it is important to design tools that enable…

Computation and Language · Computer Science 2026-01-09 Galann Pennec , Zhengyuan Liu , Nicholas Asher , Philippe Muller , Nancy F. Chen

Video summarization has unprecedented importance to help us digest, browse, and search today's ever-growing video collections. We propose a novel subset selection technique that leverages supervision in the form of human-created summaries…

Computer Vision and Pattern Recognition · Computer Science 2016-05-02 Ke Zhang , Wei-Lun Chao , Fei Sha , Kristen Grauman

Humans are remarkably efficient at forming spatial understanding from just a few visual observations. When browsing real estate or navigating unfamiliar spaces, they intuitively select a small set of views that summarize the spatial layout.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Chao Chen , Mingzhi Zhu , Ankush Pratap Singh , Yu Yan , Felix Juefei-Xu , Chen Feng

Video summarization aims to create short, accurate, and cohesive summaries of longer videos. Despite the existence of various video summarization datasets, a notable limitation is their limited amount of source videos, which hampers the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Hang Hua , Yolo Yunlong Tang , Chenliang Xu , Jiebo Luo

We propose a novel supervised learning technique for summarizing videos by automatically selecting keyframes or key subshots. Casting the problem as a structured prediction problem on sequential data, our main idea is to use Long Short-Term…

Computer Vision and Pattern Recognition · Computer Science 2016-08-01 Ke Zhang , Wei-Lun Chao , Fei Sha , Kristen Grauman

Video summarization helps turn long videos into clear, concise representations that are easier to review, document, and analyze, especially in high-stakes domains like surgical training. Prior work has progressed from using basic visual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Shreya Rajpal , Michal Golovanevsky , Carsten Eickhoff

Video transcript summarization is a fundamental task for video understanding. Conventional approaches for transcript summarization are usually built upon the summarization data for written language such as news articles, while the domain…

Computation and Language · Computer Science 2021-07-16 Tengchao Lv , Lei Cui , Momcilo Vasilijevic , Furu Wei

Video is one of the robust sources of information and the consumption of online and offline videos has reached an unprecedented level in the last few years. A fundamental challenge of extracting information from videos is a viewer has to go…

Information Retrieval · Computer Science 2020-11-17 Shruti Jadon , Mahmood Jasim

In the light of exponentially increasing video content, video summarization has attracted a lot of attention recently due to its ability to optimize time and storage. Characteristics of a good summary of a video depend on the particular…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Vishal Kaushal , Sandeep Subramanian , Suraj Kothawade , Rishabh Iyer , Ganesh Ramakrishnan

Video summarization is among challenging tasks in computer vision, which aims at identifying highlight frames or shots over a lengthy video input. In this paper, we propose an novel attention-based framework for video summarization with…

Computer Vision and Pattern Recognition · Computer Science 2020-06-04 Yen-Ting Liu , Yu-Jhe Li , Yu-Chiang Frank Wang

Video highlight or summarization is among interesting topics in computer vision, which benefits a variety of applications like viewing, searching, or storage. However, most existing studies rely on training data of third-person videos,…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Hsuan-I Ho , Wei-Chen Chiu , Yu-Chiang Frank Wang

Video summarization aims to distill the most important information from a source video to produce either an abridged clip or a textual narrative. Traditionally, different methods have been proposed depending on whether the output is a video…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Jingyang Lin , Hang Hua , Ming Chen , Yikang Li , Jenhao Hsiao , Chiuman Ho , Jiebo Luo

Multimodal abstractive summarization for videos (MAS) requires generating a concise textual summary to describe the highlights of a video according to multimodal resources, in our case, the video content and its transcript. Inspired by the…

Computation and Language · Computer Science 2023-05-09 Zenan Xu , Xiaojun Meng , Yasheng Wang , Qinliang Su , Zexuan Qiu , Xin Jiang , Qun Liu

Despite its wide range of applications, video summarization is still held back by the scarcity of extensive datasets, largely due to the labor-intensive and costly nature of frame-level annotations. As a result, existing video summarization…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Hojjat Mokhtarabadi , Kave Bahraman , Mehrdad HosseinZadeh , Mahdi Eftekhari

Large language models (LLMs) have shown remarkable capabilities in generating user summaries from a long list of raw user activity data. These summaries capture essential user information such as preferences and interests, and therefore are…

Machine Learning · Computer Science 2024-09-09 Chao Wang , Neo Wu , Lin Ning , Jiaxing Wu , Luyang Liu , Jun Xie , Shawn O'Banion , Bradley Green

YouTube users looking for instructions for a specific task may spend a long time browsing content trying to find the right video that matches their needs. Creating a visual summary (abridged version of a video) provides viewers with a quick…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Medhini Narasimhan , Arsha Nagrani , Chen Sun , Michael Rubinstein , Trevor Darrell , Anna Rohrbach , Cordelia Schmid