中文
相关论文

相关论文: SummDiff: Generative Modeling of Video Summarizati…

200 篇论文

Diffusion models have emerged as a powerful generative method for synthesizing high-quality and diverse set of images. In this paper, we propose a video generation method based on diffusion models, where the effects of motion are modeled in…

计算机视觉与模式识别 · 计算机科学 2022-12-02 Kangfu Mei , Vishal M. Patel

Perceptual studies demonstrate that conditional diffusion models excel at reconstructing video content aligned with human visual perception. Building on this insight, we propose a video compression framework that leverages conditional…

计算机视觉与模式识别 · 计算机科学 2025-09-26 Fangqiu Yi , Jingyu Xu , Jiawei Shao , Chi Zhang , Xuelong Li

Generative models, particularly diffusion models, have made significant success in data synthesis across various modalities, including images, videos, and 3D assets. However, current diffusion models are computationally intensive, often…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Yuanzhi Zhu , Hanshu Yan , Huan Yang , Kai Zhang , Junnan Li

Current video summarization methods rely heavily on supervised computer vision techniques, which demands time-consuming and subjective manual annotations. To overcome these limitations, we investigated self-supervised video summarization.…

计算机视觉与模式识别 · 计算机科学 2024-08-21 Tomoya Sugihara , Shuntaro Masuda , Ling Xiao , Toshihiko Yamasaki

Traditional methods on video summarization are designed to generate summaries for single-view video records; and thus they cannot fully exploit the redundancy in multi-view video records. In this paper, we present a multi-view metric…

计算机视觉与模式识别 · 计算机科学 2015-11-30 Yanwei Fu , Lingbo Wang , Yanwen Guo

We propose a novel supervised learning technique for summarizing videos by automatically selecting keyframes or key subshots. Casting the problem as a structured prediction problem on sequential data, our main idea is to use Long Short-Term…

计算机视觉与模式识别 · 计算机科学 2016-08-01 Ke Zhang , Wei-Lun Chao , Fei Sha , Kristen Grauman

Automatic video summarization is still an unsolved problem due to several challenges. We take steps towards making automatic video summarization more realistic by addressing them. Firstly, the currently available datasets either have very…

计算机视觉与模式识别 · 计算机科学 2020-08-26 Vishal Kaushal , Suraj Kothawade , Rishabh Iyer , Ganesh Ramakrishnan

Video summarization aims at generating concise video summaries from the lengthy videos, to achieve better user watching experience. Due to the subjectivity, purely supervised methods for video summarization may bring the inherent errors…

计算机视觉与模式识别 · 计算机科学 2020-07-30 Tianyu Liu

Opinion summarization is expected to digest larger review sets and provide summaries from different perspectives. However, most existing solutions are deficient in epitomizing extensive reviews and offering opinion summaries from various…

计算与语言 · 计算机科学 2023-10-23 Han Jiang , Rui Wang , Zhihua Wei , Yu Li , Xinpeng Wang

Many applications benefit from sampling algorithms where a small number of well chosen samples are used to generalize different properties of a large dataset. In this paper, we use diverse sampling for streaming video summarization. Several…

计算机视觉与模式识别 · 计算机科学 2016-11-01 Rushil Anirudh , Ahnaf Masroor , Pavan Turaga

Video summarization aims at choosing parts of a video that narrate a story as close as possible to the original one. Most of the existing video summarization approaches focus on hand-crafted labels. As the number of videos grows…

计算机视觉与模式识别 · 计算机科学 2023-04-20 Ivan Sosnovik , Artem Moskalev , Cees Kaandorp , Arnold Smeulders

The best summary of a long video differs among different people due to its highly subjective nature. Even for the same person, the best summary may change with time or mood. In this paper, we introduce the task of generating customized…

计算机视觉与模式识别 · 计算机科学 2018-03-05 Jinsoo Choi , Tae-Hyun Oh , In So Kweon

Video summarisation can be posed as the task of extracting important parts of a video in order to create an informative summary of what occurred in the video. In this paper we introduce SummaryNet as a supervised learning framework for…

计算机视觉与模式识别 · 计算机科学 2020-02-24 Ziyad Jappie , David Torpey , Turgay Celik

Building on the momentum of image generation diffusion models, there is an increasing interest in video-based diffusion models. However, video generation poses greater challenges due to its higher-dimensional nature, the scarcity of…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Aimon Rahman , Malsha V. Perera , Vishal M. Patel

Temporal action segmentation is crucial for understanding long-form videos. Previous works on this task commonly adopt an iterative refinement paradigm by using multi-stage models. We propose a novel framework via denoising diffusion…

计算机视觉与模式识别 · 计算机科学 2023-08-15 Daochang Liu , Qiyue Li , AnhDung Dinh , Tingting Jiang , Mubarak Shah , Chang Xu

Video summarization technologies aim to create a concise and complete synopsis by selecting the most informative parts of the video content. Several approaches have been developed over the last couple of decades and the current state of the…

计算机视觉与模式识别 · 计算机科学 2021-09-28 Evlampios Apostolidis , Eleni Adamantidou , Alexandros I. Metsai , Vasileios Mezaris , Ioannis Patras

Video smmarization is a crucial method to reduce the time of videos which reduces the spent time to watch/review a long video. This apporach has became more important as the amount of publisehed video is increasing everyday. A single or…

计算机视觉与模式识别 · 计算机科学 2024-01-22 Vahid Ahmadi Kalkhorani , Qingquan Zhang , Guanqun Song , Ting Zhu

Traditional video summarization methods generate fixed video representations regardless of user interest. Therefore such methods limit users' expectations in content search and exploration scenarios. Multi-modal video summarization is one…

计算机视觉与模式识别 · 计算机科学 2021-04-27 Jia-Hong Huang , Luka Murn , Marta Mrak , Marcel Worring

We present a novel task called online video editing, which is designed to edit \textbf{streaming} frames while maintaining temporal consistency. Unlike existing offline video editing assuming all frames are pre-established and accessible,…

计算机视觉与模式识别 · 计算机科学 2024-05-31 Feng Chen , Zhen Yang , Bohan Zhuang , Qi Wu

Video summarization is among challenging tasks in computer vision, which aims at identifying highlight frames or shots over a lengthy video input. In this paper, we propose an novel attention-based framework for video summarization with…

计算机视觉与模式识别 · 计算机科学 2020-06-04 Yen-Ting Liu , Yu-Jhe Li , Yu-Chiang Frank Wang