English
Related papers

Related papers: Semantic-Guided Unsupervised Video Summarization

200 papers

A good representation for arbitrarily complicated data should have the capability of semantic generation, clustering and reconstruction. Previous research has already achieved impressive performance on either one. This paper aims at…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Yuqian Zhou , Kuangxiao Gu , Thomas Huang

As one of the fundamental tasks in computer vision, semantic segmentation plays an important role in real world applications. Although numerous deep learning models have made notable progress on several mainstream datasets with the rapid…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Bin Zhang , Shengjie Zhao , Rongqing Zhang

Generative Adversarial Networks (GANs) have shown tremendous potential in synthesizing a large number of realistic SAR images by learning patterns in the data distribution. Some GANs can achieve image editing by introducing latent codes,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Xuran Hu , Mingzhe Zhu , Ziqiang Xu , Zhenpeng Feng , Ljubisa Stankovic

Generative Adversarial Networks (GANs) have shown great performance on super-resolution problems since they can generate more visually realistic images and video frames. However, these models often introduce side effects into the outputs,…

Image and Video Processing · Electrical Eng. & Systems 2024-03-19 Xijun Wang , Santiago López-Tapia , Alice Lucas , Xinyi Wu , Rafael Molina , Aggelos K. Katsaggelos

Query-based video summarization is the task of creating a brief visual trailer, which captures the parts of the video (or a collection of videos) that are most relevant to the user-issued query. In this paper, we propose an unsupervised…

Machine Learning · Computer Science 2016-09-08 Harrie Oosterhuis , Sujith Ravi , Michael Bendersky

In many applications, including surveillance, entertainment, and restoration, there is a need to increase both the spatial resolution and the frame rate of a video sequence. The aim is to improve visual quality, refine details, and create a…

Image and Video Processing · Electrical Eng. & Systems 2024-07-25 Congrui Fu , Hui Yuan , Liquan Shen , Raouf Hamzaoui , Hao Zhang

Zero-shot learning (ZSL) is to handle the prediction of those unseen classes that have no labeled training data. Recently, generative methods like Generative Adversarial Networks (GANs) are being widely investigated for ZSL due to their…

Computer Vision and Pattern Recognition · Computer Science 2020-04-08 Yuxia Geng , Jiaoyan Chen , Zhuo Chen , Zhiquan Ye , Zonggang Yuan , Yantao Jia , Huajun Chen

Video summarization aims to extract keyframes/shots from a long video. Previous methods mainly take diversity and representativeness of generated summaries as prior knowledge in algorithm design. In this paper, we formulate video…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Yudong Jiang , Kaixu Cui , Bo Peng , Changliang Xu

Deep learning based pan-sharpening has received significant research interest in recent years. Most of existing methods fall into the supervised learning framework in which they down-sample the multi-spectral (MS) and panchromatic (PAN)…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Huanyu Zhou , Qingjie Liu , Dawei Weng , Yunhong Wang

Video processing has become a popular research direction in computer vision due to its various applications such as video summarization, action recognition, etc. Recently, deep learning-based methods have achieved impressive results in…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 G M Mashrur E Elahi , Yee-Hong Yang

Conventional video summarization approaches based on reinforcement learning have the problem that the reward can only be received after the whole summary is generated. Such kind of reward is sparse and it makes reinforcement learning hard…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Yiyan Chen , Li Tao , Xueting Wang , Toshihiko Yamasaki

Automatically generating a summary of sports video poses the challenge of detecting interesting moments, or highlights, of a game. Traditional sports video summarization methods leverage editing conventions of broadcast sports video that…

Computer Vision and Pattern Recognition · Computer Science 2018-04-16 Antonio Tejero-de-Pablos , Yuta Nakashima , Tomokazu Sato , Naokazu Yokoya , Marko Linna , Esa Rahtu

The growth of videos in our digital age and the users' limited time raise the demand for processing untrimmed videos to produce shorter versions conveying the same information. Despite the remarkable progress that summarization methods have…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Washington Ramos , Michel Silva , Edson Araujo , Victor Moura , Keller Oliveira , Leandro Soriano Marcolino , Erickson R. Nascimento

While Multimodal Large Language Models (MLLMs) exhibit strong performance on standard video tasks, their ability to faithfully summarize and reason over complex narratives remains poorly evaluated. Existing summarization benchmarks fragment…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Mengqi Shi , Haopeng Zhang

This paper introduces a novel approach for unsupervised object co-localization using Generative Adversarial Networks (GANs). GAN is a powerful tool that can implicitly learn unknown data distributions in an unsupervised manner. From the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-10 Junsuk Choe , Joo Hyun Park , Hyunjung Shim

Recently image inpainting has witnessed rapid progress due to generative adversarial networks (GAN) that are able to synthesize realistic contents. However, most existing GAN-based methods for semantic inpainting apply an auto-encoder…

Computer Vision and Pattern Recognition · Computer Science 2017-12-22 Haofeng Li , Guanbin Li , Liang Lin , Yizhou Yu

Unsupervised image-to-image translation is a recently proposed task of translating an image to a different style or domain given only unpaired image examples at training time. In this paper, we formulate a new task of unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Dina Bashkirova , Ben Usman , Kate Saenko

In recent years, there has been a growing interest in Semantic Image Synthesis (SIS) through the use of Generative Adversarial Networks (GANs) and diffusion models. This field has seen innovations such as the implementation of specialized…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Khaled M. Seyam , Julian Wiederer , Markus Braun , Bin Yang

Sequential video understanding, as an emerging video understanding task, has driven lots of researchers' attention because of its goal-oriented nature. This paper studies weakly supervised sequential video understanding where the accurate…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Sixun Dong , Huazhang Hu , Dongze Lian , Weixin Luo , Yicheng Qian , Shenghua Gao

Generative Adversarial Networks have become one of the most studied frameworks for unsupervised learning due to their intuitive formulation. They have also been shown to be capable of generating convincing examples in limited domains, such…

Machine Learning · Computer Science 2016-12-14 Daniel Jiwoong Im , He Ma , Chris Dongjoo Kim , Graham Taylor