English
Related papers

Related papers: Recycle-GAN: Unsupervised Video Retargeting

200 papers

This paper introduces a new, unsupervised method for automatic video summarization using ideas from generative adversarial networks but eliminating the discriminator, having a simple loss function, and separating training of different parts…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Hanqing Li , Diego Klabjan , Jean Utke

Unsupervised video-based object-centric learning is a promising avenue to learn structured representations from large, unlabeled video collections, but previous approaches have only managed to scale to real-world datasets in restricted…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Andrii Zadaianchuk , Maximilian Seitzer , Georg Martius

We present a deep generative model for unsupervised text style transfer that unifies previously proposed non-generative techniques. Our probabilistic approach models non-parallel data from two domains as a partially observed parallel…

Computation and Language · Computer Science 2020-05-01 Junxian He , Xinyi Wang , Graham Neubig , Taylor Berg-Kirkpatrick

We propose a novel model named Multi-Channel Attention Selection Generative Adversarial Network (SelectionGAN) for guided image-to-image translation, where we translate an input image into another while respecting an external semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Hao Tang , Philip H. S. Torr , Nicu Sebe

We address the task of unsupervised retargeting of human actions from one video to another. We consider the challenging setting where only a few frames of the target is available. The core of our approach is a conditional generative model…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Jessica Lee , Deva Ramanan , Rohit Girdhar

The development of sophisticated models for video-to-video synthesis has been facilitated by recent advances in deep reinforcement learning and generative adversarial networks (GANs). In this paper, we propose RL-V2V-GAN, a new deep neural…

Machine Learning · Computer Science 2024-10-29 Yintai Ma , Diego Klabjan , Jean Utke

Collecting well-annotated image datasets to train modern machine learning algorithms is prohibitively expensive for many tasks. One appealing alternative is rendering synthetic data where ground-truth annotations are generated…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Konstantinos Bousmalis , Nathan Silberman , David Dohan , Dumitru Erhan , Dilip Krishnan

We introduce ReConvNet, a recurrent convolutional architecture for semi-supervised video object segmentation that is able to fast adapt its features to focus on any specific object of interest at inference time. Generalization to new…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Francesco Lattari , Marco Ciccone , Matteo Matteucci , Jonathan Masci , Francesco Visin

Endoscopic videos from multicentres often have different imaging conditions, e.g., color and illumination, which make the models trained on one domain usually fail to generalize well to another. Domain adaptation is one of the potential…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Jiawei Chen , Yuexiang Li , Kai Ma , Yefeng Zheng

The problem of image-to-image translation is one that is intruiging and challenging at the same time, for the impact potential it can have on a wide variety of other computer vision applications like colorization, inpainting, segmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 BahaaEddin AlAila , Zahra Jandaghi , Abolfazl Farahani , Mohammad Ziad Al-Saad

The dominant approach to unsupervised "style transfer" in text is based on the idea of learning a latent representation, which is independent of the attributes specifying its "style". In this paper, we show that this condition is not…

Computation and Language · Computer Science 2019-09-23 Sandeep Subramanian , Guillaume Lample , Eric Michael Smith , Ludovic Denoyer , Marc'Aurelio Ranzato , Y-Lan Boureau

In recent years, considerable advancements have been made in the area of Generative Adversarial Networks (GANs), particularly with the advent of style-based architectures that address many key shortcomings - both in terms of modeling…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Nikos Kostagiolas , Mihalis A. Nicolaou , Yannis Panagakis

Learning to transfer visual attributes requires supervision dataset. Corresponding images with varying attribute values with the same identity are required for learning the transfer function. This largely limits their applications, because…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Taeksoo Kim , Byoungjip Kim , Moonsu Cha , Jiwon Kim

Generative models make huge progress to the photorealistic image synthesis in recent years. To enable human to steer the image generation process and customize the output, many works explore the interpretable dimensions of the latent space…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Jianyuan Wang , Lalit Bhagat , Ceyuan Yang , Yinghao Xu , Yujun Shen , Hongdong Li , Bolei Zhou

GAN inversion is indispensable for applying the powerful editability of GAN to real images. However, existing methods invert video frames individually often leading to undesired inconsistent results over time. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yangyang Xu , Shengfeng He , Kwan-Yee K. Wong , Ping Luo

Large text-to-image diffusion models have exhibited impressive proficiency in generating high-quality images. However, when applying these models to video domain, ensuring temporal consistency across video frames remains a formidable…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Shuai Yang , Yifan Zhou , Ziwei Liu , Chen Change Loy

Recent progress of self-supervised visual representation learning has achieved remarkable success on many challenging computer vision benchmarks. However, whether these techniques can be used for domain adaptation has not been explored. In…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Jiaolong Xu , Liang Xiao , Antonio M. Lopez

Most deep learning models are data-driven and the excellent performance is highly dependent on the abundant and diverse datasets. However, it is very hard to obtain and label the datasets of some specific scenes or applications. If we train…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Tianxiao Zhang , Wenchi Ma , Guanghui Wang

Retrofitting is a technique used to move word vectors closer together or further apart in their space to reflect their relationships in a Knowledge Base (KB). However, retrofitting only works on concepts that are present in that KB.…

Computation and Language · Computer Science 2021-08-31 Pedro Colon-Hernandez , Yida Xin , Henry Lieberman , Catherine Havasi , Cynthia Breazeal , Peter Chin

Training deep neural networks typically requires large amounts of labeled data which may be scarce or expensive to obtain for a particular target domain. As an alternative, we can leverage webly-supervised data (i.e. results from a public…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Andrew Kae , Yale Song