English
Related papers

Related papers: Recycle-GAN: Unsupervised Video Retargeting

200 papers

This work introduced a novel GAN architecture for unsupervised image translation on the task of face style transform. A spectral attention-based mechanism is embedded into the design along with spatial attention on the image contents. We…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Qizhou Wang , Maksim Makarenko

Unsupervised Multiple Domain Translation is the task of transforming data from one domain to other domains without having paired data to train the systems. Typically, methods based on Generative Adversarial Networks (GANs) are used to…

Machine Learning · Computer Science 2024-01-19 Antonio Almudévar , Théo Mariotte , Alfonso Ortega , Marie Tahon

Automatic transfer of text between domains has become popular in recent times. One of its aims is to preserve the semantic content of text being translated from source to target domain. However, it does not explicitly maintain other…

Computation and Language · Computer Science 2022-05-10 Abhinav Ramesh Kashyap , Devamanyu Hazarika , Min-Yen Kan , Roger Zimmermann , Soujanya Poria

Visual Domain Adaptation is a problem of immense importance in computer vision. Previous approaches showcase the inability of even deep neural networks to learn informative representations across domain shift. This problem is more severe…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Swami Sankaranarayanan , Yogesh Balaji , Arpit Jain , Ser Nam Lim , Rama Chellappa

Existing GAN inversion and editing methods work well for aligned objects with a clean background, such as portraits and animal faces, but often struggle for more difficult categories with complex scene layouts and object occlusions, such as…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Gaurav Parmar , Yijun Li , Jingwan Lu , Richard Zhang , Jun-Yan Zhu , Krishna Kumar Singh

We present an unsupervised representation learning approach using videos without semantic labels. We leverage the temporal coherence as a supervisory signal by formulating representation learning as a sequence sorting task. We take…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Hsin-Ying Lee , Jia-Bin Huang , Maneesh Singh , Ming-Hsuan Yang

We consider the problem of translating, in an unsupervised manner, between two domains where one contains some additional information compared to the other. The proposed method disentangles the common and separate parts of these domains…

Computer Vision and Pattern Recognition · Computer Science 2020-01-14 Ron Mokady , Sagie Benaim , Lior Wolf , Amit Bermano

Unsupervised video domain adaptation is a practical yet challenging task. In this work, for the first time, we tackle it from a disentanglement view. Our key idea is to handle the spatial and temporal domain divergence separately through…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Pengfei Wei , Lingdong Kong , Xinghua Qu , Yi Ren , Zhiqiang Xu , Jing Jiang , Xiang Yin

In this paper, we investigate the problem of unpaired video-to-video translation. Given a video in the source domain, we aim to learn the conditional distribution of the corresponding video in the target domain, without seeing any pairs of…

Computer Vision and Pattern Recognition · Computer Science 2019-08-22 Kwanyong Park , Sanghyun Woo , Dahun Kim , Donghyeon Cho , In So Kweon

GAN-based image restoration inverts the generative process to repair images corrupted by known degradations. Existing unsupervised methods must be carefully tuned for each task and degradation level. In this work, we make StyleGAN image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Yohan Poirier-Ginter , Jean-François Lalonde

Training a generative model with limited data (e.g., 10) is a very challenging task. Many works propose to fine-tune a pre-trained GAN model. However, this can easily result in overfitting. In other words, they manage to adapt the style but…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Xiaosheng He , Fan Yang , Fayao Liu , Guosheng Lin

Human behavior understanding in videos is a complex, still unsolved problem and requires to accurately model motion at both the local (pixel-wise dense prediction) and global (aggregation of motion cues) levels. Current approaches based on…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 C. Spampinato , S. Palazzo , P. D'Oro , D. Giordano , M. Shah

We propose a self-supervised learning approach for videos that learns representations of both the RGB frames and the accompanying audio without human supervision. In contrast to images that capture the static scene appearance, videos also…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Simon Jenni , Alexander Black , John Collomosse

Style transfer usually refers to the task of applying color and texture information from a specific style image to a given content image while preserving the structure of the latter. Here we tackle the more generic problem of semantic style…

Computer Vision and Pattern Recognition · Computer Science 2018-07-11 Amélie Royer , Konstantinos Bousmalis , Stephan Gouws , Fred Bertsch , Inbar Mosseri , Forrester Cole , Kevin Murphy

Diffusion-based image translation guided by semantic texts or a single target image has enabled flexible style transfer which is not limited to the specific domains. Unfortunately, due to the stochastic nature of diffusion models, it is…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Gihyun Kwon , Jong Chul Ye

Text style transfer aims to alter the style (e.g., sentiment) of a sentence while preserving its content. A common approach is to map a given sentence to content representation that is free of style, and the content representation is fed to…

Computation and Language · Computer Science 2021-08-03 Dongkyu Lee , Zhiliang Tian , Lanqing Xue , Nevin L. Zhang

Image-to-image translation tasks have been widely investigated with Generative Adversarial Networks (GANs). However, existing approaches are mostly designed in an unsupervised manner while little attention has been paid to domain…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Jianxin Lin , Zhibo Chen , Yingce Xia , Sen Liu , Tao Qin , Jiebo Luo

Learning-based gaze estimation methods require large amounts of training data with accurate gaze annotations. Facing such demanding requirements of gaze data collection and annotation, several image synthesis methods were proposed, which…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Shiwei Jin , Zhen Wang , Lei Wang , Ning Bi , Truong Nguyen

A good representation for arbitrarily complicated data should have the capability of semantic generation, clustering and reconstruction. Previous research has already achieved impressive performance on either one. This paper aims at…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Yuqian Zhou , Kuangxiao Gu , Thomas Huang

We propose a novel method for solving regression tasks using few-shot or weak supervision. At the core of our method is the fundamental observation that GANs are incredibly successful at encoding semantic information within their latent…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Yotam Nitzan , Rinon Gal , Ofir Brenner , Daniel Cohen-Or