English
Related papers

Related papers: Unsupervised Video-to-Video Translation

200 papers

In this paper, we offer a preliminary investigation into the task of in-image machine translation: transforming an image containing text in one language into an image containing the same text in another language. We propose an end-to-end…

Computation and Language · Computer Science 2020-10-22 Elman Mansimov , Mitchell Stern , Mia Chen , Orhan Firat , Jakob Uszkoreit , Puneet Jain

Humans can envision a realistic photo given a free-hand sketch that is not only spatially imprecise and geometrically distorted but also without colors and visual details. We study unsupervised sketch-to-photo synthesis for the first time,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Runtao Liu , Qian Yu , Stella Yu

Unsupervised machine translation (MT) has recently achieved impressive results with monolingual corpora only. However, it is still challenging to associate source-target sentences in the latent space. As people speak different languages…

Computation and Language · Computer Science 2020-05-08 Po-Yao Huang , Junjie Hu , Xiaojun Chang , Alexander Hauptmann

Current image-to-image translation methods formulate the task with conditional generation models, leading to learning only the recolorization or regional changes as being constrained by the rich structural information provided by the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Yu-Jie Chen , Shin-I Cheng , Wei-Chen Chiu , Hung-Yu Tseng , Hsin-Ying Lee

We treat the problem of color enhancement as an image translation task, which we tackle using both supervised and unsupervised learning. Unlike traditional image to image generators, our translation is performed using a global parameterized…

Computer Vision and Pattern Recognition · Computer Science 2020-01-17 Yoav Chai , Raja Giryes , Lior Wolf

In this paper, we tackle the problem of video alignment, the process of matching the frames of a pair of videos containing similar actions. The main challenge in video alignment is that accurate correspondence should be established despite…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Niloufar Fakhfour , Mohammad ShahverdiKondori , Sajjad Hashembeiki , Mohammadjavad Norouzi , Hoda Mohammadzade

Unsupervised image-to-image translation is an inherently ill-posed problem. Recent methods based on deep encoder-decoder architectures have shown impressive results, but we show that they only succeed due to a strong locality bias, and they…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Eitan Richardson , Yair Weiss

Video-to-video translation is more difficult than image-to-image translation due to the temporal consistency problem that, if unaddressed, leads to distracting flickering effects. Although video models designed from scratch produce…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Ryan Szeto , Mostafa El-Khamy , Jungwon Lee , Jason J. Corso

This paper introduces a novel method for self-supervised video representation learning via feature prediction. In contrast to the previous methods that focus on future feature prediction, we argue that a supervisory signal arising from…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Nadine Behrmann , Juergen Gall , Mehdi Noroozi

Scarcity of labeled data has motivated the development of semi-supervised learning methods, which learn from large portions of unlabeled data alongside a few labeled samples. Consistency Regularization between model's predictions under…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Aamir Mustafa , Rafal K. Mantiuk

The recent success in human action recognition with deep learning methods mostly adopt the supervised learning paradigm, which requires significant amount of manually labeled data to achieve good performance. However, label collection is an…

Computer Vision and Pattern Recognition · Computer Science 2018-09-07 Junnan Li , Yongkang Wong , Qi Zhao , Mohan S. Kankanhalli

Sequential video understanding, as an emerging video understanding task, has driven lots of researchers' attention because of its goal-oriented nature. This paper studies weakly supervised sequential video understanding where the accurate…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Sixun Dong , Huazhang Hu , Dongze Lian , Weixin Luo , Yicheng Qian , Shenghua Gao

Understanding the 3D world without supervision is currently a major challenge in computer vision as the annotations required to supervise deep networks for tasks in this domain are expensive to obtain on a large scale. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Octave Mariotti , Oisin Mac Aodha , Hakan Bilen

Unsupervised Image-to-Image Translation achieves spectacularly advanced developments nowadays. However, recent approaches mainly focus on one model with two domains, which may face heavy burdens with large cost of $O(n^2)$ training time and…

Computer Vision and Pattern Recognition · Computer Science 2017-12-07 Le Hui , Xiang Li , Jiaxin Chen , Hongliang He , Chen gong , Jian Yang

Unsupervised image-to-image translation intends to learn a mapping of an image in a given domain to an analogous image in a different domain, without explicit supervision of the mapping. Few-shot unsupervised image-to-image translation…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Kuniaki Saito , Kate Saenko , Ming-Yu Liu

Unsupervised Domain Adaptation (UDA) aims to adapt models trained on a source domain to a new target domain where no labelled data is available. In this work, we investigate the problem of UDA from a synthetic computer-generated domain to a…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Stephan Brehm , Sebastian Scherer , Rainer Lienhart

The recent advances in deep learning have made it possible to generate photo-realistic images by using neural networks and even to extrapolate video frames from an input video clip. In this paper, for the sake of both furthering this…

Computer Vision and Pattern Recognition · Computer Science 2018-08-10 Lijie Fan , Wenbing Huang , Chuang Gan , Junzhou Huang , Boqing Gong

Unsupervised learning poses one of the most difficult challenges in computer vision today. The task has an immense practical value with many applications in artificial intelligence and emerging technologies, as large quantities of unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Ioana Croitoru , Simion-Vlad Bogolin , Marius Leordeanu

Unpaired Image-to-image Translation is a new rising and challenging vision problem that aims to learn a mapping between unaligned image pairs in diverse domains. Recent advances in this field like MUNIT and DRIT mainly focus on…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Zhiqiang Shen , Mingyang Huang , Jianping Shi , Xiangyang Xue , Thomas Huang

This paper proposes a novel pretext task to address the self-supervised video representation learning problem. Specifically, given an unlabeled video clip, we compute a series of spatio-temporal statistical summaries, such as the spatial…

Computer Vision and Pattern Recognition · Computer Science 2021-02-01 Jiangliu Wang , Jianbo Jiao , Linchao Bao , Shengfeng He , Wei Liu , Yun-hui Liu