English
Related papers

Related papers: Label-Conditioned Next-Frame Video Generation with…

200 papers

Videos express highly structured spatio-temporal patterns of visual data. A video can be thought of as being governed by two factors: (i) temporally invariant (e.g., person identity), or slowly varying (e.g., activity), attribute-induced…

Computer Vision and Pattern Recognition · Computer Science 2018-03-26 Jiawei He , Andreas Lehrmann , Joseph Marino , Greg Mori , Leonid Sigal

We propose a novel approach to image generation by decomposing an image into a structured sequence, where each element in the sequence shares the same spatial resolution but differs in the number of unique tokens used, capturing different…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yikai Wang , Zhouxia Wang , Zhonghua Wu , Qingyi Tao , Kang Liao , Chen Change Loy

Generative adversarial network (GAN) has been shown to be useful in various applications, such as image recognition, text processing and scientific computing, due its strong ability to learn complex data distributions. In this study, a…

Geophysics · Physics 2021-09-14 Tianhao He , Dongxiao Zhang

Graph Neural Networks (GNNs) have garnered considerable interest due to their exceptional performance in a wide range of graph machine learning tasks. Nevertheless, the majority of GNN-based approaches have been examined using…

Machine Learning · Computer Science 2023-09-27 Jingyang Yuan , Xiao Luo , Yifang Qin , Zhengyang Mao , Wei Ju , Ming Zhang

We propose a conditional generative adversarial network (GAN) model for zero-shot video generation. In this study, we have explored zero-shot conditional generation setting. In other words, we generate unseen videos from training samples…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Shun Kimura , Kazuhiko Kawamoto

Flow-based generative models have highly desirable properties like exact log-likelihood evaluation and exact latent-variable inference, however they are still in their infancy and have not received as much attention as alternative…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Albert Pumarola , Stefan Popov , Francesc Moreno-Noguer , Vittorio Ferrari

Generating a 3D point cloud from a single 2D image is of great importance for 3D scene understanding applications. To reconstruct the whole 3D shape of the object shown in the image, the existing deep learning based approaches use either…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yao Wei , George Vosselman , Michael Ying Yang

Audio super-resolution is the task of constructing a high-resolution (HR) audio from a low-resolution (LR) audio by adding the missing band. Previous methods based on convolutional neural networks and mean squared error training objective…

Sound · Computer Science 2021-06-17 Kexun Zhang , Yi Ren , Changliang Xu , Zhou Zhao

Unsupervised video object segmentation (VOS), also known as video salient object detection, aims to detect the most prominent object in a video at the pixel level. Recently, two-stream approaches that leverage both RGB images and optical…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Suhwan Cho , Minhyeok Lee , Jungho Lee , Donghyeong Kim , Seunghoon Lee , Sungmin Woo , Sangyoun Lee

The recent success in StyleGAN demonstrates that pre-trained StyleGAN latent space is useful for realistic video generation. However, the generated motion in the video is usually not semantically meaningful due to the difficulty of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Seung Hyun Lee , Gyeongrok Oh , Wonmin Byeon , Chanyoung Kim , Won Jeong Ryoo , Sang Ho Yoon , Hyunjun Cho , Jihyun Bae , Jinkyu Kim , Sangpil Kim

Sufficient supervised information is crucial for any machine learning models to boost performance. However, labeling data is expensive and sometimes difficult to obtain. Active learning is an approach to acquire annotations for data from a…

Machine Learning · Computer Science 2019-06-18 Quan Kong , Bin Tong , Martin Klinkigt , Yuki Watanabe , Naoto Akira , Tomokazu Murakami

Graph learning research has increasingly shifted toward continual graph learning (CGL), which better reflects real-world scenarios where graphs evolve over time. However, existing CGL methods largely assume clean supervision and overlook a…

Machine Learning · Computer Science 2026-05-12 Danhui Zhang , Zhe Wang , Qing Qing , Jiarui Liu , Wentao Gao , Ziqi Xu , Mingliang Hou , Xikun Zhang , Renqiang Luo

We propose Unbalanced GANs, which pre-trains the generator of the generative adversarial network (GAN) using variational autoencoder (VAE). We guarantee the stable training of the generator by preventing the faster convergence of the…

Machine Learning · Computer Science 2020-02-07 Hyungrok Ham , Tae Joon Jun , Daeyoung Kim

Generative Adversarial Networks (GANs) have shown great promise recently in image generation. Training GANs for language generation has proven to be more difficult, because of the non-differentiable nature of generating text with recurrent…

Computation and Language · Computer Science 2017-12-22 Ofir Press , Amir Bar , Ben Bogin , Jonathan Berant , Lior Wolf

A realistic inflow boundary condition is essential for successful simulation of the developing turbulent boundary layer or channel flows. Recent advances in artificial intelligence (AI) have enabled the development of an inflow generator…

Fluid Dynamics · Physics 2020-02-19 Junhyuk Kim , Changhoon Lee

Contemporary benchmark methods for image inpainting are based on deep generative models and specifically leverage adversarial loss for yielding realistic reconstructions. However, these models cannot be directly applied on image/video…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Avisek Lahiri , Arnav Jain , Prabir Kumar Biswas , Pabitra Mitra

Current video denoising methods perform temporal fusion by designing convolutional neural networks (CNN) or combine spatial denoising with temporal fusion into basic recurrent neural networks (RNNs). However, there have not yet been works…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Kai Guo , Seungwon Choi , Jongseong Choi

We propose in this paper a new paradigm for facial video compression. We leverage the generative capacity of GANs such as StyleGAN to represent and compress a video, including intra and inter compression. Each frame is inverted in the…

Image and Video Processing · Electrical Eng. & Systems 2022-07-14 Mustafa Shukor , Bharath Bhushan Damodaran , Xu Yao , Pierre Hellier

Generating videos predicting the future of a given sequence has been an area of active research in recent years. However, an essential problem remains unsolved: most of the methods require large computational cost and memory usage for…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Naoya Fushishita , Antonio Tejero-de-Pablos , Yusuke Mukuta , Tatsuya Harada

Synthesizing a realistic image from textual description is a major challenge in computer vision. Current text to image synthesis approaches falls short of producing a highresolution image that represent a text descriptor. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Haileleol Tibebu , Aadil Malik , Varuna De Silva