English
Related papers

Related papers: Label-Conditioned Next-Frame Video Generation with…

200 papers

In recent years, deep neural networks have been utilized in a wide variety of applications including image generation. In particular, generative adversarial networks (GANs) are able to produce highly realistic pictures as part of tasks such…

Image and Video Processing · Electrical Eng. & Systems 2020-04-20 Hyunsuk Ko , Dae Yeol Lee , Seunghyun Cho , Alan C. Bovik

Existing dominant methods for audio generation include Generative Adversarial Networks (GANs) and diffusion-based methods like Flow Matching. GANs suffer from slow convergence during training, while diffusion methods require multi-step…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-10 Zengwei Yao , Wei Kang , Han Zhu , Liyong Guo , Lingxuan Ye , Fangjun Kuang , Weiji Zhuang , Zhaoqing Li , Zhifeng Han , Long Lin , Daniel Povey

Generative Adversarial Networks (GANs) are powerful models able to synthesize data samples closely resembling the distribution of real data, yet the diversity of those generated samples is limited due to the so-called mode collapse…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Jan Dubiński , Kamil Deja , Sandro Wenzel , Przemysław Rokita , Tomasz Trzciński

Flow-based latent generative models such as Stable Diffusion 3 are able to generate images with remarkable quality, even enabling photorealistic text-to-image generation. Their impressive performance suggests that these models should also…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Julius Erbach , Dominik Narnhofer , Andreas Dombos , Bernt Schiele , Jan Eric Lenssen , Konrad Schindler

We consider the task of generating diverse and realistic videos guided by natural audio samples from a wide variety of semantic classes. For this task, the videos are required to be aligned both globally and temporally with the input audio:…

Machine Learning · Computer Science 2023-09-29 Guy Yariv , Itai Gat , Sagie Benaim , Lior Wolf , Idan Schwartz , Yossi Adi

Semantic layouts based Image synthesizing, which has benefited from the success of Generative Adversarial Network (GAN), has drawn much attention in these days. How to enhance the synthesis image equality while keeping the stochasticity of…

Computer Vision and Pattern Recognition · Computer Science 2018-01-11 Ziqiang Zheng , Chao Wang , Zhibin Yu , Haiyong Zheng , Bing Zheng

This work introduces a novel system for the generation of images that contain multiple classes of objects. Recent work in Generative Adversarial Networks have produced high quality images, but many focus on generating images of a single…

Machine Learning · Computer Science 2019-11-11 Elijah D. Bolluyt , Cristina Comaniciu

Conditional image generation has paved the way for several breakthroughs in image editing, generating stock photos and 3-D object generation. This continues to be a significant area of interest with the rise of new state-of-the-art methods…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Vedant Singh , Surgan Jandial , Ayush Chopra , Siddharth Ramesh , Balaji Krishnamurthy , Vineeth N. Balasubramanian

We present Emu Video, a text-to-video generation model that factorizes the generation into two steps: first generating an image conditioned on the text, and then generating a video conditioned on the text and the generated image. We…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Rohit Girdhar , Mannat Singh , Andrew Brown , Quentin Duval , Samaneh Azadi , Sai Saketh Rambhatla , Akbar Shah , Xi Yin , Devi Parikh , Ishan Misra

Generative adversarial networks are the state of the art approach towards learned synthetic image generation. Although early successes were mostly unsupervised, bit by bit, this trend has been superseded by approaches based on labelled…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Ricard Durall , Kalun Ho , Franz-Josef Pfreundt , Janis Keuper

In recent years, research on image generation methods has been developing fast. The auto-encoding variational Bayes method (VAEs) was proposed in 2013, which uses variational inference to learn a latent space from the image database and…

Computer Vision and Pattern Recognition · Computer Science 2018-07-12 Guoqiang Zhong , Wei Gao , Yongbin Liu , Youzhao Yang

Autoregressive models based on Transformers have become the prevailing approach for generating music compositions that exhibit comprehensive musical structure. These models are typically trained by minimizing the negative log-likelihood…

Sound · Computer Science 2023-10-11 Ziyi Jiang , Ruoxue Wu , Zhenghan Chen , Xiaoxuan Liang

We present UniFluid, a unified autoregressive framework for joint visual generation and understanding leveraging continuous visual tokens. Our unified autoregressive architecture processes multimodal image and text inputs, generating…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Lijie Fan , Luming Tang , Siyang Qin , Tianhong Li , Xuan Yang , Siyuan Qiao , Andreas Steiner , Chen Sun , Yuanzhen Li , Tao Zhu , Michael Rubinstein , Michalis Raptis , Deqing Sun , Radu Soricut

We introduce a novel diffusion-based video generation method, generating a video showing multiple events given multiple individual sentences from the user. Our method does not require a large-scale video dataset since our method uses a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Gyeongrok Oh , Jaehwan Jeong , Sieun Kim , Wonmin Byeon , Jinkyu Kim , Sungwoong Kim , Sangpil Kim

Most existing zero-shot learning methods consider the problem as a visual semantic embedding one. Given the demonstrated capability of Generative Adversarial Networks(GANs) to generate images, we instead leverage GANs to imagine unseen…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Yizhe Zhu , Mohamed Elhoseiny , Bingchen Liu , Xi Peng , Ahmed Elgammal

Formulated as a conditional generation problem, face animation aims at synthesizing continuous face images from a single source image driven by a set of conditional face motion. Previous works mainly model the face motion as conditions with…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Xintian Wu , Qihang Zhang , Yiming Wu , Huanyu Wang , Songyuan Li , Lingyun Sun , Xi Li

Visual knowledge bases such as Visual Genome power numerous applications in computer vision, including visual question answering and captioning, but suffer from sparse, incomplete relationships. All scene graph models to date are limited to…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Vincent S. Chen , Paroma Varma , Ranjay Krishna , Michael Bernstein , Christopher Re , Li Fei-Fei

A myriad of recent literary works has leveraged generative adversarial networks (GANs) to generate unseen evasion samples. The purpose is to annex the generated data with the original train set for adversarial training to improve the…

Cryptography and Security · Computer Science 2022-08-09 Rizwan Hamid Randhawa , Nauman Aslam , Mohammad Alauthman , Husnain Rafiq

Extensive studies have demonstrated that deep neural networks (DNNs) are vulnerable to adversarial attacks. Despite the significant progress in the attack success rate that has been made recently, the adversarial noise generated by most of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Renyang Liu , Jinhong Zhang , Haoran Li , Jin Zhang , Yuanyu Wang , Wei Zhou

Recently, several methods based on generative adversarial network (GAN) have been proposed for the task of aligning cross-domain images or learning a joint distribution of cross-domain images. One of the methods is to use conditional GAN…

Computer Vision and Pattern Recognition · Computer Science 2017-07-06 Xudong Mao , Qing Li , Haoran Xie