English
Related papers

Related papers: Label-Conditioned Next-Frame Video Generation with…

200 papers

Technological developments have produced methods that can generate educational videos from input text or sound. Recently, the use of deep learning techniques for image and video generation has been widely explored, particularly in…

Multimedia · Computer Science 2026-01-27 M. E. ElAlami , S. M. Khater , M. El. R. Rehan

This paper proposes a novel model for video generation and especially makes the attempt to deal with the problem of video generation from text descriptions, i.e., synthesizing realistic videos conditioned on given texts. Existing video…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Hongyuan Yu , Yan Huang , Lihong Pi , Liang Wang

The generation and simulation of diverse real-world scenes have significant application value in the field of autonomous driving, especially for the corner cases. Recently, researchers have explored employing neural radiance fields or…

Robotics · Computer Science 2025-03-04 Bin Xie , Yingfei Liu , Tiancai Wang , Jiale Cao , Xiangyu Zhang

While recent machine learning research has revealed connections between deep generative models such as VAEs and rate-distortion losses used in learned compression, most of this work has focused on images. In a similar spirit, we view…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Ruihan Yang , Yibo Yang , Joseph Marino , Stephan Mandt

In this paper we propose WaveGlow: a flow-based network capable of generating high quality speech from mel-spectrograms. WaveGlow combines insights from Glow and WaveNet in order to provide fast, efficient and high-quality audio synthesis,…

Sound · Computer Science 2018-11-02 Ryan Prenger , Rafael Valle , Bryan Catanzaro

Generating molecular graphs is crucial in drug design and discovery but remains challenging due to the complex interdependencies between nodes and edges. While diffusion models have demonstrated their potentiality in molecular graph design,…

Machine Learning · Computer Science 2024-11-11 Xiaoyang Hou , Tian Zhu , Milong Ren , Dongbo Bu , Xin Gao , Chunming Zhang , Shiwei Sun

Normalizing flows (NFs) are end-to-end likelihood-based generative models for continuous data, and have recently regained attention with encouraging progress on image generation. Yet in the video generation domain, where spatiotemporal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Jiatao Gu , Ying Shen , Tianrong Chen , Laurent Dinh , Yuyang Wang , Miguel Angel Bautista , David Berthelot , Josh Susskind , Shuangfei Zhai

Traditional structured prediction models try to learn the conditional likelihood, i.e., p(y|x), to capture the relationship between the structured output y and the input features x. For many models, computing the likelihood is intractable.…

Machine Learning · Computer Science 2020-02-28 You Lu , Bert Huang

In this paper, we propose a model using generative adversarial net (GAN) to generate realistic text. Instead of using standard GAN, we combine variational autoencoder (VAE) with generative adversarial net. The use of high-level latent…

Computation and Language · Computer Science 2018-11-08 Heng Wang , Zengchang Qin , Tao Wan

In this work, we introduce a two-step framework for generative modeling of temporal data. Specifically, the generative adversarial networks (GANs) setting is employed to generate synthetic scenes of moving objects. To do so, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2019-02-01 Isabela Albuquerque , João Monteiro , Tiago H. Falk

Understanding, predicting, and generating object motions and transformations is a core problem in artificial intelligence. Modeling sequences of evolving images may provide better representations and models of motion and may ultimately be…

Computer Vision and Pattern Recognition · Computer Science 2016-12-07 Arnab Ghosh , Viveka Kulharia , Amitabha Mukerjee , Vinay Namboodiri , Mohit Bansal

Building on the success of deep learning, Generative Adversarial Networks (GANs) provide a modern approach to learn a probability distribution from observed samples. GANs are often formulated as a zero-sum game between two sets of…

Machine Learning · Computer Science 2020-09-28 Pirazh Khorramshahi , Hossein Souri , Rama Chellappa , Soheil Feizi

Most of the existing works in video synthesis focus on generating videos using adversarial learning. Despite their success, these methods often require input reference frame or fail to generate diverse videos from the given data…

Image and Video Processing · Electrical Eng. & Systems 2020-04-21 Abhishek Aich , Akash Gupta , Rameswar Panda , Rakib Hyder , M. Salman Asif , Amit K. Roy-Chowdhury

Predicting future frames for a video sequence is a challenging generative modeling task. Promising approaches include probabilistic latent variable models such as the Variational Auto-Encoder. While VAEs can handle uncertainty and model…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Lluis Castrejon , Nicolas Ballas , Aaron Courville

Flow-based data sets are necessary for evaluating network-based intrusion detection systems (NIDS). In this work, we propose a novel methodology for generating realistic flow-based network traffic. Our approach is based on Generative…

Networking and Internet Architecture · Computer Science 2019-03-07 Markus Ring , Daniel Schlör , Dieter Landes , Andreas Hotho

Autonomous agents, such as driverless cars, require large amounts of labeled visual data for their training. A viable approach for acquiring such data is training a generative model with collected real data, and then augmenting the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-08 Moein Sorkhei , Gustav Eje Henter , Hedvig Kjellström

Diffusion based video generation has received extensive attention and achieved considerable success within both the academic and industrial communities. However, current efforts are mainly concentrated on single-objective or single-task…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Ludan Ruan , Lei Tian , Chuanwei Huang , Xu Zhang , Xinyan Xiao

Advances in technology have led to the development of methods that can create desired visual multimedia. In particular, image generation using deep learning has been extensively studied across diverse fields. In comparison, video…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Doyeon Kim , Donggyu Joo , Junmo Kim

Generative modeling aims to transform random noise into structured outputs. In this work, we enhance video diffusion models by allowing motion control via structured latent noise sampling. This is achieved by just a change in data: we…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Ryan Burgert , Yuancheng Xu , Wenqi Xian , Oliver Pilarski , Pascal Clausen , Mingming He , Li Ma , Yitong Deng , Lingxiao Li , Mohsen Mousavi , Michael Ryoo , Paul Debevec , Ning Yu

Current two-stage TTS framework typically integrates an acoustic model with a vocoder -- the acoustic model predicts a low resolution intermediate representation such as Mel-spectrum while the vocoder generates waveform from the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-23 Jian Cong , Shan Yang , Lei Xie , Dan Su