中文
相关论文

相关论文: Video Generation with Predictive Latents

200 篇论文

As one of the most popular generative models, Variational Autoencoder (VAE) approximates the posterior of latent variables based on amortized variational inference. However, when the decoder network is sufficiently expressive, VAE may lead…

机器学习 · 计算机科学 2021-10-26 Dazhong Shen , Chuan Qin , Chao Wang , Hengshu Zhu , Enhong Chen , Hui Xiong

Large climate-model ensembles are computationally expensive; yet many downstream analyses would benefit from additional, statistically consistent realizations of spatiotemporal climate variables. We study a generative modeling approach for…

机器学习 · 计算机科学 2026-01-06 Jacquelyn Shelton , Przemyslaw Polewski , Alexander Robel , Matthew Hoffman , Stephen Price

Variational autoencoders (VAEs) are a popular generative model used to approximate distributions. The encoder part of the VAE is used in amortized learning of latent variables, producing a latent representation for data samples. Recently,…

机器学习 · 统计学 2023-05-12 Daniel G. Edelberg , Roy R. Lederman

A key advance in learning generative models is the use of amortized inference distributions that are jointly trained with the models. We find that existing training objectives for variational autoencoders can lead to inaccurate amortized…

机器学习 · 计算机科学 2018-05-31 Shengjia Zhao , Jiaming Song , Stefano Ermon

Variational Autoencoders (VAEs) are well-established as a principled approach to probabilistic unsupervised learning with neural networks. Typically, an encoder network defines the parameters of a Gaussian distributed latent space from…

机器学习 · 计算机科学 2025-05-16 Alan Jeffares , Liyuan Liu

Generative models serve as powerful tools for modeling the real world, with mainstream diffusion models, particularly those based on the latent diffusion model paradigm, achieving remarkable progress across various tasks, such as image and…

机器学习 · 计算机科学 2025-02-04 Wanghan Xu , Xiaoyu Yue , Zidong Wang , Yao Teng , Wenlong Zhang , Xihui Liu , Luping Zhou , Wanli Ouyang , Lei Bai

Variational autoencoders (VAEs), that are built upon deep neural networks have emerged as popular generative models in computer vision. Most of the work towards improving variational autoencoders has focused mainly on making the…

机器学习 · 统计学 2016-11-17 Siddharth Agrawal , Ambedkar Dukkipati

Variational Autoencoders (VAE) and their variants have been widely used in a variety of applications, such as dialog generation, image generation and disentangled representation learning. However, the existing VAE models have some…

机器学习 · 计算机科学 2020-06-23 Huajie Shao , Shuochao Yao , Dachun Sun , Aston Zhang , Shengzhong Liu , Dongxin Liu , Jun Wang , Tarek Abdelzaher

An implicit goal in works on deep generative models is that such models should be able to generate novel examples that were not previously seen in the training data. In this paper, we investigate to what extent this property holds for…

机器学习 · 计算机科学 2018-12-27 Alican Bozkurt , Babak Esmaeili , Dana H. Brooks , Jennifer G. Dy , Jan-Willem van de Meent

Constructing powerful generative models for natural images is a challenging task. PixelCNN models capture details and local information in images very well but have limited receptive field. Variational autoencoders with a factorial decoder…

计算机视觉与模式识别 · 计算机科学 2019-08-28 Hossein Sadeghi , Evgeny Andriyash , Walter Vinci , Lorenzo Buffoni , Mohammad H. Amin

Recent work leverages Vision Foundation Models as image encoders to boost the generative performance of latent diffusion models (LDMs), as their semantic feature distributions are easy to learn. However, such semantic features often lack…

计算机视觉与模式识别 · 计算机科学 2026-02-10 Siyu Liu , Chujie Qin , Hubery Yin , Qixin Yan , Zheng-Peng Duan , Chen Li , Jing Lyu , Chun-Le Guo , Chongyi Li

Latent diffusion models have established a new state-of-the-art in high-resolution visual generation. Integrating Vision Foundation Model priors improves generative efficiency, yet existing latent designs remain largely heuristic. These…

计算机视觉与模式识别 · 计算机科学 2026-03-13 Hangyu Liu , Jianyong Wang , Yutao Sun

Generative models have been widely applied to world modeling for environment simulation and future state prediction. With advancements in autonomous driving, there is a growing demand not only for high-fidelity video generation under…

计算机视觉与模式识别 · 计算机科学 2025-10-17 Tianrui Zhang , Yichen Liu , Zilin Guo , Yuxin Guo , Jingcheng Ni , Chenjing Ding , Dan Xu , Lewei Lu , Zehuan Wu

Vision-language-action (VLA) models have advanced robot manipulation through large-scale pretraining, but real-world deployment remains challenging due to partial observability and delayed feedback. Reinforcement learning addresses this via…

The unsupervised Pretraining method has been widely used in aiding human action recognition. However, existing methods focus on reconstructing the already present frames rather than generating frames which happen in future.In this paper, We…

计算机视觉与模式识别 · 计算机科学 2017-12-13 Yu Runsheng , Shi Zhenyu , Ma Qiongxiong , Qing Laiyun

The Variational Autoencoder (VAE) is a powerful framework for learning probabilistic latent variable generative models. However, typical assumptions on the approximate posterior distribution of the encoder and/or the prior, seriously…

机器学习 · 计算机科学 2020-07-13 Ifigeneia Apostolopoulou , Elan Rosenfeld , Artur Dubrawski

Variational autoencoders (VAEs) are one of the powerful likelihood-based generative models with applications in many domains. However, they struggle to generate high-quality images, especially when samples are obtained from the prior…

机器学习 · 计算机科学 2021-11-05 Jyoti Aneja , Alexander Schwing , Jan Kautz , Arash Vahdat

Deep probabilistic generative models have achieved incredible success in many fields of application. Among such models, variational autoencoders (VAEs) have proved their ability in modeling a generative process by learning a latent…

机器学习 · 计算机科学 2022-12-16 Eleonora Grassucci , Danilo Comminiello , Aurelio Uncini

Recent advances in Convolutional Neural Network (CNN) model interpretability have led to impressive progress in visualizing and understanding model predictions. In particular, gradient-based visual attention methods have driven much recent…

计算机视觉与模式识别 · 计算机科学 2020-04-15 Wenqian Liu , Runze Li , Meng Zheng , Srikrishna Karanam , Ziyan Wu , Bir Bhanu , Richard J. Radke , Octavia Camps

Variational autoencoders (VAEs), as an important aspect of generative models, have received a lot of research interests and reached many successful applications. However, it is always a challenge to achieve the consistency between the…

机器学习 · 计算机科学 2022-05-10 Xiaoyu Chen , Chen Gong , Qiang He , Xinwen Hou , Yu Liu