English
Related papers

Related papers: Physics-integrated generative modeling using atten…

200 papers

Autoencoders are neural network formulations where the input and output of the network are identical and the goal is to identify the hidden representation in the provided datasets. Generally, autoencoders project the data nonlinearly onto a…

Signal Processing · Electrical Eng. & Systems 2019-07-10 Debjani Bhowick , Deepak K. Gupta , Saumen Maiti , Uma Shankar

We introduce a generative learning framework to model high-dimensional parametric systems using gradient guidance and virtual observations. We consider systems described by Partial Differential Equations (PDEs) discretized with structured…

Machine Learning · Computer Science 2024-08-02 Han Gao , Sebastian Kaltenbach , Petros Koumoutsakos

As one of the most popular generative models, Variational Autoencoder (VAE) approximates the posterior of latent variables based on amortized variational inference. However, when the decoder network is sufficiently expressive, VAE may lead…

Machine Learning · Computer Science 2021-10-26 Dazhong Shen , Chuan Qin , Chao Wang , Hengshu Zhu , Enhong Chen , Hui Xiong

The Variational Autoencoder (VAE) is a powerful framework for learning probabilistic latent variable generative models. However, typical assumptions on the approximate posterior distribution of the encoder and/or the prior, seriously…

Machine Learning · Computer Science 2020-07-13 Ifigeneia Apostolopoulou , Elan Rosenfeld , Artur Dubrawski

It is crucial to ask how agents can achieve goals by generating action plans using only partial models of the world acquired through habituated sensory-motor experiences. Although many existing robotics studies use a forward model…

Robotics · Computer Science 2020-06-01 Takazumi Matsumoto , Jun Tani

Inference and prediction under partial knowledge of a physical system is challenging, particularly when multiple confounding sources influence the measured response. Explicitly accounting for these influences in physics-based models is…

Machine Learning · Statistics 2026-01-14 Ioannis Christoforos Koune , Alice Cicirello

Recent advances in artificial intelligence have propelled the development of innovative computational materials modeling and design techniques. Generative deep learning models have been used for molecular representation, discovery, and…

Chemical Physics · Physics 2021-02-12 Navid Shervani-Tabar , Nicholas Zabaras

Urban planning designs land-use configurations and can benefit building livable, sustainable, safe communities. Inspired by image generation, deep urban planning aims to leverage deep learning to generate land-use configurations. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Dongjie Wang , Kunpeng Liu , Pauline Johnson , Leilei Sun , Bowen Du , Yanjie Fu

Diffusion models have established themselves as state-of-the-art generative models across various data modalities, including images and videos, due to their ability to accurately approximate complex data distributions. Unlike traditional…

Machine Learning · Computer Science 2025-10-23 Daniel Wesego

In generative modeling, tokenization simplifies complex data into compact, structured representations, creating a more efficient, learnable space. For high-dimensional visual data, it reduces redundancy and emphasizes key features for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Long Zhao , Sanghyun Woo , Ziyu Wan , Yandong Li , Han Zhang , Boqing Gong , Hartwig Adam , Xuhui Jia , Ting Liu

Autoencoders and generative neural network models have recently gained popularity in fluid mechanics due to their spontaneity and low processing time instead of high fidelity CFD simulations. Auto encoders are used as model order reduction…

Fluid Dynamics · Physics 2022-03-04 Kanishk , Tanishk Nandal , Prince Tyagi , Raj Kumar Singh

Recent image generative models typically capture the image distribution in a pre-constructed latent space, relying on a frozen image tokenizer. However, there exists a significant discrepancy between the reconstruction and generation…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Kai Qiu , Xiang Li , Hao Chen , Jason Kuen , Xiaohao Xu , Jiuxiang Gu , Yinyi Luo , Bhiksha Raj , Zhe Lin , Marios Savvides

Variational Autoencoder (VAE)-based generative models offer flexible representation learning by incorporating meta-priors, general premises considered beneficial for downstream tasks. However, the incorporated meta-priors often involve…

Machine Learning · Computer Science 2023-02-27 Nao Nakagawa , Ren Togo , Takahiro Ogawa , Miki Haseyama

We propose a methodology that combines generative latent diffusion models with physics-informed machine learning to generate solutions of parametric partial differential equations (PDEs) conditioned on partial observations, which includes,…

Machine Learning · Computer Science 2026-02-11 Davide Gallon , Philippe von Wurstemberger , Patrick Cheridito , Arnulf Jentzen

Popular generative model learning methods such as Generative Adversarial Networks (GANs), and Variational Autoencoders (VAE) enforce the latent representation to follow simple distributions such as isotropic Gaussian. In this paper, we…

Machine Learning · Computer Science 2018-03-15 Cem Subakan , Oluwasanmi Koyejo , Paris Smaragdis

Voltage prediction in distribution grids is a critical yet difficult task for maintaining power system stability. Machine learning approaches, particularly Graph Neural Networks (GNNs), offer significant speedups but suffer from poor…

Machine Learning · Computer Science 2025-12-09 Ehimare Okoyomon , Arbel Yaniv , Christoph Goebel

As generative technologies advance, visual content has evolved into a complex mix of natural and AI-generated images, driving the need for more efficient coding techniques that prioritize perceptual quality. Traditional codecs and learned…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Jianhui Chang

Deep generative models have been used in recent years to learn coherent latent representations in order to synthesize high-quality images. In this work, we propose a neural network to learn a generative model for sampling consistent indoor…

Computer Vision and Pattern Recognition · Computer Science 2020-08-24 Pulak Purkait , Christopher Zach , Ian Reid

This dissertation attempts to drive innovation in the field of generative modeling for computer vision, by exploring novel formulations of conditional generative models, and innovative applications in images, 3D animations, and video. Our…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Vikram Voleti

Employing a forward diffusion chain to gradually map the data to a noise distribution, diffusion-based generative models learn how to generate the data by inferring a reverse diffusion chain. However, this approach is slow and costly…

Machine Learning · Statistics 2023-09-08 Huangjie Zheng , Pengcheng He , Weizhu Chen , Mingyuan Zhou