English
Related papers

Related papers: Physics-integrated generative modeling using atten…

200 papers

Deep generative models aim to learn underlying distributions that generate the observed data. Given the fact that the generative distribution may be complex and intractable, deep latent variable models use probabilistic frameworks to learn…

Machine Learning · Computer Science 2021-10-05 Batuhan Koyuncu

We propose a new class of physics-informed neural networks, called Physics-Informed Generator-Encoder Adversarial Networks, to effectively address the challenges posed by forward, inverse, and mixed problems in stochastic differential…

Machine Learning · Computer Science 2023-11-06 Ruisong Gao , Min Yang , Jin Zhang

Lifelong learning is the problem of learning multiple consecutive tasks in a sequential manner, where knowledge gained from previous tasks is retained and used to aid future learning over the lifetime of the learner. It is essential towards…

Machine Learning · Statistics 2020-09-09 Jason Ramapuram , Magda Gregorova , Alexandros Kalousis

We consider the problem of learning Variational Autoencoders (VAEs), i.e., a type of deep generative model, from data with missing values. Such data is omnipresent in real-world applications of machine learning because complete data is…

Machine Learning · Computer Science 2023-10-26 Timur Sudak , Sebastian Tschiatschek

Gray-box models offer significant benefit over black-box approaches for equipment emulator development for equipment since their integration of physics provides more confidence in the model outside of the training domain. However,…

Machine Learning · Computer Science 2023-10-04 Mohamed Kandil , J. J. McArthur

We present a variational autoencoder framework for learning and generating configurations of structured polymer globules from distance matrices. We used coarse-grained molecular dynamics to sample polyethylene structures, which we used as…

Variational Auto-encoders (VAEs) are deep generative latent variable models consisting of two components: a generative model that captures a data distribution p(x) by transforming a distribution p(z) over latent space, and an inference…

Machine Learning · Computer Science 2022-08-25 Yaniv Yacoby , Weiwei Pan , Finale Doshi-Velez

We present a generative modeling approach based on the variational inference framework for likelihood-free simulation-based inference. The method leverages latent variables within variational autoencoders to efficiently estimate complex…

Machine Learning · Computer Science 2025-10-20 Mayank Nautiyal , Andrey Shternshis , Andreas Hellander , Prashant Singh

There has been a lot of recent interest in designing neural network models to estimate a distribution from a set of examples. We introduce a simple modification for autoencoder neural networks that yields powerful generative models. Our…

Machine Learning · Computer Science 2015-06-08 Mathieu Germain , Karol Gregor , Iain Murray , Hugo Larochelle

Generative modeling frameworks have emerged as an effective approach to capture high-dimensional image distributions from large datasets without requiring domain-specific knowledge, a capability essential for longitudinal disease…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Ayantika Das , Arunima Sarkar , Keerthi Ram , Mohanasankar Sivaprakasam

We introduce the variational graph auto-encoder (VGAE), a framework for unsupervised learning on graph-structured data based on the variational auto-encoder (VAE). This model makes use of latent variables and is capable of learning…

Machine Learning · Statistics 2016-11-23 Thomas N. Kipf , Max Welling

Representation learning seeks to expose certain aspects of observed data in a learned representation that's amenable to downstream tasks like classification. For instance, a good representation for 2D images might be one that describes only…

Machine Learning · Computer Science 2017-03-07 Xi Chen , Diederik P. Kingma , Tim Salimans , Yan Duan , Prafulla Dhariwal , John Schulman , Ilya Sutskever , Pieter Abbeel

Data often are formed of multiple modalities, which jointly describe the observed phenomena. Modeling the joint distribution of multimodal data requires larger expressive power to capture high-level concepts and provide better data…

Machine Learning · Computer Science 2020-09-09 Sasho Nedelkoski , Mihail Bogojeski , Odej Kao

Deep generative models are a class of techniques that train deep neural networks to model the distribution of training samples. Research has fragmented into various interconnected approaches, each of which make trade-offs including…

Machine Learning · Computer Science 2022-03-29 Sam Bond-Taylor , Adam Leach , Yang Long , Chris G. Willcocks

Extracting compact, physically interpretable representations from high-dimensional scientific data is a persistent challenge due to the complex, nonlinear structures inherent in physical systems. We propose a Gaussian Mixture Variational…

Machine Learning · Computer Science 2025-12-01 Tiffany Fan , Murray Cutforth , Marta D'Elia , Alexandre Cortiella , Alireza Doostan , Eric Darve

This work presents a formalism to improve the predictive accuracy of physical models by learning generalizable augmentations from sparse data. Building on recent advances in data-driven turbulence modeling, the present approach, referred to…

Fluid Dynamics · Physics 2021-07-28 Vishal Srivastava , Karthik Duraisamy

Well-calibrated traffic flow models are fundamental to understanding traffic phenomena and designing control strategies. Traditional calibration has been developed base on optimization methods. In this paper, we propose a novel…

Machine Learning · Computer Science 2023-07-13 Yu Tang , Li Jin , Kaan Ozbay

We introduce a novel formulation for incorporating visual feedback in controlling robots. We define a generative model from actions to image observations of features on the end-effector. Inference in the model allows us to infer the robot…

The variational autoencoder (VAE; Kingma, Welling (2014)) is a recently proposed generative model pairing a top-down generative network with a bottom-up recognition network which approximates posterior inference. It typically makes strong…

Machine Learning · Computer Science 2016-11-08 Yuri Burda , Roger Grosse , Ruslan Salakhutdinov

In this work we present a hybrid physics-based and data-driven learning approach to construct surrogate models for concurrent multiscale simulations of complex material behavior. We start from robust but inflexible physics-based…

Numerical Analysis · Mathematics 2023-02-01 I. B. C. M. Rocha , P. Kerfriden , F. P. van der Meer