English
Related papers

Related papers: $\beta$-Variational autoencoders and transformers …

200 papers

Simulating fluid flows in different virtual scenarios is of key importance in engineering applications. However, high-fidelity, full-order models relying, e.g., on the finite element method, are unaffordable whenever fluid flows must be…

Fluid Dynamics · Physics 2021-11-24 Stefania Fresca , Andrea Manzoni

A new deep-learning-based reduced-order modeling (ROM) framework is proposed for application in subsurface flow simulation. The reduced-order model is based on an existing embed-to-control (E2C) framework and includes an auto-encoder, which…

Computational Physics · Physics 2019-06-11 Zhaoyang Larry Jin , Yimin Liu , Louis J. Durlofsky

In recent years Variation Autoencoders have become one of the most popular unsupervised learning of complicated distributions.Variational Autoencoder (VAE) provides more efficient reconstructive performance over a traditional autoencoder.…

Machine Learning · Statistics 2017-07-12 Gautam Ramachandra

Classical methods for model order selection often fail in scenarios with low SNR or few snapshots. Deep learning-based methods are promising alternatives for such challenging situations as they compensate lack of information in the…

Signal Processing · Electrical Eng. & Systems 2023-12-07 Michael Baur , Franz Weißer , Benedikt Böck , Wolfgang Utschick

Developing reduced-order models applicable to fluid-dynamics problems involving complex geometries and different flow conditions remains a critical challenge for turbulent flows. This study introduces VIVALDy, a novel machine-learning…

Given a set of solution snapshots of a hyperbolic PDE, we are interested in learning a reduced order model (ROM). To this end, we propose a novel decompose then learn approach. We decompose the solution by expressing it as a composition of…

Numerical Analysis · Mathematics 2021-09-14 Neeraj Sarna , Peter Benner

We present new intuitions and theoretical assessments of the emergence of disentangled representation in variational autoencoders. Taking a rate-distortion theory perspective, we show the circumstances under which representations aligned…

Analog quantum simulators provide access to many-body dynamics beyond the reach of classical computation. However, extracting physical insights from experimental data is often hindered by measurement noise, limited observables, and…

We investigate the capability of neural network-based model order reduction, i.e., autoencoder (AE), for fluid flows. As an example model, an AE which comprises of a convolutional neural network and multi-layer perceptrons is considered in…

Fluid Dynamics · Physics 2021-12-08 Kai Fukami , Kazuto Hasegawa , Taichi Nakamura , Masaki Morimoto , Koji Fukagata

We propose an algorithm, guided variational autoencoder (Guided-VAE), that is able to learn a controllable generative model by performing latent representation disentanglement learning. The learning objective is achieved by providing…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Zheng Ding , Yifan Xu , Weijian Xu , Gaurav Parmar , Yang Yang , Max Welling , Zhuowen Tu

Variational Autoencoders (VAEs) are powerful generative models widely used for learning interpretable latent spaces, quantifying uncertainty, and compressing data for downstream generative tasks. VAEs typically rely on diagonal Gaussian…

Machine Learning · Computer Science 2025-06-03 Peter Sorrenson , Lukas Lührs , Hans Olischläger , Ullrich Köthe

Unsteady fluid systems are nonlinear high-dimensional dynamical systems that may exhibit multiple complex phenomena both in time and space. Reduced Order Modeling (ROM) of fluid flows has been an active research topic in the recent decade…

Fluid Dynamics · Physics 2020-10-05 Hamidreza Eivazi , Hadi Veisi , Mohammad Hossein Naderi , Vahid Esfahanian

Variational Autoencoders (VAEs) were originally motivated (Kingma & Welling, 2014) as probabilistic generative models in which one performs approximate Bayesian inference. The proposal of $\beta$-VAEs (Higgins et al., 2017) breaks this…

Machine Learning · Statistics 2023-02-10 Tim Z. Xiao , Robert Bamler

Weather prediction is a quintessential problem involving the forecasting of a complex, nonlinear, and chaotic high-dimensional dynamical system. This work introduces an efficient reduced-order modeling (ROM) framework for short-range…

Machine Learning · Computer Science 2025-11-18 Amirpasha Hedayat , Karthik Duraisamy

Reduced order models (ROMs) are computational models whose dimension is significantly lower than those obtained through classical numerical discretizations (e.g., finite element, finite difference, finite volume, or spectral methods). Thus,…

Fluid Dynamics · Physics 2020-12-03 Changhong Mou , Zhu Wang , David R. Wells , Xuping Xie , Traian Iliescu

While the beta-VAE family is aiming to find disentangled representations and acquire human-interpretable generative factors, like what an ICA (from the linear domain) does, we propose Full Encoder, a novel unified autoencoder framework as a…

Machine Learning · Computer Science 2021-07-14 Zhouzheng Li , Kun Feng

Optimization of rotating electrical machines is both time- and computationally expensive. Because of the different parametrization, design optimization is commonly executed separately for each machine technology. In this paper, we present…

Machine Learning · Computer Science 2023-08-25 Vivek Parekh , Dominik Flore , Sebastian Schöps

Variational Auto-Encoders (VAEs) are capable of learning latent representations for high dimensional data. However, due to the i.i.d. assumption, VAEs only optimize the singleton variational distributions and fail to account for the…

Machine Learning · Computer Science 2020-04-20 Da Tang , Dawen Liang , Tony Jebara , Nicholas Ruozzi

An adaptive projection-based reduced-order model (ROM) formulation is presented for model-order reduction of problems featuring chaotic and convection-dominant physics. An efficient method is formulated to adapt the basis at every time-step…

Computational Physics · Physics 2023-08-09 Cheng Huang , Karthik Duraisamy

Kinetic equations are crucial for modeling non-equilibrium phenomena, but their computational complexity is a challenge. This paper presents a data-driven approach using reduced order models (ROM) to efficiently model non-equilibrium flows…

Fluid Dynamics · Physics 2023-10-09 Julian Koellermeier , Philipp Krah , Julius Reiss , Zachary Schellin