English
Related papers

Related papers: Deep Learning Moment Closure Approximations using …

200 papers

Phase-averaged dilute bubbly flow models require high-order statistical moments of the bubble population. The method of classes, which directly evolve bins of bubbles in the probability space, are accurate but computationally expensive.…

Approximate solutions of the chemical master equation and the chemical Fokker-Planck equation are an important tool in the analysis of biomolecular reaction networks. Previous studies have highlighted a number of problems with the…

Quantitative Methods · Quantitative Biology 2018-05-22 Leo Bronstein , Heinz Koeppl

We present an efficient classical algorithm for training deep Boltzmann machines (DBMs) that uses rejection sampling in concert with variational approximations to estimate the gradients of the training objective function. Our algorithm is…

Machine Learning · Computer Science 2015-07-10 Nathan Wiebe , Ashish Kapoor , Christopher Granade , Krysta M Svore

To close the moment model deduced from kinetic equations, the canonical approach is to provide an approximation to the flux function not able to be depicted by the moments in the reduced model. In this paper, we propose a brand new closure…

Computational Physics · Physics 2021-02-16 Ruo Li , Weiming Li , Lingchao Zheng

In this work we explore the possibility of learning from data collision operators for the Lattice Boltzmann Method using a deep learning approach. We compare a hierarchy of designs of the neural network (NN) collision operator and evaluate…

Computational Physics · Physics 2023-03-09 Alessandro Corbetta , Alessandro Gabbana , Vitaliy Gyrya , Daniel Livescu , Joost Prins , Federico Toschi

We introduce a machine learning framework for moment-equation modeling of rarefied gas flows, addressing strongly non-equilibrium conditions inaccessible to conventional computational fluid dynamics. Our approach utilizes high-order moments…

Fluid Dynamics · Physics 2025-11-04 Hang Song , Satyvir Singh , Manuel Torrilhon , Semih Cayci

We build on the dynamical systems approach to deep learning, where deep residual networks are idealized as continuous-time dynamical systems, from the approximation perspective. In particular, we establish general sufficient conditions for…

Machine Learning · Computer Science 2020-06-09 Qianxiao Li , Ting Lin , Zuowei Shen

The Chemical Master Equation (CME) is used to stochastically model biochemical reaction networks, under the Markovian assumption. The low-order statistical moments induced by the CME are often the key quantities that one is interested in.…

Systems and Control · Computer Science 2017-07-04 Mohammad Naghnaeian , Domitilla Del Vecchio

Moment closure methods are widely used to analyze mathematical models. They are specifically geared toward derivation of approximations of moments of stochastic models, and of similar quantities in other models. The methods possess several…

Probability · Mathematics 2017-07-12 Ingemar Nåsell

We present a deep learning model, DE-LSTM, for the simulation of a stochastic process with an underlying nonlinear dynamics. The deep learning model aims to approximate the probability density function of a stochastic process via numerical…

Computational Physics · Physics 2018-10-23 Kyongmin Yeo , Igor Melnyk

Quadrature-based moment-closure methods are a class of approximations that replace high-dimensional kinetic descriptions with lower-dimensional fluid models. In this work we investigate some of the properties of a sub-class of these methods…

Numerical Analysis · Mathematics 2013-10-17 Yongtao Cheng , James A. Rossmanith

We present a data-driven approach to construct entropy-based closures for the moment system from kinetic equations. The proposed closure learns the entropy function by fitting the map between the moments and the entropy of the moment…

Numerical Analysis · Mathematics 2021-06-17 William A. Porteous , M. Paul Laiu , Cory D. Hauck

Boltzmann machines are undirected graphical models with two-state stochastic variables, in which the logarithms of the clique potentials are quadratic functions of the node states. They have been widely studied in the neural computing…

Machine Learning · Computer Science 2013-02-01 Neil D. Lawrence , Christopher M. Bishop , Michael I. Jordan

The goal of metric learning is to learn a function that maps samples to a lower-dimensional space where similar samples lie closer than dissimilar ones. Particularly, deep metric learning utilizes neural networks to learn such a mapping.…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Jenny Seidenschwarz , Ismail Elezi , Laura Leal-Taixé

We present a general method for fitting finite mixture models (FMM). Learning in a mixture model consists of finding the most likely cluster assignment for each data-point, as well as finding the parameters of the clusters themselves. In…

Machine Learning · Statistics 2019-12-20 Mathias Edman , Neil Dhir

The learning of domain-invariant representations in the context of domain adaptation with neural networks is considered. We propose a new regularization method that minimizes the discrepancy between domain-specific latent feature…

We present a deep learning approach for computing multi-phase solutions to the semiclassical limit of the Schr\"odinger equation. Traditional methods require deriving a multi-phase ansatz to close the moment system of the Liouville…

Numerical Analysis · Mathematics 2025-04-14 Jin Woo Jang , Jae Yong Lee , Liu Liu , Zhenyi Zhu

Dose volume histogram (DVH) metrics are widely accepted evaluation criteria in the clinic. However, incorporating these metrics into deep learning dose prediction models is challenging due to their non-convexity and non-differentiability.…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Gourav Jhanwar , Navdeep Dahiya , Parmida Ghahremani , Masoud Zarepisheh , Saad Nadeem

Deep Learning has the hierarchical network architecture to represent the complicated features of input patterns. Such architecture is well known to represent higher learning capability compared with some conventional models if the best set…

Neural and Evolutionary Computing · Computer Science 2018-07-12 Takumi Ichimura , Shin Kamada

Discriminative deep learning models with a linear+softmax final layer have a problem: the latent space only predicts the conditional probabilities $p(Y|X)$ but not the full joint distribution $p(Y,X)$, which necessitates a generative…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Michael Majurski , Sumeet Menon , Parniyan Farvardin , David Chapman