English
Related papers

Related papers: Deep Normalizing Flows for State Estimation

200 papers

Predicting the behavior of a dynamical system from noisy observations of its past outputs is a classical problem encountered across engineering and science. For linear systems with Gaussian inputs, the Kalman filter -- the best linear…

Machine Learning · Computer Science 2026-03-10 Usman Akram , Haris Vikalo

We present a machine-learning approach, based on normalizing flows, for modelling atomic solids. Our model transforms an analytically tractable base distribution into the target solid without requiring ground-truth samples for training. We…

Domain randomization in reinforcement learning is an established technique for increasing the robustness of control policies trained in simulation. By randomizing environment properties during training, the learned policy can become robust…

Designing predictive models for subjective problems in natural language processing (NLP) remains challenging. This is mainly due to its non-deterministic nature and different perceptions of the content by different humans. It may be solved…

Artificial Intelligence · Computer Science 2023-12-12 Piotr Miłkowski , Konrad Karanowski , Patryk Wielopolski , Jan Kocoń , Przemysław Kazienko , Maciej Zięba

The sampling of probability distributions specified up to a normalization constant is an important problem in both machine learning and statistical mechanics. While classical stochastic sampling methods such as Markov Chain Monte Carlo…

Machine Learning · Statistics 2020-10-27 Hao Wu , Jonas Köhler , Frank Noé

Neural network observers (NNOs) are proposed for real-time estimation of fluid flows, addressing a key challenge in flow control: obtaining real-time flow states from a limited set of sparse and noisy sensor data. For this task, we propose…

Fluid Dynamics · Physics 2025-11-06 Tarcísio C. Déda , William R. Wolf , Scott T. M. Dawson , Brener L. O. Ramos

The distribution system state estimation problem seeks to determine the network state from available measurements. Widely used Gauss-Newton approaches are very sensitive to the initialization and often not suitable for real-time estimation.…

Optimization and Control · Mathematics 2019-07-16 Ahmed S. Zamzam , Nicholas D. Sidiropoulos

This notebook tutorial demonstrates a method for sampling Boltzmann distributions of lattice field theories using a class of machine learning models known as normalizing flows. The ideas and approaches proposed in arXiv:1904.12072,…

The simulation of high-energy physics collision events is a key element for data analysis at present and future particle accelerators. The comparison of simulation predictions to data allows looking for rare deviations that can be due to…

High Energy Physics - Experiment · Physics 2024-07-16 Francesco Vaselli , Filippo Cattafesta , Patrick Asenov , Andrea Rizzi

A properly designed controller can help improve the quality of experimental measurements or force a dynamical system to follow a completely new time-evolution path. Recent developments in deep reinforcement learning have made steep advances…

Statistical Mechanics · Physics 2025-02-26 Ruslan Mukhamadiarov

In recent years, a variety of normalization methods have been proposed to help train neural networks, such as batch normalization (BN), layer normalization (LN), weight normalization (WN), group normalization (GN), etc. However,…

Machine Learning · Computer Science 2020-06-17 Jiacheng Sun , Xiangyong Cao , Hanwen Liang , Weiran Huang , Zewei Chen , Zhenguo Li

Inverse medium scattering solvers generally reconstruct a single solution without an associated measure of uncertainty. This is true both for the classical iterative solvers and for the emerging deep learning methods. But ill-posedness and…

Machine Learning · Computer Science 2022-12-12 AmirEhsan Khorashadizadeh , Ali Aghababaei , Tin Vlašić , Hieu Nguyen , Ivan Dokmanić

Generative Flow Networks (GFlowNets) have emerged as an innovative learning paradigm designed to address the challenge of sampling from an unnormalized probability distribution, called the reward function. This framework learns a policy on…

Machine Learning · Computer Science 2024-07-04 Anas Krichel , Nikolay Malkin , Salem Lahlou , Yoshua Bengio

In multiphase flow systems, classifying flow patterns is crucial to optimize fluid dynamics and enhance system efficiency. Current industrial methods and scientific laboratories mainly depend on techniques such as flow visualization using…

Machine Learning · Computer Science 2025-02-27 Nian Ran , Fayez M. Al-Alweet , Richard Allmendinger , Ahmad Almakhlafi

Normalizing flows are a class of probabilistic generative models which allow for both fast density computation and efficient sampling and are effective at modelling complex distributions like images. A drawback among current methods is…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Jason J. Yu , Konstantinos G. Derpanis , Marcus A. Brubaker

Iterative Gaussianization is a fixed-point iteration procedure that can transform any continuous random vector into a Gaussian one. Based on iterative Gaussianization, we propose a new type of normalizing flow model that enables both…

Machine Learning · Computer Science 2020-03-05 Chenlin Meng , Yang Song , Jiaming Song , Stefano Ermon

Many components of data analysis in high energy physics and beyond require morphing one dataset into another. This is commonly solved via reweighting, but there are many advantages of preserving weights and shifting the data points instead.…

High Energy Physics - Phenomenology · Physics 2023-11-22 Tobias Golling , Samuel Klein , Radha Mastandrea , Benjamin Nachman , John Andrew Raine

This paper presents a parameter scan technique for BSM signal models based on normalizing flow. Normalizing flow is a type of deep learning model that transforms a simple probability distribution into a complex probability distribution as…

Data Analysis, Statistics and Probability · Physics 2024-09-23 Masahiko Saito , Masahiro Morinaga , Tomoe Kishimoto , Junichi Tanaka

The precise knowledge regarding the state of the power grid is important in order to ensure optimal and reliable grid operation. Specifically, knowing the state of the distribution grid becomes increasingly important as more renewable…

Systems and Control · Electrical Eng. & Systems 2020-02-18 Jonatan Ostrometzky , Konstantin Berestizshevsky , Andrey Bernstein , Gil Zussman

Normalization techniques are essential for accelerating the training and improving the generalization of deep neural networks (DNNs), and have successfully been used in various applications. This paper reviews and comments on the past,…

Machine Learning · Computer Science 2020-09-29 Lei Huang , Jie Qin , Yi Zhou , Fan Zhu , Li Liu , Ling Shao