English
Related papers

Related papers: Deep Normalizing Flows for State Estimation

200 papers

Normalizing flows are a class of deep generative models that provide a promising route to sample lattice field theories more efficiently than conventional Monte Carlo simulations. In this work we show that the theoretical framework of…

High Energy Physics - Lattice · Physics 2022-07-07 Michele Caselle , Elia Cellini , Alessandro Nada , Marco Panero

Recent work shows that path gradient estimators for normalizing flows have lower variance compared to standard estimators for variational inference, resulting in improved training. However, they are often prohibitively more expensive from a…

Machine Learning · Computer Science 2024-03-26 Lorenz Vaitl , Ludwig Winkler , Lorenz Richter , Pan Kessel

Modeling real-world distributions can often be challenging due to sample data that are subjected to perturbations, e.g., instrumentation errors, or added random noise. Since flow models are typically nonlinear algorithms, they amplify these…

Machine Learning · Computer Science 2022-10-11 Sameera Ramasinghe , Kasun Fernando , Salman Khan , Nick Barnes

In this paper, the problem of state estimation, in the context of both filtering and smoothing, for nonlinear state-space models is considered. Due to the nonlinear nature of the models, the state estimation problem is generally intractable…

Machine Learning · Statistics 2021-11-24 Jarrad Courts , Adrian Wills , Thomas B. Schön

In this thesis, we draw inspiration from both classical system identification and modern machine learning in order to solve estimation problems for real-world, physical systems. The main approach to estimation and learning adopted is…

Machine Learning · Computer Science 2024-09-23 Fredrik Bagge Carlson

We propose an algorithm for taming Normalizing Flow models - changing the probability that the model will produce a specific image or image category. We focus on Normalizing Flows because they can calculate the exact generation probability…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Shimon Malnick , Shai Avidan , Ohad Fried

Randomized value functions offer a promising approach towards the challenge of efficient exploration in complex environments with high dimensional state and action spaces. Unlike traditional point estimate methods, randomized value…

Machine Learning · Computer Science 2019-07-02 Ahmed Touati , Harsh Satija , Joshua Romoff , Joelle Pineau , Pascal Vincent

Normalizing flows are a powerful tool to create flexible probability distributions with a wide range of potential applications in cosmology. Here we are studying normalizing flows which represent cosmological observables at field level,…

Cosmology and Nongalactic Astrophysics · Physics 2021-05-26 Adam Rouhiainen , Utkarsh Giri , Moritz Münchmeyer

We introduce graph normalizing flows: a new, reversible graph neural network model for prediction and generation. On supervised tasks, graph normalizing flows perform similarly to message passing neural networks, but at a significantly…

Machine Learning · Computer Science 2019-05-31 Jenny Liu , Aviral Kumar , Jimmy Ba , Jamie Kiros , Kevin Swersky

A Normalizing Flow computes a bijective mapping from an arbitrary distribution to a predefined (e.g. normal) distribution. Such a flow can be used to address different tasks, e.g. anomaly detection, once such a mapping has been learned. In…

Quantum Physics · Physics 2024-07-23 Bodo Rosenhahn , Christoph Hirche

Building on the recent trend of new deep generative models known as Normalizing Flows (NF), simulation-based inference (SBI) algorithms can now efficiently accommodate arbitrary complex and high-dimensional data distributions. The…

Machine Learning · Statistics 2022-11-28 Julia Linhart , Alexandre Gramfort , Pedro L. C. Rodrigues

We propose a physics-based method to learn environmental fields (EFs) using a mobile robot. Common purely data-driven methods require prohibitively many measurements to accurately learn such complex EFs. Alternatively, physics-based models…

Robotics · Computer Science 2021-01-15 Reza Khodayi-mehr , Michael M. Zavlanos

Fair representation learning is an attractive approach that promises fairness of downstream predictors by encoding sensitive data. Unfortunately, recent work has shown that strong adversarial predictors can still exhibit unfairness by…

Machine Learning · Computer Science 2022-03-21 Mislav Balunović , Anian Ruoss , Martin Vechev

The problem of state estimation for unobservable distribution systems is considered. A deep learning approach to Bayesian state estimation is proposed for real-time applications. The proposed technique consists of distribution learning of…

Machine Learning · Statistics 2019-02-26 Kursat Rasim Mestav , Jaime Luengo-Rozas , Lang Tong

Eliciting a high-dimensional probability distribution from an expert via noisy judgments is notoriously challenging, yet useful for many applications, such as prior elicitation and reward modeling. We introduce a method for eliciting the…

Machine Learning · Computer Science 2024-10-17 Petrus Mikkola , Luigi Acerbi , Arto Klami

This study focuses on the novel application of a normalizing flow as a method of domain adaptation. Normalizing flows offer a way to transform data points between two different distributions. The present study investigates a method of…

Data Analysis, Statistics and Probability · Physics 2024-05-16 Rowan Kelleher , Anselm Vossen

In this work, we investigate the use of normalizing flows to model conditional distributions. In particular, we use our proposed method to analyze inverse problems with invertible neural networks by maximizing the posterior likelihood. Our…

Machine Learning · Computer Science 2019-11-07 Zhisheng Xiao , Qing Yan , Yali Amit

Normalizing flows (NFs) have become a prominent method for deep generative models that allow for an analytic probability density estimation and efficient synthesis. However, a flow-based network is considered to be inefficient in parameter…

Machine Learning · Computer Science 2020-10-26 Sang-gil Lee , Sungwon Kim , Sungroh Yoon

Normalizing flows are a class of generative models that enable exact likelihood evaluation. While these models have already found various applications in particle physics, normalizing flows are not flexible enough to model many of the…

High Energy Physics - Phenomenology · Physics 2022-09-07 Rob Verheyen

This paper investigates the state estimation problem for a class of complex networks, in which the dynamics of each node is subject to Gaussian noise, system uncertainties and nonlinearities. Based on a regularized least-squares approach,…

Systems and Control · Electrical Eng. & Systems 2021-03-16 Peihu Duan , Qishao Wang , Zhisheng Duan , Guanrong Chen