English
Related papers

Related papers: The NFLikelihood: an unsupervised DNNLikelihood fr…

200 papers

In this study, we use Rational-Quadratic Neural Spline Flows, a sophisticated parametrization of Normalizing Flows, for inferring posterior probability distributions in scenarios where direct evaluation of the likelihood is challenging at…

Data Analysis, Statistics and Probability · Physics 2024-01-26 Mathias El Baz , Federico Sánchez

The advection of a passive scalar by a quenched (frozen) incompressible velocity field is studied by extensive high precision numerical simulation and various approximation schemes. We show that second order self consistent perturbation…

Disordered Systems and Neural Networks · Physics 2009-10-31 D. S. Dean , I. T. Drummond , R. R. Horgan

Normalizing Flows (NFs) are flexible explicit generative models that have been shown to accurately model complex real-world data distributions. However, their invertibility constraint imposes limitations on data distributions that reside on…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Janis Postels , Martin Danelljan , Luc Van Gool , Federico Tombari

Neural networks (NNs) are inherently multidimensional classifiers that learn complex, non-linear relationships among input observables. While their flexibility enables unprecedented performance in high-energy physics (HEP) analyses, it also…

The normalization constraint on probability density poses a significant challenge for solving the Fokker-Planck equation. Normalizing Flow, an invertible generative model leverages the change of variables formula to ensure probability…

Machine Learning · Computer Science 2023-09-28 Feng Liu , Faguo Wu , Xiao Zhang

In supervised learning, it is known that overparameterized neural networks with one hidden layer provably and efficiently learn and generalize, when trained using stochastic gradient descent with a sufficiently small learning rate and…

Machine Learning · Computer Science 2022-03-24 Kulin Shah , Amit Deshpande , Navin Goyal

We explore the use of autoregressive flows, a type of generative model with tractable likelihood, as a means of efficient generation of physical particle collider events. The usual maximum likelihood loss function is supplemented by an…

High Energy Physics - Phenomenology · Physics 2021-02-17 Bob Stienen , Rob Verheyen

We propose a novel machine learning method for sampling from the high-dimensional probability distributions of Lattice Field Theories, which is based on a single neural ODE layer and incorporates the full symmetries of the problem. We test…

High Energy Physics - Lattice · Physics 2023-12-21 Mathis Gerdes , Pim de Haan , Corrado Rainone , Roberto Bondesan , Miranda C. N. Cheng

The large data rates at the LHC require an online trigger system to select relevant collisions. Rather than compressing individual events, we propose to compress an entire data set at once. We use a normalizing flow as a deep generative…

High Energy Physics - Phenomenology · Physics 2022-10-12 Anja Butter , Sascha Diefenbacher , Gregor Kasieczka , Benjamin Nachman , Tilman Plehn , David Shih , Ramon Winterhalder

Fair representation learning is an attractive approach that promises fairness of downstream predictors by encoding sensitive data. Unfortunately, recent work has shown that strong adversarial predictors can still exhibit unfairness by…

Machine Learning · Computer Science 2022-03-21 Mislav Balunović , Anian Ruoss , Martin Vechev

Normalizing Flows are generative models that directly maximize the likelihood. Previously, the design of normalizing flows was largely constrained by the need for analytical invertibility. We overcome this constraint by a training procedure…

Machine Learning · Computer Science 2024-04-25 Felix Draxler , Peter Sorrenson , Lea Zimmermann , Armand Rousselot , Ullrich Köthe

The two key characteristics of a normalizing flow is that it is invertible (in particular, dimension preserving) and that it monitors the amount by which it changes the likelihood of data points as samples are propagated along the network.…

Machine Learning · Computer Science 2023-01-27 Bálint Máté , Samuel Klein , Tobias Golling , François Fleuret

Normalizing Flows (NFs) are a class of generative models distinguished by a mathematically invertible architecture, where the forward pass transforms data into a latent space for density estimation, and the reverse pass generates new…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Yang Chen , Xiaowei Xu , Shuai Wang , Chenhui Zhu , Ruxue Wen , Xubin Li , Tiezheng Ge , Limin Wang

The Normalizing Flow (NF) models a general probability density by estimating an invertible transformation applied on samples drawn from a known distribution. We introduce a new type of NF, called Deep Diffeomorphic Normalizing Flow (DDNF).…

Machine Learning · Statistics 2018-11-26 Hadi Salman , Payman Yadollahpour , Tom Fletcher , Kayhan Batmanghelich

Normalizing flows are diffeomorphic, typically dimension-preserving, models trained using the likelihood of the model. We use the SurVAE framework to construct dimension reducing surjective flows via a new layer, known as the funnel. We…

Machine Learning · Computer Science 2021-12-16 Samuel Klein , John A. Raine , Sebastian Pina-Otey , Slava Voloshynovskiy , Tobias Golling

In machine learning, likelihood-free inference refers to the task of performing an analysis driven by data instead of an analytical expression. We discuss the application of Neural Spline Flows, a neural density estimation algorithm, to the…

High Energy Physics - Phenomenology · Physics 2020-07-01 Sebastian Pina-Otey , Federico Sánchez , Vicens Gaitan , Thorsten Lux

Normalizing flows model complex probability distributions by combining a base distribution with a series of bijective neural networks. State-of-the-art architectures rely on coupling and autoregressive transformations to lift up invertible…

Machine Learning · Computer Science 2021-02-15 Antoine Wehenkel , Gilles Louppe

Despite their advantages, normalizing flows generally suffer from several shortcomings including their tendency to generate unrealistic data (e.g., images) and their failing to detect out-of-distribution data. One reason for these…

Machine Learning · Statistics 2022-07-13 Florentin Coeurdoux , Nicolas Dobigeon , Pierre Chainais

Exemplar learning is a powerful paradigm for discovering visual similarities in an unsupervised manner. In this context, however, the recent breakthrough in deep learning could not yet unfold its full potential. With only a single positive…

Computer Vision and Pattern Recognition · Computer Science 2016-09-01 Miguel A. Bautista , Artsiom Sanakoyeu , Ekaterina Sutter , Björn Ommer

Unsupervised node representation learning aims to obtain meaningful node embeddings without relying on node labels. To achieve this, graph convolution, which aggregates information from neighboring nodes, is commonly employed to encode node…

Machine Learning · Computer Science 2025-12-18 Sunwoo Kim , Soo Yong Lee , Kyungho Kim , Hyunjin Hwang , Jaemin Yoo , Kijung Shin