English
Related papers

Related papers: Normalisation Control in Deep Inference via Atomic…

200 papers

Ptychography, as an essential tool for high-resolution and nondestructive material characterization, presents a challenging large-scale nonlinear and non-convex inverse problem; however, its intrinsic photon statistics create clear…

Machine Learning · Statistics 2021-11-02 Agnimitra Dasgupta , Zichao Wendy Di

Normalizing flows, a category of probabilistic models famed for their capabilities in modeling complex data distributions, have exhibited remarkable efficacy in unsupervised anomaly detection. This paper explores the potential of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Yixuan Zhou , Xing Xu , Zhe Sun , Jingkuan Song , Andrzej Cichocki , Heng Tao Shen

Normalizing flows provide an elegant approach to generative modeling that allows for efficient sampling and exact density evaluation of unknown data distributions. However, current techniques have significant limitations in their…

Machine Learning · Computer Science 2022-06-22 Sahil Sidheekh , Chris B. Dock , Tushar Jain , Radu Balan , Maneesh K. Singh

I am showing how the ideas behind the renormalisation group can be generalised in order to produce the desired reduction in the degrees of freedom other that the ones considered up to now. Instead of looking only at the renormalisation…

High Energy Physics - Theory · Physics 2024-04-01 Andrei T. Patrascu

Traditional theories of optimization cannot describe the dynamics of optimization in deep learning, even in the simple setting of deterministic training. The challenge is that optimizers typically operate in a complex, oscillatory regime…

Machine Learning · Computer Science 2025-09-26 Jeremy M. Cohen , Alex Damian , Ameet Talwalkar , J. Zico Kolter , Jason D. Lee

Flow-based deep generative models learn data distributions by transforming a simple base distribution into a complex distribution via a set of invertible transformations. Due to the invertibility, such models can score unseen data samples…

Machine Learning · Computer Science 2019-06-18 Maximilian Schmidt , Marko Simic

A normalizing flow models a complex probability density as an invertible transformation of a simple base density. Flows based on either coupling or autoregressive transforms both offer exact density evaluation and sampling, but rely on the…

Machine Learning · Statistics 2019-12-03 Conor Durkan , Artur Bekasov , Iain Murray , George Papamakarios

Normalizing flows are a powerful tool for building expressive distributions in high dimensions. So far, most of the literature has concentrated on learning flows on Euclidean spaces. Some problems however, such as those involving angles,…

Normalizing Flows (NFs) describe a class of models that express a complex target distribution as the composition of a series of bijective transformations over a simpler base distribution. By limiting the space of candidate transformations…

Machine Learning · Computer Science 2023-09-11 Keegan Kelly , Lorena Piedras , Sukrit Rao , David Roth

To overcome topological constraints and improve the expressiveness of normalizing flow architectures, Wu, K\"ohler and No\'e introduced stochastic normalizing flows which combine deterministic, learnable flow transformations with stochastic…

Machine Learning · Computer Science 2022-12-02 Paul Hagemann , Johannes Hertrich , Gabriele Steidl

Given the growth in the variety and precision of astronomical datasets of interest for cosmology, the best cosmological constraints are invariably obtained by combining data from different experiments. At the likelihood level, one…

Cosmology and Nongalactic Astrophysics · Physics 2024-09-04 Arrykrishna Mootoovaloo , Carlos García-García , David Alonso , Jaime Ruiz-Zapatero

This paper presents the first in a series of results that allow us to develop a theory providing finer control over the complexity of normalisation, and in particular of cut elimination. By considering atoms as self-dual non-commutative…

Logic in Computer Science · Computer Science 2022-07-01 Andrea Aler Tubella , Alessio Guglielmi

Normalizing flows are generative models that provide tractable density estimation via an invertible transformation from a simple base distribution to a complex target distribution. However, this technique cannot directly model data…

Machine Learning · Statistics 2021-11-15 Brendan Leigh Ross , Jesse C. Cresswell

Normalizing flows are a class of deep generative models that provide a promising route to sample lattice field theories more efficiently than conventional Monte Carlo simulations. In this work we show that the theoretical framework of…

High Energy Physics - Lattice · Physics 2022-07-07 Michele Caselle , Elia Cellini , Alessandro Nada , Marco Panero

Anomaly detection is a challenging task that frequently arises in practically all areas of industry and science, from fraud detection and data quality monitoring to finding rare cases of diseases and searching for new physics. Most of the…

Machine Learning · Computer Science 2021-11-22 Artem Ryzhikov , Maxim Borisyak , Andrey Ustyuzhanin , Denis Derkach

We introduce and prove basic results about several graph-theoretic notions relevant to the multiresolution analysis of flow graphs that represent the transfer of control in computer programs. We take a category-theoretical viewpoint to…

Combinatorics · Mathematics 2019-06-28 Steve Huntsman

Normalizing flows transform a simple base distribution into a complex target distribution and have proved to be powerful models for data generation and density estimation. In this work, we propose a novel type of normalizing flow driven by…

Machine Learning · Computer Science 2021-07-14 Ruizhi Deng , Bo Chang , Marcus A. Brubaker , Greg Mori , Andreas Lehrmann

Normalizing flows have arisen as a tool to accelerate Monte Carlo sampling for lattice field theories. This work reviews recent progress in applying normalizing flows to 4-dimensional nonabelian gauge theories, focusing on two advancements:…

High Energy Physics - Lattice · Physics 2025-02-04 Ryan Abbott , Denis Boyda , Daniel C. Hackett , Gurtej Kanwar , Fernando Romero-López , Phiala E. Shanahan , Julian M. Urban

We define computational atoms named "actions" equipped primarily with three operations: reduction, collection, and inspection. We show how actions can be used for decision-making algorithms from simple axioms. We describe the encodings of…

Symbolic Computation · Computer Science 2025-01-23 Sotirios Henning

Normalizing flows are a popular class of models for approximating probability distributions. However, their invertible nature limits their ability to model target distributions whose support have a complex topological structure, such as…

Machine Learning · Statistics 2022-02-25 Vincent Stimper , Bernhard Schölkopf , José Miguel Hernández-Lobato