English
Related papers

Related papers: Learning normalizing flows from Entropy-Kantorovic…

200 papers

Normalizing flows have arisen as a tool to accelerate Monte Carlo sampling for lattice field theories. This work reviews recent progress in applying normalizing flows to 4-dimensional nonabelian gauge theories, focusing on two advancements:…

High Energy Physics - Lattice · Physics 2025-02-04 Ryan Abbott , Denis Boyda , Daniel C. Hackett , Gurtej Kanwar , Fernando Romero-López , Phiala E. Shanahan , Julian M. Urban

We derive renormalised finite functional flow equations for quantum field theories in real and imaginary time that incorporate scale transformations of the renormalisation conditions, hence implementing a flowing renormalisation. The flows…

We study the training dynamics of a shallow neural network with quadratic activation functions and quadratic cost in a teacher-student setup. In line with previous works on the same neural architecture, the optimization is performed…

Optimization and Control · Mathematics 2023-11-08 Simon Martin , Francis Bach , Giulio Biroli

Normalizing flows have recently demonstrated the ability to learn the Boltzmann distribution of the Hubbard model, opening new avenues for generative modeling in condensed matter physics. In this work, we investigate the steps required to…

Strongly Correlated Electrons · Physics 2026-01-27 Janik Kreit , Andrea Bulgarelli , Lena Funcke , Thomas Luu , Dominic Schuh , Simran Singh , Lorenzo Verzichelli

The recent introduction of Machine Learning techniques, especially Normalizing Flows, for the sampling of lattice gauge theories has shed some hope on improving the sampling efficiency of the traditional Hybrid Monte Carlo (HMC) algorithm.…

High Energy Physics - Lattice · Physics 2023-09-21 David Albandea , Luigi Del Debbio , Pilar Hernández , Richard Kenway , Joe Marsh Rossney , Alberto Ramos

Transformers have achieved state-of-the-art performance in numerous tasks. In this paper, we propose a continuous-time formulation of transformers. Specifically, we consider a dynamical system whose governing equation is parametrized by…

Machine Learning · Computer Science 2025-02-03 Kelvin Kan , Xingjian Li , Stanley Osher

We study the convergence of the derivative expansion for flow equations. The convergence strongly depends on the choice for the infrared regularisation. Based on the structure of the flow, we explain why optimised regulators lead to better…

High Energy Physics - Theory · Physics 2009-11-07 Daniel F. Litim

Training learning parameterizations to solve optimal power flow (OPF) with pointwise constraints is proposed. In this novel training approach, a learning parameterization is substituted directly into an OPF problem with constraints required…

Systems and Control · Electrical Eng. & Systems 2025-10-24 Damian Owerko , Anna Scaglione , Alejandro Ribeiro

In this paper, we propose an approach to effectively accelerating the computation of continuous normalizing flow (CNF), which has been proven to be a powerful tool for the tasks such as variational inference and density estimation. The…

Machine Learning · Computer Science 2021-01-28 Han-Hsien Huang , Mi-Yen Yeh

We study the training dynamics of shallow neural networks, in a two-timescale regime in which the stepsizes for the inner layer are much smaller than those for the outer layer. In this regime, we prove convergence of the gradient flow to a…

Optimization and Control · Mathematics 2023-10-26 Pierre Marion , Raphaël Berthier

We introduce an architecture for neural quantum states for many-body quantum-mechanical systems, based on normalizing flows. The use of normalizing flows enables efficient uncorrelated sampling of configurations from the probability…

Quantum Physics · Physics 2024-06-05 Scott Lawrence , Arlee Shelby , Yukari Yamauchi

We introduce a new stochastic algorithm for solving entropic optimal transport (EOT) between two absolutely continuous probability measures $\mu$ and $\nu$. Our work is motivated by the specific setting of Monge-Kantorovich quantiles where…

Probability · Mathematics 2025-07-29 Bernard Bercu , Jérémie Bigot , Gauthier Thurin

We revisit optimization of functional renormalization group flows by analyzing regularized loop integrals. This leads us to a principle, the Principle of Strongest Singularity, and a corresponding order relation which allows to order…

High Energy Physics - Phenomenology · Physics 2024-10-17 Niklas Zorbach , Jonas Stoll , Jens Braun

A prominent goal of representation learning research is to achieve representations which are factorized in a useful manner with respect to the ground truth factors of variation. The fields of disentangled and equivariant representation…

Machine Learning · Computer Science 2023-09-26 Yue Song , T. Anderson Keller , Nicu Sebe , Max Welling

We develop a mathematical theory of entropic regularisation of unbalanced optimal transport problems. Focusing on static formulation and relying on the formalism developed for the unregularised case, we show that unbalanced optimal…

Optimization and Control · Mathematics 2023-05-05 Maciej Buze , Manh Hong Duong

Unsupervised learning of optical flow, which leverages the supervision from view synthesis, has emerged as a promising alternative to supervised methods. However, the objective of unsupervised learning is likely to be unreliable in…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Liang Liu , Jiangning Zhang , Ruifei He , Yong Liu , Yabiao Wang , Ying Tai , Donghao Luo , Chengjie Wang , Jilin Li , Feiyue Huang

We establish a concrete correspondence between a gradient flow and the renormalization group flow for a generic scalar field theory. We use the exact renormalization group formalism with a particular choice of the cutoff function.

High Energy Physics - Theory · Physics 2019-12-06 Hidenori Sonoda , Hiroshi Suzuki

Stochastic normalizing flows are a class of deep generative models that combine normalizing flows with Monte Carlo updates and can be used in lattice field theory to sample from Boltzmann distributions. In this proceeding, we outline the…

High Energy Physics - Lattice · Physics 2022-10-10 Michele Caselle , Elia Cellini , Alessandro Nada , Marco Panero

Machine learning methods based on normalizing flows have been shown to address important challenges, such as critical slowing-down and topological freezing, in the sampling of gauge field configurations in simple lattice field theories. A…

We propose a general framework for entropy-regularized average-reward reinforcement learning in Markov decision processes (MDPs). Our approach is based on extending the linear-programming formulation of policy optimization in MDPs to…

Machine Learning · Computer Science 2017-05-23 Gergely Neu , Anders Jonsson , Vicenç Gómez