English
Related papers

Related papers: Testing the boundaries: Normalizing Flows for high…

200 papers

The Hamiltonian formalism plays a central role in classical and quantum physics. Hamiltonians are the main tool for modelling the continuous time evolution of systems with conserved quantities, and they come equipped with many useful…

Machine Learning · Computer Science 2020-02-17 Peter Toth , Danilo Jimenez Rezende , Andrew Jaegle , Sébastien Racanière , Aleksandar Botev , Irina Higgins

Normalizing flows, diffusion normalizing flows and variational autoencoders are powerful generative models. This chapter provides a unified framework to handle these approaches via Markov chains. We consider stochastic normalizing flows as…

Machine Learning · Computer Science 2023-02-06 Paul Hagemann , Johannes Hertrich , Gabriele Steidl

We present a framework for learning probability distributions on topologically non-trivial manifolds, utilizing normalizing flows. Current methods focus on manifolds that are homeomorphic to Euclidean space, enforce strong structural priors…

Machine Learning · Computer Science 2022-07-12 Dimitris Kalatzis , Johan Ziruo Ye , Alison Pouplin , Jesper Wohlert , Søren Hauberg

Generative artificial intelligence is now a widely used tool in molecular science. Despite the popularity of probabilistic generative models, numerical experiments benchmarking their performance on molecular data are lacking. In this work,…

Machine Learning · Computer Science 2024-11-15 Richard John , Lukas Herron , Pratyush Tiwary

We are interested in learning generative models for complex geometries described via manifolds, such as spheres, tori, and other implicit surfaces. Current extensions of existing (Euclidean) generative models are restricted to specific…

Machine Learning · Statistics 2021-11-04 Noam Rozen , Aditya Grover , Maximilian Nickel , Yaron Lipman

Graph neural networks (GNNs), which learn the representation of a node by aggregating its neighbors, have become an effective computational tool in downstream applications. Over-smoothing is one of the key issues which limit the performance…

Machine Learning · Computer Science 2020-06-15 Kaixiong Zhou , Xiao Huang , Yuening Li , Daochen Zha , Rui Chen , Xia Hu

Feedforward neural networks (FNNs) are typically viewed as pure prediction algorithms, and their strong predictive performance has led to their use in many machine-learning applications. However, their flexibility comes with an…

Methodology · Statistics 2023-11-15 Andrew McInerney , Kevin Burke

Maximum entropy modeling is a flexible and popular framework for formulating statistical models given partial knowledge. In this paper, rather than the traditional method of optimizing over the continuous density directly, we learn a smooth…

Methodology · Statistics 2017-05-01 Gabriel Loaiza-Ganem , Yuanjun Gao , John P. Cunningham

Systems biology relies on mathematical models that often involve complex and intractable likelihood functions, posing challenges for efficient inference and model selection. Generative models, such as normalizing flows, have shown…

Quantitative Methods · Quantitative Biology 2023-12-06 Vincent D. Zaballa , Elliot E. Hui

Particle accelerators generate charged-particle beams with tailored distributions in six-dimensional position-momentum space (phase space). Knowledge of the phase space distribution enables model-based beam optimization and control. In the…

Accelerator Physics · Physics 2024-08-09 Austin Hoover , Jonathan C. Wong

Normalizing flows are a class of deep generative models that are especially interesting for modeling probability distributions in physics, where the exact likelihood of flows allows reweighting to known target energy functions and computing…

Machine Learning · Statistics 2023-11-27 Leon Klein , Andreas Krämer , Frank Noé

Recent work has shown that Neural Ordinary Differential Equations (ODEs) can serve as generative models of images using the perspective of Continuous Normalizing Flows (CNFs). Such models offer exact likelihood calculation, and invertible…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Vikram Voleti , Chris Finlay , Adam Oberman , Christopher Pal

Studying the dynamics of open quantum systems can enable breakthroughs both in fundamental physics and applications to quantum engineering and quantum computation. Since the density matrix $\rho$, which is the fundamental description for…

Quantum Physics · Physics 2023-06-08 Owen Dugan , Peter Y. Lu , Rumen Dangovski , Di Luo , Marin Soljačić

Identifying the intrinsic coordinates or modes of the dynamical systems is essential to understand, analyze, and characterize the underlying dynamical behaviors of complex systems. For nonlinear dynamical systems, this presents a critical…

Chaotic Dynamics · Physics 2025-01-27 Abdolvahhab Rostamijavanani , Shanwu Li , Yongchao Yang

We consider the problem of density estimation on Riemannian manifolds. Density estimation on manifolds has many applications in fluid-mechanics, optics and plasma physics and it appears often when dealing with angular variables (such as…

Machine Learning · Statistics 2016-11-10 Mevlana C. Gemici , Danilo Rezende , Shakir Mohamed

We introduce ImitationFlow, a novel Deep generative model that allows learning complex globally stable, stochastic, nonlinear dynamics. Our approach extends the Normalizing Flows framework to learn stable Stochastic Differential Equations.…

Machine Learning · Computer Science 2020-10-27 Julen Urain , Michelle Ginesi , Davide Tateo , Jan Peters

Discrete flow-based models are a recently proposed class of generative models that learn invertible transformations for discrete random variables. Since they do not require data dequantization and maximize an exact likelihood objective,…

Machine Learning · Computer Science 2021-07-27 Alexandra Lindt , Emiel Hoogeboom

Normalizing flows are invertible neural networks with tractable change-of-volume terms, which allow optimization of their parameters to be efficiently performed via maximum likelihood. However, data of interest are typically assumed to live…

Machine Learning · Statistics 2021-11-04 Anthony L. Caterini , Gabriel Loaiza-Ganem , Geoff Pleiss , John P. Cunningham

Deep generative frameworks including GANs and normalizing flow models have proven successful at filling in missing values in partially observed data samples by effectively learning -- either explicitly or implicitly -- complex,…

Machine Learning · Computer Science 2021-04-06 Edgar A. Bernal

Continuous Normalizing Flows (CNFs) enable elegant generative modeling but remain bottlenecked by slow sampling: producing a single sample requires solving a nonlinear ODE with hundreds of function evaluations. Recent approaches such as…

Machine Learning · Computer Science 2025-10-23 Erkan Turan , Aristotelis Siozopoulos , Louis Martinez , Julien Gaubil , Emery Pierson , Maks Ovsjanikov