English
Related papers

Related papers: Copula-Based Normalizing Flows

200 papers

The normal distribution plays a central role in information theory - it is at the same time the best-case signal and worst-case noise distribution, has the greatest representational capacity of any distribution, and offers an equivalence…

Machine Learning · Computer Science 2025-06-09 Daniel Eftekhari , Vardan Papyan

In this paper, we proposed a multivariate normality test based on copula entropy. The test statistic is defined as the difference between the copula entropies of unknown distribution and the Gaussian distribution with same covariances. The…

Methodology · Statistics 2022-06-14 Jian Ma

Normalizing Flows (NFs) are likelihood-based models for continuous inputs. They have demonstrated promising results on both density estimation and generative modeling tasks, but have received relatively little attention in recent years. In…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Shuangfei Zhai , Ruixiang Zhang , Preetum Nakkiran , David Berthelot , Jiatao Gu , Huangjie Zheng , Tianrong Chen , Miguel Angel Bautista , Navdeep Jaitly , Josh Susskind

Data normalization is crucial in machine learning, usually performed by subtracting the mean and dividing by standard deviation, or by rescaling to a fixed range. In copula theory, popular in finance, there is used normalization to…

Machine Learning · Computer Science 2025-07-21 Jakub Strawa , Jarek Duda

Modern reinforcement learning (RL) algorithms have found success by using powerful probabilistic models, such as transformers, energy-based models, and diffusion/flow-based models. To this end, RL researchers often choose to pay the price…

Machine Learning · Computer Science 2025-06-05 Raj Ghugare , Benjamin Eysenbach

Normalizing flows are objects used for modeling complicated probability density functions, and have attracted considerable interest in recent years. Many flexible families of normalizing flows have been developed. However, the focus to date…

Methodology · Statistics 2023-01-18 Tin Lok James Ng , Andrew Zammit-Mangion

We investigate the use of data-driven likelihoods to bypass a key assumption made in many scientific analyses, which is that the true likelihood of the data is Gaussian. In particular, we suggest using the optimization targets of flow-based…

Cosmology and Nongalactic Astrophysics · Physics 2020-11-11 Ana Diaz Rivero , Cora Dvorkin

We propose an algorithm for taming Normalizing Flow models - changing the probability that the model will produce a specific image or image category. We focus on Normalizing Flows because they can calculate the exact generation probability…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Shimon Malnick , Shai Avidan , Ohad Fried

The distribution function of the sum $Z$ of two standard normally distributed random variables $X$ and $Y$ is computed with the concept of copulas to model the dependency between $X$ and $Y$. By using implicit copulas such as the Gauss- or…

Computation · Statistics 2021-07-02 Walter Schneider

Normalizing Flows are generative models that directly maximize the likelihood. Previously, the design of normalizing flows was largely constrained by the need for analytical invertibility. We overcome this constraint by a training procedure…

Machine Learning · Computer Science 2024-04-25 Felix Draxler , Peter Sorrenson , Lea Zimmermann , Armand Rousselot , Ullrich Köthe

The so-called trivializing flows were proposed to speed up Hybrid Monte Carlo simulations, where the Wilson flow was used as an approximation of a trivializing map, a transformation of the gauge fields which trivializes the theory. It was…

High Energy Physics - Lattice · Physics 2023-10-06 David Albandea , Luigi Del Debbio , Pilar Hernández , Richard Kenway , Joe Marsh Rossney , Alberto Ramos

Continuous normalizing flows are known to be highly expressive and flexible, which allows for easier incorporation of large symmetries and makes them a powerful computational tool for lattice field theories. Building on previous work, we…

High Energy Physics - Lattice · Physics 2025-12-22 Mathis Gerdes , Pim de Haan , Roberto Bondesan , Miranda C. N. Cheng

We propose a new semi-parametric distributional regression smoother that is based on a copula decomposition of the joint distribution of the vector of response values. The copula is high-dimensional and constructed by inversion of a pseudo…

Methodology · Statistics 2020-06-30 Michael Stanley Smith , Nadja Klein

Probability density estimation is a central task in statistics. Copula-based models provide a great deal of flexibility in modelling multivariate distributions, allowing for the specifications of models for the marginal distributions…

Methodology · Statistics 2024-05-08 Nicolás Kuschinski , Richard Warr , Alejandro Jara

We propose a continuous normalizing flow for sampling from the high-dimensional probability distributions of Quantum Field Theories in Physics. In contrast to the deep architectures used so far for this task, our proposal is based on a…

Machine Learning · Computer Science 2021-11-29 Pim de Haan , Corrado Rainone , Miranda C. N. Cheng , Roberto Bondesan

Normalizing flows transform a latent distribution through an invertible neural network for a flexible and pleasingly simple approach to generative modelling, while preserving an exact likelihood. We propose FlowGMM, an end-to-end approach…

Machine Learning · Computer Science 2020-01-01 Pavel Izmailov , Polina Kirichenko , Marc Finzi , Andrew Gordon Wilson

In this work, we investigate the use of normalizing flows to model conditional distributions. In particular, we use our proposed method to analyze inverse problems with invertible neural networks by maximizing the posterior likelihood. Our…

Machine Learning · Computer Science 2019-11-07 Zhisheng Xiao , Qing Yan , Yali Amit

Wavelet transformation stands as a cornerstone in modern data analysis and signal processing. Its mathematical essence is an invertible transformation that discerns slow patterns from fast ones in the frequency domain. Such an invertible…

Machine Learning · Computer Science 2022-01-28 Shuo-Hui Li

Modeling transformations between arbitrary data distributions is a fundamental scientific challenge, arising in applications like drug discovery and evolutionary simulation. While flow matching offers a natural framework for this task, its…

Machine Learning · Computer Science 2025-10-09 Shiye Su , Yuhui Zhang , Linqi Zhou , Rajesh Ranganath , Serena Yeung-Levy

The particle-in-cell numerical method of plasma physics balances a trade-off between computational cost and intrinsic noise. Inference on data produced by these simulations generally consists of binning the data to recover the particle…

Plasma Physics · Physics 2022-02-03 John Donaghy , Kai Germaschewski