English
Related papers

Related papers: Invertible Generative Modeling using Linear Ration…

200 papers

The traditional approach of hand-crafting priors (such as sparsity) for solving inverse problems is slowly being replaced by the use of richer learned priors (such as those modeled by deep generative networks). In this work, we study the…

Machine Learning · Computer Science 2021-05-14 Viraj Shah , Rakib Hyder , M. Salman Asif , Chinmay Hegde

Normalizing flows are generative models that provide tractable density estimation via an invertible transformation from a simple base distribution to a complex target distribution. However, this technique cannot directly model data…

Machine Learning · Statistics 2021-11-15 Brendan Leigh Ross , Jesse C. Cresswell

Copulas are a powerful tool for modeling multivariate distributions as they allow to separately estimate the univariate marginal distributions and the joint dependency structure. However, known parametric copulas offer limited flexibility…

Machine Learning · Statistics 2021-11-11 Tim Janke , Mohamed Ghanmi , Florian Steinke

Despite recent advances in generative modeling for text-to-speech synthesis, these models do not yet have the same fine-grained adjustability of pitch-conditioned deterministic models such as FastPitch and FastSpeech2. Pitch information is…

Sound · Computer Science 2022-06-28 Kevin J. Shih , Rafael Valle , Rohan Badlani , João Felipe Santos , Bryan Catanzaro

Normalizing flows model complex probability distributions by combining a base distribution with a series of bijective neural networks. State-of-the-art architectures rely on coupling and autoregressive transformations to lift up invertible…

Machine Learning · Computer Science 2021-02-15 Antoine Wehenkel , Gilles Louppe

Whenever invertible generative networks are needed for LHC physics, normalizing flows show excellent performance. In this work, we investigate their performance for fast calorimeter shower simulations with increasing phase space dimension.…

High Energy Physics - Phenomenology · Physics 2025-03-06 Florian Ernst , Luigi Favaro , Claudius Krause , Tilman Plehn , David Shih

In phase retrieval and similar inverse problems, the stability of solutions across different noise levels is crucial for applications. One approach to promote it is using signal priors in a form of a generative model as a regularization, at…

Machine Learning · Statistics 2025-02-04 Selin Aslan , Tristan van Leeuwen , Allard Mosk , Palina Salanevich

Statistical generative models for molecular graphs attract attention from many researchers from the fields of bio- and chemo-informatics. Among these models, invertible flow-based approaches are not fully explored yet. In this paper, we…

Machine Learning · Computer Science 2019-10-01 Shion Honda , Hirotaka Akita , Katsuhiko Ishiguro , Toshiki Nakanishi , Kenta Oono

Efficient gradient computation of the Jacobian determinant term is a core problem in many machine learning settings, and especially so in the normalizing flow framework. Most proposed flow models therefore either restrict to a function…

Machine Learning · Computer Science 2021-06-10 T. Anderson Keller , Jorn W. T. Peters , Priyank Jaini , Emiel Hoogeboom , Patrick Forré , Max Welling

We propose a new way of constructing invertible neural networks by combining simple building blocks with a novel set of composition rules. This leads to a rich set of invertible architectures, including those similar to ResNets. Inversion…

Machine Learning · Computer Science 2019-10-30 Yang Song , Chenlin Meng , Stefano Ermon

The paper introduces a generalization for known probabilistic models such as log-linear and graphical models, called here multiplicative models. These models, that express probabilities via product of parameters are shown to capture…

Artificial Intelligence · Computer Science 2012-06-18 Ydo Wexler , Christopher Meek

Generative models for image generation are now commonly used for a wide variety of applications, ranging from guided image generation for entertainment to solving inverse problems. Nonetheless, training a generator is a non-trivial feat…

Machine Learning · Computer Science 2025-03-07 Eldad Haber , Shadab Ahamed , Md. Shahriar Rahim Siddiqui , Niloufar Zakariaei , Moshe Eliasof

Normalizing Flows are generative models that directly maximize the likelihood. Previously, the design of normalizing flows was largely constrained by the need for analytical invertibility. We overcome this constraint by a training procedure…

Machine Learning · Computer Science 2024-04-25 Felix Draxler , Peter Sorrenson , Lea Zimmermann , Armand Rousselot , Ullrich Köthe

Many application domains, spanning from computational photography to medical imaging, require recovery of high-fidelity images from noisy, incomplete or partial/compressed measurements. State of the art methods for solving these inverse…

Image and Video Processing · Electrical Eng. & Systems 2022-07-13 Xinyi Wei , Hans van Gorp , Lizeth Gonzalez Carabarin , Daniel Freedman , Yonina C. Eldar , Ruud J. G. van Sloun

We introduce graph normalizing flows: a new, reversible graph neural network model for prediction and generation. On supervised tasks, graph normalizing flows perform similarly to message passing neural networks, but at a significantly…

Machine Learning · Computer Science 2019-05-31 Jenny Liu , Aviral Kumar , Jimmy Ba , Jamie Kiros , Kevin Swersky

Fractional processes have gained popularity in financial modeling due to the dependence structure of their increments and the roughness of their sample paths. The non-Markovianity of these processes gives, however, rise to conceptual and…

Mathematical Finance · Quantitative Finance 2018-02-07 Philipp Harms , David Stefanovits

Normalizing Flows (NFs) are a classical family of likelihood-based methods that have received revived attention. Recent efforts such as TARFlow have shown that NFs are capable of achieving promising performance on image modeling tasks,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Tianrong Chen , Jiatao Gu , David Berthelot , Joshua Susskind , Shuangfei Zhai

This paper proposes a new way of regularizing an inverse problem in imaging (e.g., deblurring or inpainting) by means of a deep generative neural network. Compared to end-to-end models, such approaches seem particularly interesting since…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Thomas Oberlin , Mathieu Verm

Flow-based generative modeling is a powerful tool for solving inverse problems in physical sciences that can be used for sampling and likelihood evaluation with much lower inference times than traditional methods. We propose to refine flows…

Machine Learning · Computer Science 2024-10-31 Benjamin Holzschuh , Nils Thuerey

Normalizing flows have emerged as a powerful brand of generative models, as they not only allow for efficient sampling of complicated target distributions but also deliver density estimation by construction. We propose here an in-depth…

Machine Learning · Statistics 2025-08-05 Andrea Coccaro , Marco Letizia , Humberto Reyes-Gonzalez , Riccardo Torre