English
Related papers

Related papers: Taming Normalizing Flows

200 papers

Understanding the dynamics of complex molecular processes is often linked to the study of infrequent transitions between long-lived stable states. The standard approach to the sampling of such rare events is to generate an ensemble of…

Computational Physics · Physics 2023-05-22 Sebastian Falkner , Alessandro Coretti , Salvatore Romano , Phillip Geissler , Christoph Dellago

We propose Generative Probabilistic Image Colorization, a diffusion-based generative process that trains a sequence of probabilistic models to reverse each step of noise corruption. Given a line-drawing image as input, our method suggests…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Chie Furusawa , Shinya Kitaoka , Michael Li , Yuri Odagiri

Point cloud upsampling aims to generate dense point clouds from given sparse ones, which is a challenging task due to the irregular and unordered nature of point sets. To address this issue, we present a novel deep learning-based model,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Aihua Mao , Zihui Du , Junhui Hou , Yaqi Duan , Yong-jin Liu , Ying He

Standard diffusion models involve an image transform -- adding Gaussian noise -- and an image restoration operator that inverts this degradation. We observe that the generative behavior of diffusion models is not strongly dependent on the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Arpit Bansal , Eitan Borgnia , Hong-Min Chu , Jie S. Li , Hamid Kazemi , Furong Huang , Micah Goldblum , Jonas Geiping , Tom Goldstein

Normalizing flows have received a great deal of recent attention as they allow flexible generative modeling as well as easy likelihood computation. While a wide variety of flow models have been proposed, there is little formal understanding…

Machine Learning · Computer Science 2020-06-02 Zhifeng Kong , Kamalika Chaudhuri

It is well known that deep generative models have a rich latent space, and that it is possible to smoothly manipulate their outputs by traversing this latent space. Recently, architectures have emerged that allow for more complex…

Machine Learning · Computer Science 2019-12-06 Andrew Gambardella , Atılım Güneş Baydin , Philip H. S. Torr

Survival analysis, or time-to-event modelling, is a classical statistical problem that has garnered a lot of interest for its practical use in epidemiology, demographics or actuarial sciences. Recent advances on the subject from the point…

Machine Learning · Computer Science 2021-07-28 Guillaume Ausset , Tom Ciffreo , Francois Portier , Stephan Clémençon , Timothée Papin

A popular approach to decrease the need for costly manual annotation of large data sets is weak supervision, which introduces problems of noisy labels, coverage and bias. Methods for overcoming these problems have either relied on…

Computation and Language · Computer Science 2022-05-03 Andreas Stephan , Benjamin Roth

Pose-guided person image generation is to transform a source person image to a target pose. This task requires spatial manipulations of source data. However, Convolutional Neural Networks are limited by the lack of ability to spatially…

Computer Vision and Pattern Recognition · Computer Science 2020-03-19 Yurui Ren , Xiaoming Yu , Junming Chen , Thomas H. Li , Ge Li

Flow-based generative models are composed of invertible transformations between two random variables of the same dimension. Therefore, flow-based models cannot be adequately trained if the dimension of the data distribution does not match…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Hyeongju Kim , Hyeonseung Lee , Woo Hyun Kang , Joun Yeop Lee , Nam Soo Kim

Modern methods for counting people in crowded scenes rely on deep networks to estimate people densities in individual images. As such, only very few take advantage of temporal consistency in video sequences, and those that do only impose…

Computer Vision and Pattern Recognition · Computer Science 2021-08-04 Weizhe Liu , Mathieu Salzmann , Pascal Fua

Modeling and synthesizing image noise is an important aspect in many computer vision applications. The long-standing additive white Gaussian and heteroscedastic (signal-dependent) noise models widely used in the literature provide only a…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Abdelrahman Abdelhamed , Marcus A. Brubaker , Michael S. Brown

Normalizing Flows explicitly maximize a full-dimensional likelihood on the training data. However, real data is typically only supported on a lower-dimensional manifold leading the model to expend significant compute on modeling noise.…

Machine Learning · Computer Science 2024-06-28 Peter Sorrenson , Felix Draxler , Armand Rousselot , Sander Hummerich , Lea Zimmermann , Ullrich Köthe

The two key characteristics of a normalizing flow is that it is invertible (in particular, dimension preserving) and that it monitors the amount by which it changes the likelihood of data points as samples are propagated along the network.…

Machine Learning · Computer Science 2023-01-27 Bálint Máté , Samuel Klein , Tobias Golling , François Fleuret

Underwater images suffer from light refraction and absorption, which impairs visibility and interferes the subsequent applications. Existing underwater image enhancement methods mainly focus on image quality improvement, ignoring the effect…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Zengxi Zhang , Zhiying Jiang , Jinyuan Liu , Xin Fan , Risheng Liu

Recently, there has been a surge of interest in incorporating neural networks into particle filters, e.g. differentiable particle filters, to perform joint sequential state estimation and model learning for non-linear non-Gaussian…

Machine Learning · Computer Science 2025-01-07 Xiongjie Chen , Yunpeng Li

We introduce a new paradigm for generative modeling built on Continuous Normalizing Flows (CNFs), allowing us to train CNFs at unprecedented scale. Specifically, we present the notion of Flow Matching (FM), a simulation-free approach for…

Machine Learning · Computer Science 2023-02-09 Yaron Lipman , Ricky T. Q. Chen , Heli Ben-Hamu , Maximilian Nickel , Matt Le

Flow models have rapidly become the go-to method for training and deploying large-scale generators, owing their success to inference-time flexibility via adjustable integration steps. A crucial ingredient in flow training is the choice of…

The large data rates at the LHC require an online trigger system to select relevant collisions. Rather than compressing individual events, we propose to compress an entire data set at once. We use a normalizing flow as a deep generative…

High Energy Physics - Phenomenology · Physics 2022-10-12 Anja Butter , Sascha Diefenbacher , Gregor Kasieczka , Benjamin Nachman , Tilman Plehn , David Shih , Ramon Winterhalder

Conditional diffusion probabilistic models can model the distribution of natural images and can generate diverse and realistic samples based on given conditions. However, oftentimes their results can be unrealistic with observable color…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Kangfu Mei , Nithin Gopalakrishnan Nair , Vishal M. Patel