中文
相关论文

相关论文: Taming Hyperparameter Tuning in Continuous Normali…

200 篇论文

Modern reinforcement learning (RL) algorithms have found success by using powerful probabilistic models, such as transformers, energy-based models, and diffusion/flow-based models. To this end, RL researchers often choose to pay the price…

机器学习 · 计算机科学 2025-06-05 Raj Ghugare , Benjamin Eysenbach

Despite their popularity, to date, the application of normalizing flows on categorical data stays limited. The current practice of using dequantization to map discrete data to a continuous space is inapplicable as categorical data has no…

机器学习 · 计算机科学 2021-01-22 Phillip Lippe , Efstratios Gavves

Optimal transport (OT) provides effective tools for comparing and mapping probability measures. We propose to leverage the flexibility of neural networks to learn an approximate optimal transport map. More precisely, we present a new and…

机器学习 · 计算机科学 2022-07-06 Florentin Coeurdoux , Nicolas Dobigeon , Pierre Chainais

Fair representation learning is an attractive approach that promises fairness of downstream predictors by encoding sensitive data. Unfortunately, recent work has shown that strong adversarial predictors can still exhibit unfairness by…

机器学习 · 计算机科学 2022-03-21 Mislav Balunović , Anian Ruoss , Martin Vechev

Normalizing flows are constructed from a base distribution with a known density and a diffeomorphism with a tractable Jacobian. The base density of a normalizing flow can be parameterised by a different normalizing flow, thus allowing maps…

机器学习 · 计算机科学 2022-11-07 Samuel Klein , John Andrew Raine , Tobias Golling

Normalizing Flows (NFs) are able to model complicated distributions p(y) with strong inter-dimensional correlations and high multimodality by transforming a simple base density p(z) through an invertible neural network under the change of…

机器学习 · 计算机科学 2023-11-14 Christina Winkler , Daniel Worrall , Emiel Hoogeboom , Max Welling

By chaining a sequence of differentiable invertible transformations, normalizing flows (NF) provide an expressive method of posterior approximation, exact density evaluation, and sampling. The trend in normalizing flow literature has been…

机器学习 · 计算机科学 2020-10-20 Robert Giaquinto , Arindam Banerjee

Flow models have rapidly become the go-to method for training and deploying large-scale generators, owing their success to inference-time flexibility via adjustable integration steps. A crucial ingredient in flow training is the choice of…

Normalizing flows learn a diffeomorphic mapping between the target and base distribution, while the Jacobian determinant of that mapping forms another real-valued function. In this paper, we show that the Jacobian determinant mapping is…

机器学习 · 计算机科学 2021-02-18 Huadong Liao , Jiawei He

Normalizing Flows (NFs) have been established as a principled framework for generative modeling. Standard NFs consist of a forward process and a reverse process: the forward process maps data to noise, while the reverse process generates…

机器学习 · 计算机科学 2025-12-12 Yiyang Lu , Qiao Sun , Xianbang Wang , Zhicheng Jiang , Hanhong Zhao , Kaiming He

The DC optimal power flow (DCOPF) problem is a fundamental problem in power systems operations and planning. With high penetration of uncertain renewable resources in power systems, DCOPF needs to be solved repeatedly for a large amount of…

系统与控制 · 电气工程与系统科学 2020-09-22 Ling Zhang , Yize Chen , Baosen Zhang

Continuous Normalizing Flows (CNFs) have emerged as promising deep generative models for a wide range of tasks thanks to their invertibility and exact likelihood estimation. However, conditioning CNFs on signals of interest for conditional…

机器学习 · 计算机科学 2019-12-10 Tan M. Nguyen , Animesh Garg , Richard G. Baraniuk , Anima Anandkumar

Two fundamental problems in unsupervised learning are efficient inference for latent-variable models and robust density estimation based on large amounts of unlabeled data. Algorithms for the two tasks, such as normalizing flows and…

机器学习 · 统计学 2018-08-02 Changyou Chen , Chunyuan Li , Liqun Chen , Wenlin Wang , Yunchen Pu , Lawrence Carin

Continuous normalizing flows (CNFs) learn an ordinary differential equation to transform prior samples into data. Flow matching (FM) has recently emerged as a simulation-free approach for training CNFs by regressing a velocity model towards…

机器学习 · 统计学 2024-05-28 Tianyu Xie , Yu Zhu , Longlin Yu , Tong Yang , Ziheng Cheng , Shiyue Zhang , Xiangyu Zhang , Cheng Zhang

We propose an algorithm for taming Normalizing Flow models - changing the probability that the model will produce a specific image or image category. We focus on Normalizing Flows because they can calculate the exact generation probability…

计算机视觉与模式识别 · 计算机科学 2023-04-04 Shimon Malnick , Shai Avidan , Ohad Fried

A generative model based on a continuous-time normalizing flow between any pair of base and target probability densities is proposed. The velocity field of this flow is inferred from the probability current of a time-dependent density that…

机器学习 · 计算机科学 2023-03-10 Michael S. Albergo , Eric Vanden-Eijnden

To facilitate reliable deployments of autonomous robots in the real world, Out-of-Distribution (OOD) detection capabilities are often required. A powerful approach for OOD detection is based on density estimation with Normalizing Flows…

机器人学 · 计算机科学 2023-11-14 Jianxiang Feng , Jongseok Lee , Simon Geisler , Stephan Gunnemann , Rudolph Triebel

Normalizing Flows (NFs) learn invertible mappings between the data and a Gaussian distribution. Prior works usually suffer from two limitations. First, they add random noise to training samples or VAE latents as data augmentation,…

计算机视觉与模式识别 · 计算机科学 2025-12-04 Qinyu Zhao , Guangting Zheng , Tao Yang , Rui Zhu , Xingjian Leng , Stephen Gould , Liang Zheng

Through examples of coordinate and probability transformation between different distributions, the basic principle of normalizing flow is introduced in a simple and concise manner. From the perspective of the distribution of random variable…

机器学习 · 计算机科学 2024-01-22 Hongjun Zhang

Wasserstein gradient flow has emerged as a promising approach to solve optimization problems over the space of probability distributions. A recent trend is to use the well-known JKO scheme in combination with input convex neural networks to…

机器学习 · 计算机科学 2022-07-26 Jiaojiao Fan , Qinsheng Zhang , Amirhossein Taghvaei , Yongxin Chen