English
Related papers

Related papers: Taming Hyperparameter Tuning in Continuous Normali…

200 papers

Regularized optimal transport (OT) is now increasingly used as a loss or as a matching layer in neural networks. Entropy-regularized OT can be computed using the Sinkhorn algorithm but it leads to fully-dense transportation plans, meaning…

Machine Learning · Statistics 2023-04-17 Tianlin Liu , Joan Puigcerver , Mathieu Blondel

Designing robust algorithms for the optimal power flow (OPF) problem is critical for the control of large-scale power systems under uncertainty. The chance-constrained OPF (CCOPF) problem provides a natural formulation of the trade-off…

Optimization and Control · Mathematics 2025-01-23 Eli Brock , Haixiang Zhang , Javad Lavaei , Somayeh Sojoudi

Existing machine learning methods for causal inference usually estimate quantities expressed via the mean of potential outcomes (e.g., average treatment effect). However, such quantities do not capture the full information about the…

Machine Learning · Computer Science 2023-06-21 Valentyn Melnychuk , Dennis Frauen , Stefan Feuerriegel

Computing optimal transport (OT) for general high-dimensional data has been a long-standing challenge. Despite much progress, most of the efforts including neural network methods have been focused on the static formulation of the OT…

Machine Learning · Statistics 2025-03-12 Chen Xu , Xiuyuan Cheng , Yao Xie

Bayesian posterior inference is prevalent in various machine learning problems. Variational inference provides one way to approximate the posterior distribution, however its expressive power is limited and so is the accuracy of resulting…

Machine Learning · Computer Science 2018-07-11 Guoqing Zheng , Yiming Yang , Jaime Carbonell

Normalizing flows (NFs) provide a powerful tool to construct an expressive distribution by a sequence of trackable transformations of a base distribution and form a probabilistic model of underlying data. Rotation, as an important quantity…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Yulin Liu , Haoran Liu , Yingda Yin , Yang Wang , Baoquan Chen , He Wang

We present a novel generative modeling method called diffusion normalizing flow based on stochastic differential equations (SDEs). The algorithm consists of two neural SDEs: a forward SDE that gradually adds noise to the data to transform…

Machine Learning · Computer Science 2021-10-15 Qinsheng Zhang , Yongxin Chen

Generative models aim to learn the distribution of datasets, such as images, so as to be able to generate samples that statistically resemble real data. However, learning the underlying probability distribution can be very challenging and…

Machine Learning · Computer Science 2024-09-20 Zeyang Yu , Shengxi Li , Danilo Mandic

Out-of-distribution (OOD) detection is a critical task for safe deployment of learning systems in the open world setting. In this work, we investigate the use of feature density estimation via normalizing flows for OOD detection and present…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Evan D. Cook , Marc-Antoine Lavoie , Steven L. Waslander

Flow Matching (FM) method in generative modeling maps arbitrary probability distributions by constructing an interpolation between them and then learning the vector field that defines ODE for this interpolation. Recently, it was shown that…

Machine Learning · Statistics 2025-11-03 Nikita Kornilov , Alexander Korotin

Optimal Power Flow (OPF) is a valuable tool for power system operators, but it is a difficult problem to solve for large systems. Machine Learning (ML) algorithms, especially Neural Networks-based (NN) optimization proxies, have emerged as…

Artificial Intelligence · Computer Science 2024-05-13 Rahul Nellikkath , Mathieu Tanneau , Pascal Van Hentenryck , Spyros Chatzivasileiadis

We introduce a new regularization method for Artificial Neural Networks (ANNs) based on Kernel Flows (KFs). KFs were introduced as a method for kernel selection in regression/kriging based on the minimization of the loss of accuracy…

Machine Learning · Statistics 2021-08-25 Gene Ryan Yoo , Houman Owhadi

This paper introduces temporal-conditioned normalizing flows (tcNF), a novel framework that addresses anomaly detection in time series data with accurate modeling of temporal dependencies and uncertainty. By conditioning normalizing flows…

Machine Learning · Computer Science 2026-03-11 David Baumgartner , Helge Langseth , Kenth Engø-Monsen , Heri Ramampiaro

In this paper we devote our attention to a class of weighted ultrafast diffusion equations arising from the problem of quantisation for probability measures. These equations have a natural gradient flow structure in the space of probability…

Analysis of PDEs · Mathematics 2019-01-30 Mikaela Iacobelli , Francesco Patacchini , Filippo Santambrogio

As a powerful technique in generative modeling, Flow Matching (FM) aims to learn velocity fields from noise to data, which is often explained and implemented as solving Optimal Transport (OT) problems. In this study, we bridge FM and the…

Machine Learning · Computer Science 2025-12-23 Angxiao Yue , Anqi Dong , Hongteng Xu

Optical flow estimation is a fundamental problem in computer vision, yet the reliance on expensive ground-truth annotations limits the scalability of supervised approaches. Although unsupervised and semi-supervised methods alleviate this…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yixuan Luo , Feng Qiao , Zhexiao Xiong , Yanjing Li , Nathan Jacobs

This paper proposes a quasi-optimal power flow (OPF) algorithm for flexible DC traction power systems (TPSs). Near-optimal solutions can be solved with high computational efficiency by the proposed quasi-OPF. Unlike conventional OPF…

Systems and Control · Electrical Eng. & Systems 2022-11-08 Zhanhe Li , Xiaoqian Li , Yingdong Wei , Chao Lu , Xuelian Bai

High percentage penetrations of renewable energy generations introduce significant uncertainty into power systems. It requires grid operators to solve alternative current optimal power flow (AC-OPF) problems more frequently for economical…

Systems and Control · Electrical Eng. & Systems 2022-07-04 Xiang Pan , Minghua Chen , Tianyu Zhao , Steven H. Low

Solving the non-convex optimal power flow (OPF) problem for large-scale power distribution systems is computationally expensive. An alternative is to solve the relaxed convex problem or linear approximated problem, but these methods lead to…

Systems and Control · Electrical Eng. & Systems 2022-11-09 Rabayet Sadnan , Anamika Dubey

In this paper, we propose normalizing flows (NF) as a novel probability density function (PDF) turbulence model (NF-PDF model) for the Reynolds-averaged Navier-Stokes (RANS) equations. We propose to use normalizing flows in two different…

Fluid Dynamics · Physics 2021-01-12 Deniz A. Bezgin , Nikolaus A. Adams