English
Related papers

Related papers: Convex Potential Flows: Universal Probability Dist…

200 papers

In this paper, we derive a number of interesting properties and extensions of the convex flow problem from the perspective of convex geometry. We show that the sets of allowable flows always can be imbued with a downward closure property,…

Optimization and Control · Mathematics 2024-08-26 Theo Diamandis , Guillermo Angeris

Shape optimization with constraints given by partial differential equations (PDE) is a highly developed field of optimization theory. The elegant adjoint formalism allows to compute shape gradients at the computational cost of a further PDE…

Optimization and Control · Mathematics 2023-03-03 Matthias Bolten , Onur Tanil Doganay , Hanno Gottschalk , Kathrin Klamroth

Nonconvexity induced by the nonlinear AC power flow equations challenges solution algorithms for AC optimal power flow (OPF) problems. While significant research efforts have focused on reliably computing high-quality OPF solutions, it is…

Optimization and Control · Mathematics 2020-02-18 Dongchan Lee , Konstantin Turitsyn , Daniel K. Molzahn , Line A. Roald

We study the convergence of gradient flow for the training of deep neural networks. If Residual Neural Networks are a popular example of very deep architectures, their training constitutes a challenging optimization problem due notably to…

Machine Learning · Computer Science 2025-07-22 Raphaël Barboni , Gabriel Peyré , François-Xavier Vialard

Optimal power flow (OPF) is an important problem for power generation and it is in general non-convex. With the employment of renewable energy, it will be desirable if OPF can be solved very efficiently so its solution can be used in real…

Optimization and Control · Mathematics 2011-09-27 Albert Y. S. Lam , Baosen Zhang , David Tse

Understanding the dependencies among features of a dataset is at the core of most unsupervised learning tasks. However, a majority of generative modeling approaches are focused solely on the joint distribution $p(x)$ and utilize models…

Machine Learning · Computer Science 2020-08-07 Yang Li , Shoaib Akbar , Junier B. Oliva

Convex relaxations of the AC Optimal Power Flow (OPF) problem are essential not only for identifying the globally optimal solution but also for enabling the use of OPF formulations in Bilevel Programming and Mathematical Programs with…

Optimization and Control · Mathematics 2020-06-23 Lucien Bobo , Andreas Venzke , Spyros Chatzivasileiadis

Flow-based generative models (Dinh et al., 2014) are conceptually attractive due to tractability of the exact log-likelihood, tractability of exact latent-variable inference, and parallelizability of both training and synthesis. In this…

Machine Learning · Statistics 2018-07-11 Diederik P. Kingma , Prafulla Dhariwal

The thesis focuses on developing a data-driven algorithm, based on machine learning, to solve the stochastic alternating current (AC) chance-constrained (CC) Optimal Power Flow (OPF) problem. Although the AC CC-OPF problem has been…

Machine Learning · Computer Science 2024-02-20 Mile Mitrovic

Uncertainty often plays an important role in dynamic flow problems. In this paper, we consider both, a stationary and a dynamic flow model with uncertain boundary data on networks. We introduce two different ways how to compute the…

Numerical Analysis · Mathematics 2021-04-28 Michael Schuster , Elisa Strauch , Martin Gugat , Jens Lang

In this paper, we propose a convolutional layer inspired by optical flow algorithms to learn motion representations. Our representation flow layer is a fully-differentiable layer designed to capture the `flow' of any representation channel…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 AJ Piergiovanni , Michael S. Ryoo

In the past few years, Online Convex Optimization (OCO) has received notable attention in the control literature thanks to its flexible real-time nature and powerful performance guarantees. In this paper, we propose new step-size rules and…

Optimization and Control · Mathematics 2023-01-18 Pedro Zattoni Scroccaro , Arman Sharifi Kolarijani , Peyman Mohajerin Esfahani

This paper studies stochastic control problems with the action space taken to be probability measures, with the objective penalised by the relative entropy. We identify suitable metric space on which we construct a gradient flow for the…

Optimization and Control · Mathematics 2024-01-26 David Šiška , Łukasz Szpruch

This article details a novel numerical scheme to approximate gradient flows for optimal transport (i.e. Wasserstein) metrics. These flows have proved useful to tackle theoretically and numerically non-linear diffusion equations that model…

Optimization and Control · Mathematics 2015-03-10 Gabriel Peyré

Particle methods play an important role in computational fluid dynamics, but they are among the most difficult to implement and solve. The most common method is smoothed particle hydrodynamics, which is suitable for problem settings that…

Fluid Dynamics · Physics 2025-08-26 Masato Shibukawa , Naoya Ozaki , Maximilien Berthet

Nonconvex optimization is central to modern machine learning, but the general framework of nonconvex optimization yields weak convergence guarantees that are too pessimistic compared to practice. On the other hand, while convexity enables…

Machine Learning · Computer Science 2025-02-19 Artem Riabinin , Ahmed Khaled , Peter Richtárik

Forecasting conditional stochastic nonlinear dynamical systems is a fundamental challenge repeatedly encountered across the biological and physical sciences. While flow-based models can impressively predict the temporal evolution of…

Machine Learning · Computer Science 2025-04-02 Adam P. Generale , Andreas E. Robertson , Surya R. Kalidindi

In this paper, we consider the problem of recovering the $W_2$-optimal transport map T between absolutely continuous measures $\mu,\nu\in\mathcal{P}(\mathbb{R}^n)$ as the flow of a linear-control neural ODE, where the control depends only…

Optimization and Control · Mathematics 2024-12-04 Alessandro Scagliotti , Sara Farinelli

Two fundamental problems in unsupervised learning are efficient inference for latent-variable models and robust density estimation based on large amounts of unlabeled data. Algorithms for the two tasks, such as normalizing flows and…

Machine Learning · Statistics 2018-08-02 Changyou Chen , Chunyuan Li , Liqun Chen , Wenlin Wang , Yunchen Pu , Lawrence Carin

Flow models are a cornerstone of modern machine learning. They are generative models that progressively transform probability distributions according to learned dynamics. Specifically, they learn a continuous-time Markov process that…

Quantum Physics · Physics 2025-10-10 David Layden , Ryan Sweke , Vojtěch Havlíček , Anirban Chowdhury , Kirill Neklyudov