English
Related papers

Related papers: Beyond Propagation of Chaos: A Stochastic Algorith…

200 papers

In this article, we formulate topology optimization problems concerning the mass distribution as minimization problems for functionals on the Wasserstein space. We relax optimization problems regarding non-convex objective functions on the…

Optimization and Control · Mathematics 2026-01-22 Fumiya Okazaki , Takayuki Yamada

The notion of propagation of chaos for large systems of interacting particles originates in statistical physics and has recently become a central notion in many areas of applied mathematics. The present review describes old and new methods…

Probability · Mathematics 2023-02-15 Louis-Pierre Chaintron , Antoine Diez

Uncertainty propagation and filtering can be interpreted as gradient flows with respect to suitable metrics in the infinite dimensional manifold of probability density functions. Such a viewpoint has been put forth in recent literature, and…

Optimization and Control · Mathematics 2017-10-31 Abhishek Halder , Tryphon T. Georgiou

Markov chains and diffusion processes are indispensable tools in machine learning and statistics that are used for inference, sampling, and modeling. With the growth of large-scale datasets, the computational cost associated with simulating…

Statistics Theory · Mathematics 2017-08-31 Jonathan H. Huggins , James Zou

Thompson sampling (TS) is a class of algorithms for sequential decision-making, which requires maintaining a posterior distribution over a model. However, calculating exact posterior distributions is intractable for all but the simplest…

Machine Learning · Statistics 2019-02-21 Ruiyi Zhang , Zheng Wen , Changyou Chen , Lawrence Carin

We present a computationally efficient framework, called $\texttt{FlowDRO}$, for solving flow-based distributionally robust optimization (DRO) problems with Wasserstein uncertainty sets while aiming to find continuous worst-case…

Machine Learning · Computer Science 2024-02-27 Chen Xu , Jonghyeok Lee , Xiuyuan Cheng , Yao Xie

Stochastic particle-optimization sampling (SPOS) is a recently-developed scalable Bayesian sampling framework that unifies stochastic gradient MCMC (SG-MCMC) and Stein variational gradient descent (SVGD) algorithms based on Wasserstein…

Machine Learning · Statistics 2018-11-21 Jianyi Zhang , Yang Zhao , Changyou Chen

We study stochastic particle systems on a complete graph and derive effective mean-field rate equations in the limit of diverging system size, which are also known from cluster aggregation models. We establish the propagation of chaos under…

Probability · Mathematics 2021-07-21 Watthanan Jatuviriyapornchai , Stefan Grosskinsky

Wasserstein gradient flow (WGF) is a common method to perform optimization over the space of probability measures. While WGF is guaranteed to converge to a first-order stationary point, for nonconvex functionals the converged solution does…

Optimization and Control · Mathematics 2025-09-23 Naoya Yamamoto , Juno Kim , Taiji Suzuki

We investigate a stochastic program with expected value constraints, addressing the problem in a general context through Distributionally Robust Optimization (DRO) approach using Wasserstein distances, where the ambiguity set depends on the…

Optimization and Control · Mathematics 2023-04-18 Diego Fonseca , Mauricio Junca

Estimating parameters of a diffusion process given continuous-time observations of the process via maximum likelihood approaches or, online, via stochastic gradient descent or Kalman filter formulations constitutes a well-established…

Methodology · Statistics 2025-03-17 Jan Albrecht , Sebastian Reich

This paper focus on investigating the distributed Riemannian stochastic optimization problem on the Stiefel manifold for multi-agent systems, where all the agents work collaboratively to optimize a function modeled by the average of their…

Optimization and Control · Mathematics 2025-01-17 Jishu Zhao , Xi Wang , Jinlong Lei

To accurately reproduce measurements from the real world, simulators need to have an adequate model of the physical system and require the parameters of the model be identified. We address the latter problem of estimating parameters through…

Robotics · Computer Science 2022-03-01 Eric Heiden , Christopher E. Denniston , David Millard , Fabio Ramos , Gaurav S. Sukhatme

We introduce a nonparametric approach for estimating drift and diffusion functions in systems of stochastic differential equations from observations of the state vector. Gaussian processes are used as flexible models for these functions and…

Data Analysis, Statistics and Probability · Physics 2018-08-15 Philipp Batz , Andreas Ruttor , Manfred Opper

Optimization is at the heart of machine learning, statistics and many applied scientific disciplines. It also has a long history in physics, ranging from the minimal action principle to finding ground states of disordered systems such as…

Optimization and Control · Mathematics 2021-05-11 Guilherme França , Daniel P. Robinson , René Vidal

We study distributed optimization problems over a network when the communication between the nodes is constrained, and so information that is exchanged between the nodes must be quantized. This imperfect communication poses a fundamental…

Optimization and Control · Mathematics 2018-10-30 Thinh T. Doan , Siva Theja Maguluri , Justin Romberg

The goal of scenario reduction is to approximate a given discrete distribution with another discrete distribution that has fewer atoms. We distinguish continuous scenario reduction, where the new atoms may be chosen freely, and discrete…

Optimization and Control · Mathematics 2017-01-17 Napat Rujeerapaiboon , Kilian Schindler , Daniel Kuhn , Wolfram Wiesemann

In this work we are interested in stochastic particle methods for multi-objective optimization. The problem is formulated using parametrized, single-objective sub-problems which are solved simultaneously. To this end a consensus based…

Optimization and Control · Mathematics 2022-08-03 Giacomo Borghi , Michael Herty , Lorenzo Pareschi

This paper focus on investigating the explicit rate of convergence for the propagation of chaos, in a pathwise sense a family of interacting stochastic particle related to some Brownian driven McKean-Vlasov dynamics. Precisely the McKean…

Probability · Mathematics 2019-07-23 Jean-Francois Jabir

We study sparse optimal control of a non-local continuity equation, where the goal is to steer a distribution via finitely many controllable agents or actuators. This model arises naturally in mean-field multi-agent systems and takes the…

Optimization and Control · Mathematics 2026-03-03 Enrico Sartor , Florian Dörfler , Nicolas Lanzetti
‹ Prev 1 4 5 6 7 8 10 Next ›