English
Related papers

Related papers: Global Non-convex Optimization with Discretized Di…

200 papers

When applying the finite-differences method to numerically solve the one-dimensional diffusion equation, one must choose discretization steps $\Delta x$, $\Delta t$ in space and time, respectively. By applying large-deviation theory on the…

Statistical Mechanics · Physics 2024-04-09 Naftali R. Smith

In this work we study the diffusion annealed Langevin dynamics, a score-based diffusion process recently introduced in the theory of generative models and which is an alternative to the classical overdamped Langevin diffusion. Our goal is…

Probability · Mathematics 2025-11-14 Patrick Cattiaux , Paula Cordero-Encinar , Arnaud Guillin

We consider the problem of making nonparametric inference in a class of multi-dimensional diffusions in divergence form, from low-frequency data. Statistical analysis in this setting is notoriously challenging due to the intractability of…

Methodology · Statistics 2025-01-23 Matteo Giordano , Sven Wang

This paper investigates a specific class of nonsmooth nonconvex optimization problems in the face of data uncertainty, namely, robust optimization problems, where the given objective function can be expressed as a difference of two…

Optimization and Control · Mathematics 2026-02-20 Feryal Mashkoorzadeh , Nooshin Movahedian

The use of stochastic differential equations in multi-objective optimization has been limited, in practice, by two persistent gaps: incomplete stability analyses and the absence of accessible implementations. We revisit a drift--diffusion…

Optimization and Control · Mathematics 2026-03-05 Thiago Santos , Sebastiao Xavier

We introduce a novel approach addressing global analysis of a difficult class of nonconvex-nonsmooth optimization problems within the important framework of Lagrangian-based methods. This genuine nonlinear class captures many problems in…

Optimization and Control · Mathematics 2018-01-10 Jérôme Bolte , Shoham Sabach , Marc Teboulle

This paper studies the continuous-time dynamics generated by control-theoretic Lagrangian methods for equality-constrained optimization. In particular, we consider dynamics induced by proportional-integral and feedback linearization…

Optimization and Control · Mathematics 2026-05-26 Simone Pirrera , Francesco Ripa , Daniele Astolfi , Vito Cerone , Sophie M. Fosson , Diego Regruto

Large-scale multi-objective optimization poses challenges to existing evolutionary algorithms in maintaining the performances of convergence and diversity because of high dimensional decision variables. Inspired by the motion of particles…

Neural and Evolutionary Computing · Computer Science 2025-09-22 Jia-Cheng Li , Min-Rong Chen , Guo-Qiang Zeng , Jian Weng , Man Wang , Jia-Lin Mai

Many systems exhibit a mixture of continuous and discrete dynamics. We consider a family of mixed-integer non-convex non-linear optimisation problems obtained in discretisations of optimal control of such systems. For this family, a…

Optimization and Control · Mathematics 2020-01-23 Jorn Baayen , Jakub Marecek

This work develops a distributed optimization strategy with guaranteed exact convergence for a broad class of left-stochastic combination policies. The resulting exact diffusion strategy is shown in Part II to have a wider stability range…

Optimization and Control · Mathematics 2017-12-05 Kun Yuan , Bicheng Ying , Xiaochuan Zhao , Ali H. Sayed

Inverse design refers to the problem of optimizing the input of an objective function in order to enact a target outcome. For many real-world engineering problems, the objective function takes the form of a simulator that predicts how the…

Score-based generative modeling, implemented through probability flow ODEs, has shown impressive results in numerous practical settings. However, most convergence guarantees rely on restrictive regularity assumptions on the target…

Machine Learning · Statistics 2025-10-21 Gitte Kremling , Francesco Iafrate , Mahsa Taheri , Johannes Lederer

A lot of effort has been invested into characterizing the convergence rates of gradient based algorithms for non-linear convex optimization. Recently, motivated by large datasets and problems in machine learning, the interest has shifted…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-07-23 Konstantinos I. Tsianos , Michael G. Rabbat

In generative modelling and stochastic optimal control, a central computational task is to modify a reference diffusion process to maximise a given terminal-time reward. Most existing methods require this reward to be differentiable, using…

Reflected diffusions in polyhedral domains are commonly used as approximate models for stochastic processing networks in heavy traffic. Stationary distributions of such models give useful information on the steady state performance of the…

Probability · Mathematics 2012-05-24 Amarjit Budhiraja , Jiang Chen , Sylvain Rubenthaler

This paper studies first-order algorithms for solving fully composite optimization problems over convex and compact sets. We leverage the structure of the objective by handling its differentiable and non-differentiable components…

Optimization and Control · Mathematics 2023-07-13 Maria-Luiza Vladarean , Nikita Doikov , Martin Jaggi , Nicolas Flammarion

The Continuous p-Dispersion Problem (CpDP) with boundary constraints asks for the placement of a fixed number of points in a compact subset of Euclidean space such that the minimum distance between any two points, as well as the points and…

Optimization and Control · Mathematics 2026-03-02 Sanjay Manoj , Melkior Ornik

Adaptive networks are suitable for decentralized inference tasks, e.g., to monitor complex natural phenomena. Recent research works have intensively studied distributed optimization problems in the case where the nodes have to estimate a…

Multiagent Systems · Computer Science 2023-07-19 Jie Chen , Cédric Richard , Ali. H. Sayed

We examine the Langevin diffusion confined to a closed, convex domain $D\subset\mathbb{R}^d$, represented as a reflected stochastic differential equation. We introduce a sequence of penalized stochastic differential equations and prove that…

Probability · Mathematics 2026-01-22 Tarika Mane , Amine Boukardagha

This book is devoted to finite-dimensional problems of non-convex non-smooth optimization and numerical methods for their solution. The problem of nonconvexity is studied in the book on two main models of nonconvex dependencies: these are…

Optimization and Control · Mathematics 2024-06-18 V. S. Mikhalevich , A. M. Gupal , V. I. Norkin