English
Related papers

Related papers: Understanding the Variance Dichotomy in Continuous…

200 papers

This paper provides lower bounds on the convergence rate of Derivative Free Optimization (DFO) with noisy function evaluations, exposing a fundamental and unavoidable gap between the performance of algorithms with access to gradients and…

Machine Learning · Statistics 2012-09-13 Kevin G. Jamieson , Robert D. Nowak , Benjamin Recht

The paper deals with stochastic difference-of-convex functions (DC) programs, that is, optimization problems whose the cost function is a sum of a lower semicontinuous DC function and the expectation of a stochastic DC function with respect…

Numerical Analysis · Mathematics 2020-12-14 Le Thi Hoai An , Huynh Van Ngai , Pham Dinh Tao , Luu Hoang Phuc Hau

Designing a fast and efficient optimization method with local optima avoidance capability on a variety of optimization problems is still an open problem for many researchers. In this work, the concept of a new global optimization method…

Neural and Evolutionary Computing · Computer Science 2012-08-13 Fereydoun Farrahi Moghaddam , Reza Farrahi Moghaddam , Mohamed Cheriet

Stochastic Optimal Control (SOC) typically considers noise only in the process model, i.e. unknown disturbances. However, in many robotic applications involving interaction with the environment, such as locomotion and manipulation,…

Systems and Control · Computer Science 2021-06-08 Brahayam Ponton , Stefan Schaal , Ludovic Righetti

Discrete stochastic optimization considers the problem of minimizing (or maximizing) loss functions defined on discrete sets, where only noisy measurements of the loss functions are available. The discrete stochastic optimization problem is…

Optimization and Control · Mathematics 2013-11-04 Qi Wang

This paper explores adaptive variance reduction methods for stochastic optimization based on the STORM technique. Existing adaptive extensions of STORM rely on strong assumptions like bounded gradients and bounded function values, or suffer…

Optimization and Control · Mathematics 2024-10-24 Wei Jiang , Sifan Yang , Yibo Wang , Lijun Zhang

The optimal control of a mechanical system is of crucial importance in many realms. Typical examples are the determination of a time-minimal path in vehicle dynamics, a minimal energy trajectory in space mission design, or optimal motion…

Optimization and Control · Mathematics 2008-10-09 S. Ober-Bloebaum , O. Junge , J. E. Marsden

We systematically develop a learning-based treatment of stochastic optimal control (SOC), relying on direct optimization of parametric control policies. We propose a derivation of adjoint sensitivity results for stochastic differential…

Machine Learning · Computer Science 2021-06-08 Stefano Massaroli , Michael Poli , Stefano Peluchetti , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

We consider decentralized time-varying stochastic optimization problems where each of the functions held by the nodes has a finite sum structure. Such problems can be efficiently solved using variance reduction techniques. Our aim is to…

Prediction via deterministic continuous-time models will always be subject to model error, for example due to unexplainable phenomena, uncertainties in any data driving the model, or discretisation/resolution issues. In this paper, we build…

Dynamical Systems · Mathematics 2025-06-30 Liam Blake , John Maclean , Sanjeeva Balasuriya

This paper deals with the problem of accurately determining guaranteed suboptimal values of an unknown cost function on the basis of noisy measurements. We consider a set-valued variant to regression where, instead of finding a best…

Optimization and Control · Mathematics 2024-07-29 Jaap Eising , Jorge Cortes

In this work we are interested in the construction of numerical methods for high dimensional constrained nonlinear optimization problems by particle-based gradient-free techniques. A consensus-based optimization (CBO) approach combined with…

Optimization and Control · Mathematics 2021-11-23 Giacomo Borghi , Michael Herty , Lorenzo Pareschi

We study the finite-agent behavior of Consensus-Based Optimization (CBO), a recent metaheuristic for the global minimization of a function, that combines drift toward a consensus estimate with stochastic exploration. While previous analyses…

Optimization and Control · Mathematics 2025-10-23 Simone Göttlich , Jacob Heieck , Andreas Neuenkirch

We study stochastic convex optimization under infinite noise variance. Specifically, when the stochastic gradient is unbiased and has uniformly bounded $(1+\kappa)$-th moment, for some $\kappa \in (0,1]$, we quantify the convergence rate of…

Machine Learning · Statistics 2022-02-24 Nuri Mert Vural , Lu Yu , Krishnakumar Balasubramanian , Stanislav Volgushev , Murat A. Erdogdu

Minimizing volatility and adjustment costs is of central importance in many economic environments, yet it is often complicated by evolving feasibility constraints. We study a decision maker who repeatedly selects an action from a…

Theoretical Economics · Economics 2026-02-18 Simon Jantschgi , Heinrich H. Nax , Bary S. R. Pradelski , Marek Pycia

Variational hybrid quantum-classical optimization represents one of the most promising avenue to show the advantage of nowadays noisy intermediate-scale quantum computers in solving hard problems, such as finding the minimum-energy state of…

Quantum Physics · Physics 2020-11-18 Laura Gentini , Alessandro Cuccoli , Stefano Pirandola , Paola Verrucchi , Leonardo Banchi

Though switched dynamical systems have shown great utility in modeling a variety of physical phenomena, the construction of an optimal control of such systems has proven difficult since it demands some type of optimal mode scheduling. In…

Optimization and Control · Mathematics 2014-02-04 Ramanarayan Vasudevan , Humberto Gonzalez , Ruzena Bajcsy , S. Shankar Sastry

We consider a dynamical system with finitely many equilibria and perturbed by small noise, in addition to being controlled by an `expensive' control. The controlled process is optimal for an ergodic criterion with a running cost that…

Probability · Mathematics 2019-03-20 Ari Arapostathis , Anup Biswas , Vivek S. Borkar

The analysis in Part I revealed interesting properties for subgradient learning algorithms in the context of stochastic optimization when gradient noise is present. These algorithms are used when the risk functions are non-smooth and…

Optimization and Control · Mathematics 2017-04-21 Bicheng Ying , Ali H. Sayed

We study stochastic zeroth-order (ZO) optimization of smooth nonconvex objectives under heavy-tailed sample-gradient noise. This regime is motivated by empirical evidence that gradient noise in modern machine learning can violate the…

Optimization and Control · Mathematics 2026-05-19 Taha El Bakkali , El Mahdi Chayti , Qiuyi Zhang , Imane Rahali , Omar Saadi