English
Related papers

Related papers: Gradient Free Cooperative Seeking of a Moving Sour…

200 papers

Schedule-Free SGD, proposed in [Defazio et al., 2024], achieves optimal convergence rates without requiring the training horizon in advance, by replacing learning rate schedules with a principled form of iterate averaging. However, the…

Machine Learning · Computer Science 2026-05-13 Dimitris Oikonomou , Matthew Buchholz , Yuen-Man Pun , Robert M. Gower , Nicolas Loizou

We study the so-called distributed two-time-scale gradient method for solving convex optimization problems over a network of agents when the communication bandwidth between the nodes is limited, and so information that is exchanged between…

Systems and Control · Electrical Eng. & Systems 2021-06-01 Marcos M. Vasconcelos , Thinh T. Doan , Urbashi Mitra

We develop and analyse an approach to optimize functions $l\colon \mathbb{R}^d \rightarrow \mathbb{R}$ not assumed to be convex, differentiable or even continuous. The algorithm belongs to the class of model-based search methods. The idea…

Computation · Statistics 2025-12-04 Christophe Andrieu , Nicolas Chopin , Ettore Fincato , Mathieu Gerber

The empirical success of derivative-free methods in reinforcement learning for planning through contact seems at odds with the perceived fragility of classical gradient-based optimization methods in these domains. What is causing this gap,…

Robotics · Computer Science 2022-01-25 H. J. Terry Suh , Tao Pang , Russ Tedrake

This paper addresses a formation tracking problem for nonlinear multi-agent systems with time-varying actuator faults, in which only a subset of agents has access to the leader's information over the directed leader-follower network with a…

Systems and Control · Electrical Eng. & Systems 2020-09-23 Z. Feng , G. Hu

In this paper, we consider the problem of distributed online convex optimization, where a group of agents collaborate to track the global minimizers of a sum of time-varying objective functions in an online manner. Specifically, we propose…

Optimization and Control · Mathematics 2020-10-14 Yan Zhang , Robert J. Ravier , Vahid Tarokh , Michael M. Zavlanos

Gradient Descent (GD) is a ubiquitous algorithm for finding the optimal solution to an optimization problem. For reduced computational complexity, the optimal solution $\mathrm{x^*}$ of the optimization problem must be attained in a minimum…

Optimization and Control · Mathematics 2023-06-01 Revati Gunjal , Sushama Wagh , Syed Shadab Nayyer , Alex Stankovic , Navdeep M. Singh

In this paper, we consider continuous-time stochastic optimal control problems where the cost is evaluated through a coherent risk measure. We provide an explicit gradient descent-ascent algorithm which applies to problems subject to…

Optimization and Control · Mathematics 2023-06-23 Gabriel Velho , Jean Auriol , Riccardo Bonalli

This paper considers the multi-agent linear least-squares problem in a server-agent network. In this problem, the system comprises multiple agents, each having a set of local data points, that are connected to a server. The goal for the…

Optimization and Control · Mathematics 2024-10-29 Kushal Chakrabarti , Nirupam Gupta , Nikhil Chopra

We study non-convex distributed optimization problems where a set of agents collaboratively solve a separable optimization problem that is distributed over a time-varying network. The existing methods to solve these problems rely on (at…

Optimization and Control · Mathematics 2022-04-26 Hadi Reisizadeh , Behrouz Touri , Soheil Mohajer

When training neural networks with low-precision computation, rounding errors often cause stagnation or are detrimental to the convergence of the optimizers; in this paper we study the influence of rounding errors on the convergence of the…

Machine Learning · Statistics 2025-01-22 Lu Xia , Michiel E. Hochstenbach , Stefano Massei

Gradient algorithms are classical in adaptive control and parameter estimation. For instantaneous quadratic cost functions they lead to a linear time-varying dynamic system that converges exponentially under persistence of excitation…

Optimization and Control · Mathematics 2020-10-06 Juan G. Rueda-Escobedo , Jaime A. Moreno

In this paper we consider a control system of the form $\dot x = F(x)u$, linear in the control variable $u$. Given a fixed starting point, we study a finite-horizon optimal control problem, where we want to minimize a weighted sum of an…

Optimization and Control · Mathematics 2023-11-20 Alessandro Scagliotti

This paper presents the design of an extremum seeking controller based on sliding modes and cyclic search for real-time optimization of non-linear multivariable dynamic systems. These systems have arbitrary relative degree, compensated by…

Optimization and Control · Mathematics 2024-07-31 Nerito Oliveira Aminde , Tiago Roux Oliveira , Liu Hsu

We study the problem of online personalized decentralized learning with $N$ statistically heterogeneous clients collaborating to accelerate local training. An important challenge in this setting is to select relevant collaborators to reduce…

Machine Learning · Statistics 2025-07-10 Constantin Philippenko , Batiste Le Bars , Kevin Scaman , Laurent Massoulié

In the paper, we generalize the approach Gasnikov et. al, 2017, which allows to solve (stochastic) convex optimization problems with an inexact gradient-free oracle, to the convex-concave saddle-point problem. The proposed approach works,…

Optimization and Control · Mathematics 2022-09-13 Aleksandr Beznosikov , Abdurakhmon Sadiev , Alexander Gasnikov

In this paper, we develop a data-based controller design framework for diffusively coupled systems with guaranteed convergence to an $\epsilon$-neighborhood of the desired formation. The controller is comprised of a fixed controller with an…

Systems and Control · Electrical Eng. & Systems 2025-01-30 Miel Sharf , Anne Koch , Daniel Zelazo , Frank Allgöwer

In the development of first-order methods for smooth (resp., composite) convex optimization problems, where smooth functions with Lipschitz continuous gradients are minimized, the gradient (resp., gradient mapping) norm becomes a…

Optimization and Control · Mathematics 2020-10-06 Masaru Ito , Mituhiro Fukuda

Solutions of optimization problems, including policy optimization in reinforcement learning, typically rely upon some variant of gradient descent. There has been much recent work in the machine learning, control, and optimization…

Machine Learning · Computer Science 2025-07-17 Eduardo D. Sontag

Incentive design problems consider a system planner who steers self-interested agents toward a socially optimal Nash equilibrium by issuing incentives in the presence of information asymmetry, that is, uncertainty about the agents' cost…

Optimization and Control · Mathematics 2026-04-14 Georgios Vasileiou , Lantian Zhang , Silun Zhang