English
Related papers

Related papers: Escaping spurious local minimum trajectories in on…

200 papers

A stochastic-gradient-based interior-point algorithm for minimizing a continuously differentiable objective function (that may be nonconvex) subject to bound constraints is presented, analyzed, and demonstrated through experimental results.…

Optimization and Control · Mathematics 2024-03-15 Frank E. Curtis , Vyacheslav Kungurtsev , Daniel P. Robinson , Qi Wang

In this paper, we consider the problem of distributed online convex optimization, where a group of agents collaborate to track the global minimizers of a sum of time-varying objective functions in an online manner. Specifically, we propose…

Optimization and Control · Mathematics 2020-10-14 Yan Zhang , Robert J. Ravier , Vahid Tarokh , Michael M. Zavlanos

We propose an anytime online algorithm for the problem of learning a sequence of adversarial convex cost functions while approximately satisfying another sequence of adversarial online convex constraints. A sequential algorithm is called…

Machine Learning · Computer Science 2025-10-28 Dhruv Sarkar , Abhishek Sinha

This work focuses on the setting of dynamic regret in the context of online learning with full information. In particular, we analyze regret bounds with respect to the temporal variability of the loss functions. By assuming that the…

Machine Learning · Computer Science 2021-02-16 Nicolò Campolongo , Francesco Orabona

This paper considers a class of convex optimization problems where both, the objective function and the constraints, have a continuously varying dependence on time. Our goal is to develop an algorithm to track the optimal solution as it…

Optimization and Control · Mathematics 2015-10-07 Mahyar Fazlyab , Santiago Paternain , Victor M. Preciado , Alejandro Ribeiro

The development of online algorithms to track time-varying systems has drawn a lot of attention in the last years, in particular in the framework of online convex optimization. Meanwhile, sparse time-varying optimization has emerged as a…

Optimization and Control · Mathematics 2020-02-03 Sophie M. Fosson

This paper concerns a new class of discontinuous dynamical systems for constrained optimization. These dynamics are particularly suited to solve nonlinear, non-convex problems in closed-loop with a physical system. Such approaches using…

Optimization and Control · Mathematics 2020-05-11 Adrian Hauswirth , Florian Dörfler , Andrew Teel

This paper is devoted to the distributed continuous-time optimization problem with time-varying objective functions and time-varying nonlinear inequality constraints. Different from most studied distributed optimization problems with…

Optimization and Control · Mathematics 2020-09-08 Shan Sun , Wei Ren

This paper develops an algorithmic framework for tracking fixed points of time-varying contraction mappings. Analytical results for the tracking error are established for the cases where: (i) the underlying contraction self-map changes at…

Optimization and Control · Mathematics 2018-09-14 Andrey Bernstein , Emiliano Dall'Anese

Recently, a new class of non-convex optimization problems motivated by the statistical problem of learning an acyclic directed graphical model from data has attracted significant interest. While existing work uses standard first-order…

Machine Learning · Computer Science 2023-07-03 Chang Deng , Kevin Bello , Bryon Aragam , Pradeep Ravikumar

We present a novel second-order trajectory optimization algorithm based on Stein Variational Newton's Method and Maximum Entropy Differential Dynamic Programming. The proposed algorithm, called Stein Variational Differential Dynamic…

Optimization and Control · Mathematics 2024-10-10 Yuichiro Aoyama , Peter Lehmamnn , Evangelos A. Theodorou

We study online optimization problems in which the cost function depends on latent, time-varying parameters that are unmeasurable and governed by unknown dynamics. Specifically, we consider a strongly convex cost function whose linear term…

Optimization and Control · Mathematics 2026-05-22 Shivanshu Tripathi , Maziar Raissi

In this paper, we develop an interior-point method for solving a class of convex optimization problems with time-varying objective and constraint functions. Using log-barrier penalty functions, we propose a continuous-time dynamical system…

Optimization and Control · Mathematics 2016-08-29 Mahyar Fazlyab , Santiago Paternain , Victor M. Preciado , Alejandro Ribeiro

Online optimization has emerged as powerful tool in large scale optimization. In this pa- per, we introduce efficient online optimization algorithms based on the alternating direction method (ADM), which can solve online convex optimization…

Machine Learning · Computer Science 2013-07-11 Huahua Wang , Arindam Banerjee

This paper considers the analysis of continuous time gradient-based optimization algorithms through the lens of nonlinear contraction theory. It demonstrates that in the case of a time-invariant objective, most elementary results on…

Optimization and Control · Mathematics 2022-12-23 Patrick M. Wensing , Jean-Jacques E. Slotine

Motion planning is a key aspect of robotics. A common approach to address motion planning problems is trajectory optimization. Trajectory optimization can represent the high-level behaviors of robots through mathematical formulations.…

Robotics · Computer Science 2024-08-21 Fatemeh Rastgar

Signal processing and machine learning algorithms for data supported over graphs, require the knowledge of the graph topology. Unless this information is given by the physics of the problem (e.g., water supply networks, power grids), the…

Signal Processing · Electrical Eng. & Systems 2021-02-11 Alberto Natali , Mario Coutino , Elvin Isufi , Geert Leus

We address the solution of time-varying optimization problems characterized by the sum of a time-varying strongly convex function and a time-invariant nonsmooth convex function. We design an online algorithmic framework based on…

Optimization and Control · Mathematics 2024-05-07 Nicola Bastianello , Andrea Simonetto , Ruggero Carli

There is a growing cross-disciplinary effort in the broad domain of optimization and learning with streams of data, applied to settings where traditional batch optimization techniques cannot produce solutions at time scales that match the…

Optimization and Control · Mathematics 2021-11-29 Emiliano Dall'Anese , Andrea Simonetto , Stephen Becker , Liam Madden

We propose an algorithm based on online convex optimization for controlling discrete-time linear dynamical systems. The algorithm is data-driven, i.e., does not require a model of the system, and is able to handle a priori unknown and…

Optimization and Control · Mathematics 2022-11-17 Marko Nonhoff , Matthias A. Müller