English
Related papers

Related papers: Online Optimization with Unknown Time-varying Para…

200 papers

Time-varying stochastic optimization problems frequently arise in machine learning practice (e.g. gradual domain shift, object tracking, strategic classification). Although most problems are solved in discrete time, the underlying process…

Machine Learning · Computer Science 2023-02-24 Subha Maity , Debarghya Mukherjee , Moulinath Banerjee , Yuekai Sun

In this paper we propose a solution to the problem of parameter estimation of nonlinearly parameterized regressions--continuous or discrete time--and apply it for system identification and adaptive control. We restrict our attention to…

Optimization and Control · Mathematics 2019-10-18 Romeo Ortega , Vladislav Gromov , Emmanuel Nuño , Anton Pyrkin , Jose Guadalupe Romero

We propose a data-driven method to establish probabilistic performance guarantees for parametric optimization problems solved via iterative algorithms. Our approach addresses two key challenges: providing convergence guarantees to…

Optimization and Control · Mathematics 2025-10-31 Jingyi Huang , Paul Goulart , Kostas Margellos

In this work, the Einstein notation is utilized to synthesize state and parameter transition matrices, by solving a set of ordinary differential equations. Additionally, for the system identification problem, it has been demonstrated that…

Systems and Control · Electrical Eng. & Systems 2024-07-08 Premjit Saha , Tarunraj Singh

We investigate an optimization problem in a queueing system where the service provider selects the optimal service fee p and service capacity \mu to maximize the cumulative expected profit (the service revenue minus the capacity cost and…

Optimization and Control · Mathematics 2025-08-12 Xinyun Chen , Guiyu Hong , Yunan Liu

Online system identification is the estimation of parameters of a dynamical system, such as mass or friction coefficients, for each measurement of the input and output signals. Here, the nonlinear stochastic differential equation of a…

Machine Learning · Computer Science 2021-06-18 Wouter M Kouw

We consider the revenue management problem of finding profit-maximising prices for delivery time slots in the context of attended home delivery. This multi-stage optimal control problem admits a dynamic programming formulation that is…

Optimization and Control · Mathematics 2020-08-04 Denis Lebedev , Kostas Margellos , Paul Goulart

We address the solution of time-varying optimization problems characterized by the sum of a time-varying strongly convex function and a time-invariant nonsmooth convex function. We design an online algorithmic framework based on…

Optimization and Control · Mathematics 2024-05-07 Nicola Bastianello , Andrea Simonetto , Ruggero Carli

This paper details how to parameterize the posterior distribution of state-space systems to generate improved optimization problems for system identification using variational inference. Three different parameterizations of the assumed…

Applications · Statistics 2025-01-15 Dimas Abreu Archanjo Dutra

Optimization of complex functions, such as the output of computer simulators, is a difficult task that has received much attention in the literature. A less studied problem is that of optimization under unknown constraints, i.e., when the…

Methodology · Statistics 2010-07-06 Robert B. Gramacy , Herbert K. H. Lee

Parameter estimation is crucial for modeling, tracking, and control of complex dynamical systems. However, parameter uncertainties can compromise system performance under a controller relying on nominal parameter values. Typically,…

Robotics · Computer Science 2020-02-20 Mouhyemen Khan , Abhijit Chatterjee

We analyze Decentralized Online Optimization algorithms using the Performance Estimation Problem approach which allows, to automatically compute exact worst-case performance of optimization algorithms. Our analysis shows that several…

Optimization and Control · Mathematics 2025-09-09 Erwan Meunier , Julien M. Hendrickx

We revisit a model for time-varying linear regression that assumes the unknown parameters evolve according to a linear dynamical system. Counterintuitively, we show that when the underlying dynamics are stable the parameters of this model…

Statistics Theory · Mathematics 2022-01-03 Ali Jadbabaie , Horia Mania , Devavrat Shah , Suvrit Sra

We present a novel online learning algorithm for a class of unknown and uncertain dynamical environments that are fully observable. First, we obtain a novel probabilistic characterization of systems whose mean behavior is known but which…

Systems and Control · Electrical Eng. & Systems 2020-09-08 Dan Li , Dariush Fooladivanda , Sonia Martinez

We investigate the distributed online economic dispatch problem for power systems with time-varying coupled inequality constraints. The problem is formulated as a distributed online optimization problem in a multi-agent system. At each time…

Optimization and Control · Mathematics 2025-12-25 Yingjie Zhou , Xiaoqian Wang , Tao Li

This paper proposes a novel distributed optimization framework that addresses time-varying optimization problems without requiring explicit derivative information of the objective functions. Traditional distributed methods often rely on…

Optimization and Control · Mathematics 2025-09-29 Xuebin Li , Xuefei Yang , Emilia Fridman , Mamadou Diagne , Jiebao Sun

In this paper, we consider algorithms with integral action for solving online optimization problems characterized by quadratic cost functions with a time-varying optimal point described by an $(n-1)$th order polynomial. Using a version of…

Optimization and Control · Mathematics 2025-09-12 Alex Xinting Wu , Ian R. Petersen , Iman Shames

Reconstructing the equation of motion and thus the network topology of a system from time series is a very important problem. Although many powerful methods have been developed, it remains a great challenge to deal with systems in high…

Adaptation and Self-Organizing Systems · Physics 2023-08-16 Zishuo Yan , Lili Gui , Kun Xu , Yueheng Lan

Variational quantum circuits have arisen as an important method in quantum computing. A crucial step of it is parameter optimization, which is typically tackled through gradient-descent techniques. We advantageously explore instead the use…

Quantum Physics · Physics 2024-12-24 Vignesh Anantharamakrishnan , Márcio M. Taddei

We consider a non-stationary variant of a sequential stochastic optimization problem, in which the underlying cost functions may change along the horizon. We propose a measure, termed variation budget, that controls the extent of said…

Probability · Mathematics 2019-06-07 O. Besbes , Y. Gur , A. Zeevi