中文
相关论文

相关论文: Delayed Feedback in Online Non-Convex Optimization…

200 篇论文

This paper addresses safe distributed online optimization over an unknown set of linear safety constraints. A network of agents aims at jointly minimizing a global, time-varying function, which is only partially observable to each…

最优化与控制 · 数学 2023-02-27 Ting-Jui Chang , Sapana Chaudhary , Dileep Kalathil , Shahin Shahrampour

In this paper, we analyze the problem of online convex optimization in different settings, including different feedback types (full-information/semi-bandit/bandit/etc) in either stochastic or non-stochastic setting and different notions of…

机器学习 · 计算机科学 2026-02-23 Mohammad Pedramfar , Vaneet Aggarwal

This paper studies the problem of controlling linear dynamical systems subject to point-wise-in-time constraints. We present an algorithm similar to online gradient descent, that can handle time-varying and a priori unknown convex cost…

最优化与控制 · 数学 2021-11-03 Marko Nonhoff , Matthias A. Müller

This paper considers the problem of online trajectory design under time-varying environments. We formulate the general trajectory optimization problem within the framework of time-varying constrained convex optimization and proposed a novel…

最优化与控制 · 数学 2020-01-09 Mohan Krishna Nutalapati , Amrit Singh Bedi , Ketan Rajawat , Marceau Coupechoux

We consider an online learning process to forecast a sequence of outcomes for nonconvex models. A typical measure to evaluate online learning algorithms is regret but such standard definition of regret is intractable for nonconvex models…

机器学习 · 计算机科学 2018-11-30 Sergul Aydore , Lee Dicker , Dean Foster

We consider the problem of online control of systems with time-varying linear dynamics. This is a general formulation that is motivated by the use of local linearization in control of nonlinear dynamical systems. To state meaningful…

机器学习 · 计算机科学 2022-02-15 Paula Gradu , Elad Hazan , Edgar Minasyan

This paper studies online nonstochastic control problems with adversarial and static constraints. We propose online nonstochastic control algorithms that achieve both sublinear regret and sublinear adversarial constraint violation while…

机器学习 · 计算机科学 2023-02-07 Xin Liu , Zixian Yang , Lei Ying

This work focuses on the setting of dynamic regret in the context of online learning with full information. In particular, we analyze regret bounds with respect to the temporal variability of the loss functions. By assuming that the…

机器学习 · 计算机科学 2021-02-16 Nicolò Campolongo , Francesco Orabona

We present the online Newton's method, a single-step second-order method for online nonconvex optimization. We analyze its performance and obtain a dynamic regret bound that is linear in the cumulative variation between round optima. We…

最优化与控制 · 数学 2020-12-11 Antoine Lesage-Landry , Joshua A. Taylor , Iman Shames

We introduce an online convex optimization algorithm which utilizes projected subgradient descent with optimal adaptive learning rates. Our method provides second-order minimax-optimal dynamic regret guarantee (i.e. dependent on the sum of…

最优化与控制 · 数学 2022-09-14 Hakan Gokcesu , Suleyman S. Kozat

This article investigates the problem of controlling linear time-invariant systems subject to time-varying and a priori unknown cost functions, state and input constraints, and exogenous disturbances. We combine the online convex…

系统与控制 · 电气工程与系统科学 2025-12-18 Marko Nonhoff , Emiliano Dall'Anese , Matthias A. Müller

This paper describes a new online convex optimization method which incorporates a family of candidate dynamical models and establishes novel tracking regret bounds that scale with the comparator's deviation from the best dynamical model in…

机器学习 · 统计学 2013-01-08 Eric C. Hall , Rebecca M. Willett

We consider online optimization in the 1-lookahead setting, where the objective does not decompose additively over the rounds of the online game. The resulting formulation enables us to deal with non-stationary and/or long-term constraints…

机器学习 · 统计学 2016-06-09 Rodolphe Jenatton , Jim Huang , Dominik Csiba , Cedric Archambeau

We consider the problem of the Zinkevich (2003)-style dynamic regret minimization in online learning with exp-concave losses. We show that whenever improper learning is allowed, a Strongly Adaptive online learner achieves the dynamic regret…

机器学习 · 计算机科学 2021-07-06 Dheeraj Baby , Yu-Xiang Wang

This paper considers the problem of distributed bandit online convex optimization with time-varying coupled inequality constraints. This problem can be defined as a repeated game between a group of learners and an adversary. The learners…

最优化与控制 · 数学 2019-12-10 Xinlei Yi , Xiuxian Li , Tao Yang , Lihua Xie , Karl H. Johansson , Tianyou Chai

In the convex optimization approach to online regret minimization, many methods have been developed to guarantee a $O(\sqrt{T})$ bound on regret for subdifferentiable convex loss functions with bounded subgradients, by using a reduction to…

机器学习 · 计算机科学 2016-09-20 Arthur Flajolet , Patrick Jaillet

We consider online convex optimization with a zero-order oracle feedback. In particular, the decision maker does not know the explicit representation of the time-varying cost functions, or their gradients. At each time step, she observes…

最优化与控制 · 数学 2020-05-05 Tatiana Tatarenko , Maryam Kamgarpour

We study the problem of Online Convex Optimization (OCO) with memory, which allows loss functions to depend on past decisions and thus captures temporal effects of learning problems. In this paper, we introduce dynamic policy regret as the…

机器学习 · 计算机科学 2023-08-16 Peng Zhao , Yu-Hu Yan , Yu-Xiang Wang , Zhi-Hua Zhou

We present an adaptive online gradient descent algorithm to solve online convex optimization problems with long-term constraints , which are constraints that need to be satisfied when accumulated over a finite number of rounds T , but can…

机器学习 · 统计学 2015-12-24 Rodolphe Jenatton , Jim Huang , Cédric Archambeau

In this paper, we present an improved analysis for dynamic regret of strongly convex and smooth functions. Specifically, we investigate the Online Multiple Gradient Descent (OMGD) algorithm proposed by Zhang et al. (2017). The original…

机器学习 · 计算机科学 2021-04-15 Peng Zhao , Lijun Zhang