中文
相关论文

相关论文: Dynamic Regret for Strongly Adaptive Methods and O…

200 篇论文

We consider the problem of online convex optimization against an arbitrary adversary with bandit feedback, known as bandit convex optimization. We give the first $\tilde{O}(\sqrt{T})$-regret algorithm for this setting based on a novel…

机器学习 · 计算机科学 2016-03-16 Elad Hazan , Yuanzhi Li

We address the problem of simultaneously learning and control in an online receding horizon control setting. We consider the control of an unknown linear dynamical system with general cost functions and affine constraints on the control…

最优化与控制 · 数学 2022-11-02 Deepan Muthirayan , Jianjun Yuan , Pramod P. Khargonekar

In this work we investigate the variation of the online kernelized ridge regression algorithm in the setting of $d-$dimensional adversarial nonparametric regression. We derive the regret upper bounds on the classes of Sobolev spaces…

We study the online saddle point problem, an online learning problem where at each iteration a pair of actions need to be chosen without knowledge of the current and future (convex-concave) payoff functions. The objective is to minimize the…

机器学习 · 统计学 2020-04-07 Adrian Rivera , He Wang , Huan Xu

Nowadays, online learning is an appealing learning paradigm, which is of great interest in practice due to the recent emergence of large scale applications such as online advertising placement and online web ranking. Standard online…

机器学习 · 计算机科学 2019-11-27 Biyi Fang , Diego Klabjan

We propose an algorithm based on online convex optimization for controlling discrete-time linear dynamical systems. The algorithm is data-driven, i.e., does not require a model of the system, and is able to handle a priori unknown and…

最优化与控制 · 数学 2022-11-17 Marko Nonhoff , Matthias A. Müller

We study the problem of safe online convex optimization, where the action at each time step must satisfy a set of linear safety constraints. The goal is to select a sequence of actions to minimize the regret without violating the safety…

机器学习 · 计算机科学 2021-11-16 Sapana Chaudhary , Dileep Kalathil

We study online inverse linear optimization, also known as contextual recommendation, where a learner sequentially infers an agent's hidden objective vector from observed optimal actions over feasible sets that change over time. The learner…

机器学习 · 计算机科学 2026-05-13 Taihei Oki , Shinsaku Sakaue

In this paper we study the non-stationary stochastic optimization question with bandit feedback and dynamic regret measures. The seminal work of Besbes et al. (2015) shows that, when aggregated function changes is known a priori, a simple…

机器学习 · 统计学 2022-10-12 Yining Wang

A natural goal when designing online learning algorithms for non-stationary environments is to bound the regret of the algorithm in terms of the temporal variation of the input sequence. Intuitively, when the variation is small, it should…

机器学习 · 计算机科学 2021-12-08 Gautam Goel , Babak Hassibi

We consider the problem of adversarial bandit convex optimization, that is, online learning over a sequence of arbitrary convex loss functions with only one function evaluation for each of them. While all previous works assume known and…

机器学习 · 计算机科学 2022-02-15 Haipeng Luo , Mengxiao Zhang , Peng Zhao

This paper introduces a new problem-dependent regret measure for online convex optimization with smooth losses. The notion, which we call the $G^\star$ regret, depends on the cumulative squared gradient norm evaluated at the decision in…

机器学习 · 统计学 2026-02-10 Wenzhi Gao , Chang He , Madeleine Udell

In this paper, we improve the kernel alignment regret bound for online kernel learning in the regime of the Hinge loss function. Previous algorithm achieves a regret of $O((\mathcal{A}_TT\ln{T})^{\frac{1}{4}})$ at a computational complexity…

机器学习 · 计算机科学 2024-03-14 Junfan Li , Shizhong Liao

This work considered an online distributed optimization problem, with a group of agents whose local objective functions vary with time. Moreover, the value of the objective function is revealed to the corresponding agent after the decision…

最优化与控制 · 数学 2021-08-16 Yipeng Pang , Guoqiang Hu

We present a new anytime algorithm that achieves near-optimal regret for any instance of finite stochastic partial monitoring. In particular, the new algorithm achieves the minimax regret, within logarithmic factors, for both "easy" and…

机器学习 · 计算机科学 2012-07-03 Gabor Bartok , Navid Zolghadr , Csaba Szepesvari

Learning and computation of equilibria are central problems in game theory, theory of computation, and artificial intelligence. In this work, we introduce proximal regret, a new notion of regret based on proximal operators that lies…

计算机科学与博弈论 · 计算机科学 2025-11-06 Yang Cai , Constantinos Daskalakis , Haipeng Luo , Chen-Yu Wei , Weiqiang Zheng

In this paper, we propose a learning approach to analyze dynamic systems with asymmetric information structure. Instead of adopting a game theoretic setting, we investigate an online quadratic optimization problem driven by system noises…

最优化与控制 · 数学 2018-11-05 Cheng Tan , Wing Shing Wong

A well-studied generalization of the standard online convex optimization (OCO) framework is constrained online convex optimization (COCO). In COCO, on every round, a convex cost function and a convex constraint function are revealed to the…

机器学习 · 计算机科学 2024-10-29 Abhishek Sinha , Rahul Vaze

We study fast rates of convergence in the setting of nonparametric online regression, namely where regret is defined with respect to an arbitrary function class which has bounded complexity. Our contributions are two-fold: - In the…

机器学习 · 计算机科学 2022-04-13 Constantinos Daskalakis , Noah Golowich

Practical online learning tasks are often naturally defined on unconstrained domains, where optimal algorithms for general convex losses are characterized by the notion of comparator adaptivity. In this paper, we design such algorithms in…

机器学习 · 计算机科学 2022-10-13 Zhiyu Zhang , Ashok Cutkosky , Ioannis Ch. Paschalidis