中文
相关论文

相关论文: Dual Averaging on Compactly-Supported Distribution…

200 篇论文

This paper considers a variant of the online paging problem, where the online algorithm has access to multiple predictors, each producing a sequence of predictions for the page arrival times. The predictors may have occasional prediction…

数据结构与算法 · 计算机科学 2020-11-20 Yuval Emek , Shay Kutten , Yangguang Shi

We study nonstationary Online Linear Programming (OLP), where $n$ orders arrive sequentially with reward-resource consumption pairs that form a sequence of independent, but not necessarily identically distributed, random vectors. At the…

数据结构与算法 · 计算机科学 2026-03-17 Haoran Xu , Owen Shen , Peter Glynn , Yinyu Ye , Patrick Jaillet

We show that for a general class of convex online learning problems, Mirror Descent can always achieve a (nearly) optimal regret guarantee.

机器学习 · 计算机科学 2011-07-21 Nathan Srebro , Karthik Sridharan , Ambuj Tewari

We consider online learning in episodic loop-free Markov decision processes (MDPs), where the loss function can change arbitrarily between episodes, and the transition function is not known to the learner. We show…

机器学习 · 计算机科学 2019-05-21 Aviv Rosenberg , Yishay Mansour

We study the problem of making predictions of an adversarially chosen high-dimensional state that are unbiased subject to an arbitrary collection of conditioning events, with the goal of tailoring these events to downstream decision makers.…

机器学习 · 计算机科学 2023-10-30 Georgy Noarov , Ramya Ramalingam , Aaron Roth , Stephan Xie

We consider distributed online learning for joint regret with communication constraints. In this setting, there are multiple agents that are connected in a graph. Each round, an adversary first activates one of the agents to issue a…

机器学习 · 计算机科学 2021-10-26 Dirk van der Hoeven , Hédi Hadiji , Tim van Erven

We provide the first sub-linear space and sub-linear regret algorithm for online learning with expert advice (against an oblivious adversary), addressing an open question raised recently by Srinivas, Woodruff, Xu and Zhou (STOC 2022). We…

数据结构与算法 · 计算机科学 2022-11-09 Binghui Peng , Fred Zhang

Online optimization has emerged as powerful tool in large scale optimization. In this paper, we introduce efficient online algorithms based on the alternating directions method (ADM). We introduce a new proof technique for ADM in the batch…

机器学习 · 计算机科学 2012-07-03 Huahua Wang , Arindam Banerjee

The regret bound of dynamic online learning algorithms is often expressed in terms of the variation in the function sequence ($V_T$) and/or the path-length of the minimizer sequence after $T$ rounds. For strongly convex and smooth…

机器学习 · 计算机科学 2020-08-17 Ting-Jui Chang , Shahin Shahrampour

To address the uncertainty in function types, recent progress in online convex optimization (OCO) has spurred the development of universal algorithms that simultaneously attain minimax rates for multiple types of convex functions. However,…

机器学习 · 计算机科学 2024-05-31 Wenhao Yang , Yibo Wang , Peng Zhao , Lijun Zhang

This paper describes a new online convex optimization method which incorporates a family of candidate dynamical models and establishes novel tracking regret bounds that scale with the comparator's deviation from the best dynamical model in…

机器学习 · 统计学 2013-01-08 Eric C. Hall , Rebecca M. Willett

This work focuses on the setting of dynamic regret in the context of online learning with full information. In particular, we analyze regret bounds with respect to the temporal variability of the loss functions. By assuming that the…

机器学习 · 计算机科学 2021-02-16 Nicolò Campolongo , Francesco Orabona

This work focuses on dynamic regret of online convex optimization that compares the performance of online learning to a clairvoyant who knows the sequence of loss functions in advance and hence selects the minimizer of the loss function at…

机器学习 · 计算机科学 2016-05-17 Tianbao Yang , Lijun Zhang , Rong Jin , Jinfeng Yi

In this paper we explore the role of duality principles within the problem of rotation averaging, a fundamental task in a wide range of computer vision applications. In its conventional form, rotation averaging is stated as a minimization…

计算机视觉与模式识别 · 计算机科学 2017-11-30 Anders Eriksson , Carl Olsson , Fredrik Kahl , Tat-Jun Chin

This paper introduces a new problem-dependent regret measure for online convex optimization with smooth losses. The notion, which we call the $G^\star$ regret, depends on the cumulative squared gradient norm evaluated at the decision in…

机器学习 · 统计学 2026-02-10 Wenzhi Gao , Chang He , Madeleine Udell

We consider online optimization with binary decision variables and convex loss functions. We design a new algorithm, binary online gradient descent (bOGD) and bound its expected dynamic regret. We provide a regret bound that holds for any…

最优化与控制 · 数学 2022-01-21 Antoine Lesage-Landry , Joshua A. Taylor , Duncan S. Callaway

This paper studies online convex optimization with unknown linear budget constraints, where only the gradient information of the objective and the bandit feedback of constraint functions are observed. We propose a safe and efficient…

最优化与控制 · 数学 2025-03-10 Shanqi Liu , Xin Liu

Regret minimization is a powerful tool for solving large-scale extensive-form games. State-of-the-art methods rely on minimizing regret locally at each decision point. In this work we derive a new framework for regret minimization on…

计算机科学与博弈论 · 计算机科学 2018-09-11 Gabriele Farina , Christian Kroer , Tuomas Sandholm

The literature on game-theoretic equilibrium finding predominantly focuses on single games or their repeated play. Nevertheless, numerous real-world scenarios feature playing a game sampled from a distribution of similar, but not identical…

计算机科学与博弈论 · 计算机科学 2024-02-21 David Sychrovský , Michal Šustr , Elnaz Davoodi , Michael Bowling , Marc Lanctot , Martin Schmid

To cope with changing environments, recent developments in online learning have introduced the concepts of adaptive regret and dynamic regret independently. In this paper, we illustrate an intrinsic connection between these two concepts by…

机器学习 · 计算机科学 2018-06-05 Lijun Zhang , Tianbao Yang , Rong Jin , Zhi-Hua Zhou