English
Related papers

Related papers: Online Monotone Optimization

200 papers

Many techniques for online optimization problems involve making decisions based solely on presently available information: fewer works take advantage of potential predictions. In this paper, we discuss the problem of online convex…

Optimization and Control · Mathematics 2019-02-04 Robert Ravier , Vahid Tarokh

We study the problem of no-regret learning algorithms for general monotone and smooth games and their last-iterate convergence properties. Specifically, we investigate the problem under bandit feedback and strongly uncoupled dynamics, which…

Computer Science and Game Theory · Computer Science 2024-08-19 Jing Dong , Baoxiang Wang , Yaoliang Yu

Many prediction domains, such as ad placement, recommendation, trajectory prediction, and document summarization, require predicting a set or list of options. Such lists are often evaluated using submodular reward functions that measure…

Machine Learning · Computer Science 2013-05-14 Stephane Ross , Jiaji Zhou , Yisong Yue , Debadeepta Dey , J. Andrew Bagnell

We consider online convex optimization with a zero-order oracle feedback. In particular, the decision maker does not know the explicit representation of the time-varying cost functions, or their gradients. At each time step, she observes…

Optimization and Control · Mathematics 2020-05-05 Tatiana Tatarenko , Maryam Kamgarpour

This paper introduces a dual-based algorithm framework for solving the regularized online resource allocation problems, which have potentially non-concave cumulative rewards, hard resource constraints, and a non-separable regularizer. Under…

Machine Learning · Computer Science 2023-07-18 Wanteng Ma , Ying Cao , Danny H. K. Tsang , Dong Xia

The performance of online convex optimization algorithms in a dynamic environment is often expressed in terms of the dynamic regret, which measures the decision maker's performance against a sequence of time-varying comparators. In the…

Machine Learning · Computer Science 2022-02-28 Nima Eshraghi , Ben Liang

We study a generalization of the online binary prediction with expert advice framework where at each round, the learner is allowed to pick $m\geq 1$ experts from a pool of $K$ experts and the overall utility is a modular or submodular…

Machine Learning · Computer Science 2023-05-25 Omid Sadeghi , Maryam Fazel

Traditional reinforcement learning usually assumes either episodic interactions with resets or continuous operation to minimize average or cumulative loss. While episodic settings have many theoretical results, resets are often unrealistic…

Optimization and Control · Mathematics 2026-01-13 Bianca Marin Moreno , Margaux Brégère , Pierre Gaillard , Nadia Oudjane

Much of modern learning theory has been split between two regimes: the classical offline setting, where data arrive independently, and the online setting, where data arrive adversarially. While the former model is often both computationally…

Machine Learning · Statistics 2022-06-01 Adam Block , Yuval Dagan , Noah Golowich , Alexander Rakhlin

Regret minimization has proved to be a versatile tool for tree-form sequential decision making and extensive-form games. In large two-player zero-sum imperfect-information games, modern extensions of counterfactual regret minimization (CFR)…

Computer Science and Game Theory · Computer Science 2021-03-09 Gabriele Farina , Tuomas Sandholm

Recently, much work has been done on extending the scope of online learning and incremental stochastic optimization algorithms. In this paper we contribute to this effort in two ways: First, based on a new regret decomposition and a…

Machine Learning · Computer Science 2017-09-12 Pooria Joulani , András György , Csaba Szepesvári

In this paper, we consider the problem of distributed online convex optimization, where a network of local agents aim to jointly optimize a convex function over a period of multiple time steps. The agents do not have any information about…

Optimization and Control · Mathematics 2019-11-13 Yan Zhang , Robert J. Ravier , Michael M. Zavlanos , Vahid Tarokh

The notion of \emph{policy regret} in online learning is a well defined? performance measure for the common scenario of adaptive adversaries, which more traditional quantities such as external regret do not take into account. We revisit the…

Machine Learning · Computer Science 2020-03-24 Raman Arora , Michael Dinitz , Teodor V. Marinov , Mehryar Mohri

We consider a fair resource allocation problem in the no-regret setting against an unrestricted adversary. The objective is to allocate resources equitably among several agents in an online fashion so that the difference of the aggregate…

Machine Learning · Computer Science 2023-03-14 Abhishek Sinha , Ativ Joshi , Rajarshi Bhattacharjee , Cameron Musco , Mohammad Hajiesmaili

We consider the online convex optimization problem. In the setting of arbitrary sequences and finite set of parameters, we establish a new fast-rate quantile regret bound. Then we investigate the optimization into the L1-ball by…

Statistics Theory · Mathematics 2018-05-24 Pierre Gaillard , Olivier Wintenberger

To deal with changing environments, a new performance measure -- adaptive regret, defined as the maximum static regret over any interval, was proposed in online learning. Under the setting of online convex optimization, several algorithms…

Machine Learning · Computer Science 2025-08-04 Lijun Zhang , Wenhao Yang , Guanghui Wang , Wei Jiang , Zhi-Hua Zhou

In this paper we focus on the problem of Online Principal Component Analysis in the regret minimization framework. For this problem, all existing regret minimization algorithms for the fully-adversarial setting are based on a positive…

Machine Learning · Computer Science 2019-02-01 Dan Garber

To cope with changing environments, recent developments in online learning have introduced the concepts of adaptive regret and dynamic regret independently. In this paper, we illustrate an intrinsic connection between these two concepts by…

Machine Learning · Computer Science 2018-06-05 Lijun Zhang , Tianbao Yang , Rong Jin , Zhi-Hua Zhou

In the random-order model for online learning, the sequence of losses is chosen upfront by an adversary and presented to the learner after a random permutation. Any random-order input is \emph{asymptotically} equivalent to a stochastic…

Machine Learning · Computer Science 2025-10-06 Martino Bernasconi , Andrea Celli , Riccardo Colini-Baldeschi , Federico Fusco , Stefano Leonardi , Matteo Russo

We address the problem of simultaneously learning and control in an online receding horizon control setting. We consider the control of an unknown linear dynamical system with general cost functions and affine constraints on the control…

Optimization and Control · Mathematics 2022-11-02 Deepan Muthirayan , Jianjun Yuan , Pramod P. Khargonekar
‹ Prev 1 4 5 6 7 8 10 Next ›