中文
相关论文

相关论文: Optimal High-Probability Regret for Online Convex …

200 篇论文

This paper develops projection-free algorithms for online convex optimization with stochastic constraints. We design an online primal-dual projection-free framework that can take any projection-free algorithms developed for online convex…

最优化与控制 · 数学 2023-05-17 Duksang Lee , Nam Ho-Nguyen , Dabeen Lee

In this paper, the problem of distributed optimization is studied via a network of agents. Each agent only has access to a stochastic gradient of its own objective function in the previous time, and can communicate with its neighbors via a…

最优化与控制 · 数学 2024-01-29 Yuchen Yang , Kaihong Lu , Long Wang

We consider the problem of online boosting for regression tasks, when only limited information is available to the learner. We give an efficient regret minimization method that has two implications: an online boosting algorithm with noisy…

机器学习 · 计算机科学 2020-07-24 Nataly Brukhim , Elad Hazan

In this paper, we consider the problem of distributed online convex optimization, where a network of local agents aim to jointly optimize a convex function over a period of multiple time steps. The agents do not have any information about…

最优化与控制 · 数学 2019-11-13 Yan Zhang , Robert J. Ravier , Michael M. Zavlanos , Vahid Tarokh

Distributed online convex optimization (D-OCO) is a powerful paradigm for modeling distributed scenarios with streaming data. However, the communication cost between local learners and the central server is substantial in large-scale…

机器学习 · 计算机科学 2026-04-13 Sifan Yang , Dan-Yue Li , Lijun Zhang

This paper studies online optimization from a high-level unified theoretical perspective. We not only generalize both Optimistic-DA and Optimistic-MD in normed vector space, but also unify their analysis methods for dynamic regret. Regret…

机器学习 · 计算机科学 2022-02-15 Qing-xin Meng , Jian-wei Liu

We consider online convex optimization (OCO) with multi-slot feedback delay, where an agent makes a sequence of online decisions to minimize the accumulation of time-varying convex loss functions, subject to short-term and long-term…

信息论 · 计算机科学 2021-08-17 Juncheng Wang , Ben Liang , Min Dong , Gary Boudreau , Hatem Abou-zeid

We study online convex optimization under stochastic sub-gradient observation faults, where we introduce adaptive algorithms with minimax optimal regret guarantees. We specifically study scenarios where our sub-gradient observations can be…

机器学习 · 计算机科学 2019-04-23 Hakan Gokcesu , Suleyman S. Kozat

We consider the problem of controlling an unknown linear dynamical system under adversarially changing convex costs and full feedback of both the state and cost function. We present the first computationally-efficient algorithm that attains…

机器学习 · 计算机科学 2022-06-06 Asaf Cassel , Alon Cohen , Tomer Koren

Contextual bandit with linear reward functions is among one of the most extensively studied models in bandit and online learning research. Recently, there has been increasing interest in designing \emph{locally private} linear contextual…

机器学习 · 统计学 2024-04-16 Jiachun Li , David Simchi-Levi , Yining Wang

We consider the problem of online regret minimization in linear bandits with access to prior observations (offline data) from the underlying bandit model. There are numerous applications where extensive offline data is often available, such…

机器学习 · 计算机科学 2026-05-13 Sushant Vijayan , Arun Suggala , Karthikeyan Shanmugam , Soumyabrata Pal

The problem of constrained online convex optimization is considered, where at each round, once a learner commits to an action $x_t \in \mathcal{X} \subset \mathbb{R}^d$, a convex loss function $f_t$ and a convex constraint function $g_t$…

机器学习 · 计算机科学 2026-03-24 Haricharan Balasundaram , Karthick Krishna Mahendran , Rahul Vaze

We investigate the online nonsubmodular optimization with delayed feedback in the bandit setting, where the loss function is $\alpha$-weakly DR-submodular and $\beta$-weakly DR-supermodular. Previous work has established an…

机器学习 · 计算机科学 2025-08-04 Sifan Yang , Yuanyu Wan , Lijun Zhang

In this paper, we develop a novel virtual-queue-based online algorithm for online convex optimization (OCO) problems with long-term and time-varying constraints and conduct a performance analysis with respect to the dynamic regret and…

最优化与控制 · 数学 2021-11-16 Qingsong Liu , Wenfei Wu , Longbo Huang , Zhixuan Fang

We investigate constrained online convex optimization, in which decisions must belong to a fixed and typically complicated domain, and are required to approximately satisfy additional time-varying constraints over the long term. In this…

机器学习 · 计算机科学 2025-01-28 Yibo Wang , Yuanyu Wan , Lijun Zhang

A stochastic combinatorial semi-bandit is an online learning problem where at each step a learning agent chooses a subset of ground items subject to constraints, and then observes stochastic weights of these items and receives their sum as…

机器学习 · 计算机科学 2017-06-08 Branislav Kveton , Zheng Wen , Azin Ashkan , Csaba Szepesvari

We introduce a computationally efficient algorithm for zeroth-order bandit convex optimisation and prove that in the adversarial setting its regret is at most $d^{3.5} \sqrt{n} \mathrm{polylog}(n, d)$ with high probability where $d$ is the…

最优化与控制 · 数学 2024-06-11 Hidde Fokkema , Dirk van der Hoeven , Tor Lattimore , Jack J. Mayo

We present the first high-probability optimal regret bound for a policy optimization technique applied to the problem of stochastic contextual multi-armed bandit (CMAB) with general offline function approximation. Our algorithm is both…

机器学习 · 计算机科学 2026-02-17 Orin Levy , Yishay Mansour

We study a new class of online learning problems where each of the online algorithm's actions is assigned an adversarial value, and the loss of the algorithm at each step is a known and deterministic function of the values assigned to its…

机器学习 · 计算机科学 2014-05-20 Ofer Dekel , Jian Ding , Tomer Koren , Yuval Peres

We study an online linear optimization (OLO) problem in which the learner is provided access to $K$ "hint" vectors in each round prior to making a decision. In this setting, we devise an algorithm that obtains logarithmic regret whenever…

机器学习 · 计算机科学 2020-10-08 Aditya Bhaskara , Ashok Cutkosky , Ravi Kumar , Manish Purohit