中文
相关论文

相关论文: Upper-Linearizability of Online Non-Monotone DR-Su…

200 篇论文

We analyze and evaluate an online gradient descent algorithm with adaptive per-coordinate adjustment of learning rates. Our algorithm can be thought of as an online version of batch gradient descent with a diagonal preconditioner. This…

机器学习 · 计算机科学 2010-02-26 Matthew Streeter , H. Brendan McMahan

In this paper, we address tracking of a time-varying parameter with unknown dynamics. We formalize the problem as an instance of online optimization in a dynamic setting. Using online gradient descent, we propose a method that sequentially…

机器学习 · 计算机科学 2016-03-17 Aryan Mokhtari , Shahin Shahrampour , Ali Jadbabaie , Alejandro Ribeiro

We consider the problem of maximizing a non-monotone DR-submodular function subject to a cardinality constraint. Diminishing returns (DR) submodularity is a generalization of the diminishing returns property for functions defined over the…

数据结构与算法 · 计算机科学 2017-09-05 Ali Khodabakhsh , Evdokia Nikolova

We address the online linear optimization problem with bandit feedback. Our contribution is twofold. First, we provide an algorithm (based on exponential weights) with a regret of order $\sqrt{d n \log N}$ for any finite action set with $N$…

机器学习 · 计算机科学 2012-02-15 Sébastien Bubeck , Nicolò Cesa-Bianchi , Sham M. Kakade

This paper presents a unified approach for maximizing continuous DR-submodular functions that encompasses a range of settings and oracle access types. Our approach includes a Frank-Wolfe type offline algorithm for both monotone and…

机器学习 · 计算机科学 2024-01-15 Mohammad Pedramfar , Christopher John Quinn , Vaneet Aggarwal

We address the online unconstrained submodular maximization problem (Online USM), in a setting with stochastic bandit feedback. In this framework, a decision-maker receives noisy rewards from a non monotone submodular function taking values…

机器学习 · 计算机科学 2025-02-13 Julien Zhou , Pierre Gaillard , Thibaud Rahier , Julyan Arbel

We study the problem of online learning (OL) from revealed preferences: a learner wishes to learn a non-strategic agent's private utility function through observing the agent's utility-maximizing actions in a changing environment. We adopt…

最优化与控制 · 数学 2021-06-07 Violet Xinying Chen , Fatma Kılınç-Karzan

We consider the problem of online learning in Linear Quadratic Control systems whose state transition and state-action transition matrices $A$ and $B$ may be initially unknown. We devise an online learning algorithm and provide guarantees…

机器学习 · 计算机科学 2021-09-30 Yassir Jedra , Alexandre Proutiere

Online learning algorithms for dynamical systems provide finite time guarantees for control in the presence of sequentially revealed cost functions. We pose the classical linear quadratic tracking problem in the framework of online…

系统与控制 · 电气工程与系统科学 2024-10-18 Aren Karapetyan , Diego Bolliger , Anastasios Tsiamis , Efe C. Balta , John Lygeros

In the convex optimization approach to online regret minimization, many methods have been developed to guarantee a $O(\sqrt{T})$ bound on regret for subdifferentiable convex loss functions with bounded subgradients, by using a reduction to…

机器学习 · 计算机科学 2016-09-20 Arthur Flajolet , Patrick Jaillet

This work focuses on dynamic regret of online convex optimization that compares the performance of online learning to a clairvoyant who knows the sequence of loss functions in advance and hence selects the minimizer of the loss function at…

机器学习 · 计算机科学 2016-05-17 Tianbao Yang , Lijun Zhang , Rong Jin , Jinfeng Yi

In repeated interaction problems with adaptive agents, our objective often requires anticipating and optimizing over the space of possible agent responses. We show that many problems of this form can be cast as instances of online…

机器学习 · 计算机科学 2024-06-28 William Brown , Christos Papadimitriou , Tim Roughgarden

In this paper, we propose an online convex optimization approach with two different levels of adaptivity. On a higher level, our approach is agnostic to the unknown types and curvatures of the online functions, while at a lower level, it…

机器学习 · 计算机科学 2024-04-17 Yu-Hu Yan , Peng Zhao , Zhi-Hua Zhou

In this paper, the problem of distributed optimization is studied via a network of agents. Each agent only has access to a stochastic gradient of its own objective function in the previous time, and can communicate with its neighbors via a…

最优化与控制 · 数学 2024-01-29 Yuchen Yang , Kaihong Lu , Long Wang

We develop parameter-free algorithms for unconstrained online learning with regret guarantees that scale with the gradient variation $V_T(u) = \sum_{t=2}^T \|\nabla f_t(u)-\nabla f_{t-1}(u)\|^2$. For $L$-smooth convex loss, we provide…

机器学习 · 计算机科学 2026-04-14 Yuheng Zhao , Andrew Jacobsen , Nicolò Cesa-Bianchi , Peng Zhao

We investigate the continuous non-monotone DR-submodular maximization problem subject to a down-closed convex solvable constraint. Our first contribution is to construct an example to demonstrate that (first-order) stationary points can…

数据结构与算法 · 计算机科学 2024-03-27 Shengminjie Chen , Donglei Du , Wenguo Yang , Dachuan Xu , Suixiang Gao

Recently, several universal methods have been proposed for online convex optimization which can handle convex, strongly convex and exponentially concave cost functions simultaneously. However, most of these algorithms have been designed…

机器学习 · 计算机科学 2023-02-14 Arnold Salas

Motivated by the stringent safety requirements that are often present in real-world applications, we study a safe online convex optimization setting where the player needs to simultaneously achieve sublinear regret and zero constraint…

机器学习 · 计算机科学 2024-07-17 Spencer Hutchinson , Mahnoosh Alizadeh

We consider the problem of online prediction in a marginally stable linear dynamical system subject to bounded adversarial or (non-isotropic) stochastic perturbations. This poses two challenges. Firstly, the system is in general…

机器学习 · 计算机科学 2020-11-24 Udaya Ghai , Holden Lee , Karan Singh , Cyril Zhang , Yi Zhang

In online inverse linear optimization, a learner observes time-varying sets of feasible actions and an agent's optimal actions, selected by solving linear optimization over the feasible actions. The learner sequentially makes predictions of…

机器学习 · 计算机科学 2025-05-23 Shinsaku Sakaue , Taira Tsuchiya , Han Bao , Taihei Oki