中文
相关论文

相关论文: Proximal Point Method for Online Saddle Point Prob…

200 篇论文

We propose new algorithms with provable performance for online binary optimization subject to general constraints and in dynamic settings. We consider the subset of problems in which the objective function is submodular. We propose the…

最优化与控制 · 数学 2024-05-03 Antoine Lesage-Landry , Julien Pallage

We consider a repeatedly played generalized Nash equilibrium game. This induces a multi-agent online learning problem with joint constraints. An important challenge in this setting is that the feasible set for each agent depends on the…

机器学习 · 计算机科学 2024-10-04 Sarah Sachs , Hedi Hadiji , Tim van Erven , Mathias Staudigl

We consider the problem of computing an equilibrium in a class of \textit{nonlinear generalized Nash equilibrium problems (NGNEPs)} in which the strategy sets for each player are defined by equality and inequality constraints that may…

最优化与控制 · 数学 2023-02-07 Michael I. Jordan , Tianyi Lin , Manolis Zampetakis

We introduce the online stochastic Convex Programming (CP) problem, a very general version of stochastic online problems which allows arbitrary concave objectives and convex feasibility constraints. Many well-studied problems like online…

机器学习 · 计算机科学 2014-10-29 Shipra Agrawal , Nikhil R. Devanur

The task of computing approximate Nash equilibria in large zero-sum extensive-form games has received a tremendous amount of attention due mainly to the Annual Computer Poker Competition. Immediately after its inception, two competing and…

人工智能 · 计算机科学 2014-11-19 Kevin Waugh , J. Andrew Bagnell

This paper addresses an online convex optimization problem where the cost function at each step depends on a history of past decisions (i.e., memory), and the decision maker has access to limited predictions of future cost values within a…

最优化与控制 · 数学 2025-12-29 Zhengmiao Wang , Zhi-Wei Liu , Ming Chi , Xiaoling Wang , Housheng Su , Lintao Ye

Recent focus on robustness to adversarial attacks for deep neural networks produced a large variety of algorithms for training robust models. Most of the effective algorithms involve solving the min-max optimization problem for training…

机器学习 · 计算机科学 2021-03-03 Yasaman Esfandiari , Aditya Balu , Keivan Ebrahimi , Umesh Vaidya , Nicola Elia , Soumik Sarkar

In this work, we introduce the concept of non-negative weighted regret, an extension of non-negative regret \cite{anagnostides2022last} in games. Investigating games with non-negative weighted regret helps us to understand games with…

计算机科学与博弈论 · 计算机科学 2025-05-22 Nanxiang Zhou , Jing Dong , Baoxiang Wang

In this paper we propose a stochastic primal dual fixed point method (SPDFP) for solving the sum of two proper lower semi-continuous convex function and one of which is composite. The method is based on the primal dual fixed point method…

最优化与控制 · 数学 2020-04-21 YaNanZhu , XiaoqunZhang

We consider stochastic strongly-convex-strongly-concave (SCSC) saddle point (SP) problems which frequently arise in applications ranging from distributionally robust learning to game theory and fairness in machine learning. We focus on the…

最优化与控制 · 数学 2023-07-17 Yassine Laguel , Necdet Serhat Aybat , Mert Gürbüzbalaban

We study episodic linear mixture MDPs with the unknown transition and adversarial rewards under full-information feedback, employing dynamic regret as the performance measure. We start with in-depth analyses of the strengths and limitations…

机器学习 · 计算机科学 2024-11-06 Long-Fei Li , Peng Zhao , Zhi-Hua Zhou

This paper studies the problem of controlling linear dynamical systems subject to point-wise-in-time constraints. We present an algorithm similar to online gradient descent, that can handle time-varying and a priori unknown convex cost…

最优化与控制 · 数学 2021-11-03 Marko Nonhoff , Matthias A. Müller

We study the regret of optimal strategies for online convex optimization games. Using von Neumann's minimax theorem, we show that the optimal regret in this adversarial setting is closely related to the behavior of the empirical…

机器学习 · 计算机科学 2009-04-01 Jacob Abernethy , Alekh Agarwal , Peter L. Bartlett , Alexander Rakhlin

In this paper, we consider the problem of prediction with expert advice in dynamic environments. We choose tracking regret as the performance metric and develop two adaptive and efficient algorithms with data-dependent tracking regret…

机器学习 · 计算机科学 2020-02-11 Shiyin Lu , Lijun Zhang

In this paper, we consider an online optimization process, where the objective functions are not convex (nor concave) but instead belong to a broad class of continuous submodular functions. We first propose a variant of the Frank-Wolfe…

机器学习 · 统计学 2018-02-19 Lin Chen , Hamed Hassani , Amin Karbasi

We consider the problem of Online Convex Optimization (OCO) with two-point bandit feedback. In this setting, a player attempts to minimize a sequence of adversarially generated convex loss functions, while only observing the value of each…

机器学习 · 计算机科学 2026-04-07 Haishan Ye

A natural goal when designing online learning algorithms for non-stationary environments is to bound the regret of the algorithm in terms of the temporal variation of the input sequence. Intuitively, when the variation is small, it should…

机器学习 · 计算机科学 2021-12-08 Gautam Goel , Babak Hassibi

We study the problem of Online Convex Optimization (OCO) with memory, which allows loss functions to depend on past decisions and thus captures temporal effects of learning problems. In this paper, we introduce dynamic policy regret as the…

机器学习 · 计算机科学 2023-08-16 Peng Zhao , Yu-Hu Yan , Yu-Xiang Wang , Zhi-Hua Zhou

Saddle-point or primal-dual methods have recently attracted renewed interest as a systematic technique to design distributed algorithms which solve convex optimization problems. When implemented online for streaming data or as dynamic…

最优化与控制 · 数学 2021-04-22 John W. Simpson-Porco , Bala Kameshwar Poolla , Nima Monshizadeh , Florian Dorfler

The Primal-Dual (PD) algorithm is widely used in convex optimization to determine saddle points. While the stability of the PD algorithm can be easily guaranteed, strict contraction is nontrivial to establish in most cases. This work…

最优化与控制 · 数学 2018-11-21 Hung D. Nguyen , Thanh Long Vu , Konstantin Turitsyn , Jean-Jacques Slotine