中文
相关论文

相关论文: On Randomized Fictitious Play for Approximating Sa…

200 篇论文

We propose an alternating subgradient method with non-constant step sizes for solving convex-concave saddle-point problems associated with general convex-concave functions. We assume that the sequence of our step sizes is not summable but…

最优化与控制 · 数学 2023-05-26 Hui Ouyang

This paper studies quasi-Newton methods for solving strongly-convex-strongly-concave saddle point problems (SPP). We propose greedy and random Broyden family updates for SPP, which have explicit local superlinear convergence rate of…

最优化与控制 · 数学 2022-04-12 Chengchang Liu , Luo Luo

We consider the problem of minimizing a convex function over the intersection of finitely many simple sets which are easy to project onto. This is an important problem arising in various domains such as machine learning. The main difficulty…

最优化与控制 · 数学 2017-10-19 Achintya Kundu , Francis Bach , Chiranjib Bhattacharyya

In this note, we develop Fourier approximation methods for the solutions of first-order nonlocal mean-field games (MFG) systems. Using Fourier expansion techniques, we approximate a given MFG system by a simpler one that is equivalent to a…

偏微分方程分析 · 数学 2019-01-21 Levon Nurbekyan , Joao Saude

While Nash equilibrium in extensive-form games is well understood, very little is known about the properties of extensive-form correlated equilibrium (EFCE), both from a behavioral and from a computational point of view. In this setting,…

计算机科学与博弈论 · 计算机科学 2019-10-29 Gabriele Farina , Chun Kai Ling , Fei Fang , Tuomas Sandholm

Convex approximation sets for multiobjective optimization problems are a well-studied relaxation of the common notion of approximation sets. Instead of approximating each image of a feasible solution by the image of some solution in the…

最优化与控制 · 数学 2023-06-13 Stephan Helfrich , Stefan Ruzika , Clemens Thielen

We analyze a simple randomized subgradient method for approximating solutions to stochastic systems of convex functional constraints, the only input to the algorithm being the size of minibatches. By introducing a new notion of what is…

最优化与控制 · 数学 2021-08-30 James Renegar , Song Zhou

Computing saddle points with a prescribed Morse index on potential energy surfaces is crucial for characterizing transition states for nosie-induced rare transition events in physics and chemistry. Many numerical algorithms for this type of…

最优化与控制 · 数学 2025-01-28 Shuting Gu , Hao Zhang , Xiaoqun Zhang , Xiang Zhou

We study the online saddle point problem, an online learning problem where at each iteration a pair of actions need to be chosen without knowledge of the current and future (convex-concave) payoff functions. The objective is to minimize the…

机器学习 · 统计学 2020-04-07 Adrian Rivera , He Wang , Huan Xu

A major approach to saddle point optimization $\min_x\max_y f(x, y)$ is a gradient based approach as is popularized by generative adversarial networks (GANs). In contrast, we analyze an alternative approach relying only on an oracle that…

最优化与控制 · 数学 2021-04-02 Youhei Akimoto

Optimizing non-convex functions is of primary importance in the vast majority of machine learning algorithms. Even though many gradient descent based algorithms have been studied, successive convex approximation based algorithms have been…

最优化与控制 · 数学 2019-03-06 Amrit Singh Bedi , Ketan Rajawat , Vaneet Aggarwal

In this paper we consider solving saddle point problems using two variants of Gradient Descent-Ascent algorithms, Extra-gradient (EG) and Optimistic Gradient Descent Ascent (OGDA) methods. We show that both of these algorithms admit a…

最优化与控制 · 数学 2019-09-06 Aryan Mokhtari , Asuman Ozdaglar , Sarath Pattathil

In this paper we study the problem of maximizing the distance to a given point over an intersection of balls. It was already known that this problem can be solved in polynomial time and space if the given point is not in the convex hull of…

最优化与控制 · 数学 2023-10-09 Marius Costandin , Beniamin Costandin

In Feinstein and Rudloff (2023), it was shown that the set of Nash equilibria for any non-cooperative $N$ player game coincides with the set of Pareto optimal points of a certain vector optimization problem with non-convex ordering cone. To…

最优化与控制 · 数学 2024-04-24 Zachary Feinstein , Niklas Hey , Birgit Rudloff

In this paper, we consider the problem of finding an almost surely common fixed point of a family of paracontraction maps indexed on a probability space, which we refer to as the stochastic feasibility problem. We show that a random…

动力系统 · 数学 2020-08-12 Edgar Matias , Majela Pentón Machado

Lagrangian relaxation and approximate optimization algorithms have received much attention in the last two decades. Typically, the running time of these methods to obtain a $\epsilon$ approximate solution is proportional to…

数据结构与算法 · 计算机科学 2007-05-23 Elad Hazan

The optimistic gradient method has seen increasing popularity for solving convex-concave saddle point problems. To analyze its iteration complexity, a recent work [arXiv:1906.01115] proposed an interesting perspective that interprets this…

最优化与控制 · 数学 2024-01-11 Ruichen Jiang , Aryan Mokhtari

Machine learning problems such as neural network training, tensor decomposition, and matrix factorization, require local minimization of a nonconvex function. This local minimization is challenged by the presence of saddle points, of which…

最优化与控制 · 数学 2018-07-23 Santiago Paternain , Aryan Mokhtari , Alejandro Ribeiro

This paper studies the saddle point problem of polynomials. We give an algorithm for computing saddle points. It is based on solving Lasserre's hierarchy of semidefinite relaxations. Under some genericity assumptions on defining…

最优化与控制 · 数学 2021-06-10 Jiawang Nie , Zi Yang , Guangming Zhou

The saddlepoint approximation gives an approximation to the density of a random variable in terms of its moment generating function. When the underlying random variable is itself the sum of $n$ unobserved i.i.d. terms, the basic classical…

统计理论 · 数学 2022-01-25 Jesse Goodman