中文
相关论文

相关论文: A Variance-Reduced Stochastic Accelerated Primal D…

200 篇论文

We consider strongly-convex-strongly-concave saddle point problems assuming we have access to unbiased stochastic estimates of the gradients. We propose a stochastic accelerated primal-dual (SAPD) algorithm and show that SAPD sequence,…

最优化与控制 · 数学 2024-09-04 Xuan Zhang , Necdet Serhat Aybat , Mert Gürbüzbalaban

We consider stochastic strongly-convex-strongly-concave (SCSC) saddle point (SP) problems which frequently arise in applications ranging from distributionally robust learning to game theory and fairness in machine learning. We focus on the…

最优化与控制 · 数学 2023-07-17 Yassine Laguel , Necdet Serhat Aybat , Mert Gürbüzbalaban

We develop stochastic first-order primal-dual algorithms to solve a class of convex-concave saddle-point problems. When the saddle function is strongly convex in the primal variable, we develop the first stochastic restart scheme for this…

最优化与控制 · 数学 2021-04-13 Renbo Zhao

We consider (stochastic) convex-concave saddle point (SP) problems with high-dimensional decision variables, arising in various applications including machine learning problems. To contend with the challenges in computing full gradients, we…

最优化与控制 · 数学 2025-09-30 Erfan Yazdandoost Hamedani , Afrooz Jalilzadeh , Necdet Serhat Aybat

We consider a generic convex optimization problem associated with regularized empirical risk minimization of linear predictors. The problem structure allows us to reformulate it as a convex-concave saddle point problem. We propose a…

最优化与控制 · 数学 2015-09-10 Yuchen Zhang , Lin Xiao

We present a novel accelerated primal-dual (APD) method for solving a class of deterministic and stochastic saddle point problems (SPP). The basic idea of this algorithm is to incorporate a multi-step acceleration scheme into the…

最优化与控制 · 数学 2013-09-24 Yunmei Chen , Guanghui Lan , Yuyuan Ouyang

In this paper, we propose a variance-reduced primal-dual algorithm with Bregman distance for solving convex-concave saddle-point problems with finite-sum structure and nonbilinear coupling function. This type of problems typically arises in…

最优化与控制 · 数学 2021-06-02 Erfan Yazdandoost Hamedani , Afrooz Jalilzadeh

We consider saddle point problems which objective functions are the average of $n$ strongly convex-concave individual components. Recently, researchers exploit variance reduction methods to solve such problems and achieve linear-convergence…

机器学习 · 计算机科学 2019-09-17 Luo Luo , Cheng Chen , Yujun Li , Guangzeng Xie , Zhihua Zhang

We consider convex-concave saddle point problems with a separable structure and non-strongly convex functions. We propose an efficient stochastic block coordinate descent method using adaptive primal-dual updates, which enables flexible…

机器学习 · 统计学 2015-11-24 Zhanxing Zhu , Amos J. Storkey

In this paper, we propose a new primal-dual algorithmic framework for a class of convex-concave saddle point problems frequently arising from image processing and machine learning. Our algorithmic framework updates the primal variable…

最优化与控制 · 数学 2025-06-03 Hongjin He , Kai Wang , Jintao Yu

We propose a stochastic extension of the primal-dual hybrid gradient algorithm studied by Chambolle and Pock in 2011 to solve saddle point problems that are separable in the dual variable. The analysis is carried out for general…

In this paper, we design an inertial accelerated primal-dual algorithm to address the convex-concave saddle point problem, which is formulated as $\min_{x}\max_{y} f(x) + \langle Kx, y \rangle - g(y)$. Remarkably, both functions $f$ and $g$…

最优化与控制 · 数学 2024-04-17 X. He , N. J. Huang , Y. P. Fang

This paper presents a simple primal dual method named DPD which is a flexible framework for a class of saddle point problem with or without strongly convex component. The presented method has linearized version named LDPD and exact version…

最优化与控制 · 数学 2019-07-16 Zhipeng Xie , Jianwen Shi

In this paper, we study saddle point (SP) problems, focusing on convex-concave optimization involving functions that satisfy either two-sided quadratic functional growth (QFG) or two-sided quadratic gradient growth (QGG)--novel conditions…

最优化与控制 · 数学 2025-10-15 Cody Melcher , Afrooz Jalilzadeh , Erfan Yazdandoost Hamedani

We investigate a primal-dual (PD) method for the saddle point problem (SPP) that uses a linear approximation of the primal function instead of the standard proximal step, resulting in a linearized PD (LPD) method. For convex-strongly…

最优化与控制 · 数学 2023-05-19 Mohammad Khalafi , Digvijay Boob

In this paper we study the convex-concave saddle-point problem $\min_x \max_y f(x) + y^T \mathbf{A} x - g(y)$, where $f(x)$ and $g(y)$ are smooth and convex functions. We propose an Accelerated Primal-Dual Gradient Method (APDG) for solving…

最优化与控制 · 数学 2022-03-10 Dmitry Kovalev , Alexander Gasnikov , Peter Richtárik

We consider the convex-concave saddle point problem $\min_{\mathbf{x}}\max_{\mathbf{y}}\Phi(\mathbf{x},\mathbf{y})$, where the decision variables $\mathbf{x}$ and/or $\mathbf{y}$ subject to a multi-block structure and affine coupling…

最优化与控制 · 数学 2023-03-17 Junyu Zhang , Mengdi Wang , Mingyi Hong , Shuzhong Zhang

We introduce two novel primal-dual algorithms for addressing nonconvex, nonconcave, and nonsmooth saddle point problems characterized by the weak Minty Variational Inequality (MVI). The first algorithm, Nonconvex-Nonconcave Primal-Dual…

最优化与控制 · 数学 2025-06-19 Iyad Walwil , Olivier Fercoq

We consider stochastic convex optimization problems with affine constraints and develop several methods using either primal or dual approach to solve it. In the primal case, we use a special penalization technique to make the initial…

最优化与控制 · 数学 2020-11-13 Eduard Gorbunov , Darina Dvinskikh , Alexander Gasnikov

In this paper we propose a primal-dual proximal extragradient algorithm to solve the generalized Dantzig selector (GDS) estimation problem, based on a new convex-concave saddle-point (SP) reformulation. Our new formulation makes it possible…

机器学习 · 统计学 2016-06-03 Sangkyun Lee , Damian Brzyski , Malgorzata Bogdan
‹ 上一页 1 2 3 10 下一页 ›