中文
相关论文

相关论文: Extended alternating structure-adapted proximal gr…

200 篇论文

The problem of minimizing the sum of nonsmooth, convex objective functions defined on a real Hilbert space over the intersection of fixed point sets of nonexpansive mappings, onto which the projections cannot be efficiently computed, is…

最优化与控制 · 数学 2016-02-08 Hideaki Iiduka

Bilevel optimization problems, encountered in fields such as economics, engineering, and machine learning, pose significant computational challenges due to their hierarchical structure and constraints at both upper and lower levels.…

最优化与控制 · 数学 2024-08-21 Mengwei Xu , Yu-Hong Dai , Xin-Wei Liu , Bo Wang

Multi-block separable convex problems recently received considerable attention. This class of optimization problems minimizes a separable convex objective function with linear constraints. The algorithmic challenges come from the fact that…

最优化与控制 · 数学 2016-08-18 Qia Li , Yuesheng Xu , Na Zhang

We analyze several generic proximal splitting algorithms well suited for large-scale convex nonsmooth optimization. We derive sublinear and linear convergence results with new rates on the function value suboptimality or distance to the…

最优化与控制 · 数学 2022-01-28 Laurent Condat , Grigory Malinovsky , Peter Richtárik

We study sampling problems associated with non-convex potentials that meanwhile lack smoothness. In particular, we consider target distributions that satisfy either logarithmic-Sobolev inequality or Poincar\'e inequality. Rather than…

机器学习 · 计算机科学 2023-02-21 Jiaming Liang , Yongxin Chen

In this paper, we consider a broad class of nonsmooth and nonconvex fractional programs, where the numerator can be written as the sum of a continuously differentiable convex function whose gradient is Lipschitz continuous and a proper…

最优化与控制 · 数学 2022-01-19 Radu Ioan Boţ , Minh N. Dao , Guoyin Li

This paper addresses a class of nonsmooth and nonconvex optimization problems defined on complete Riemannian manifolds. The objective function has a composite structure, combining convex, differentiable, and lower semicontinuous terms,…

We study alternating first-order algorithms with no inner loops for solving nonconvex-strongly-concave min-max problems. We show the convergence of the alternating gradient descent--ascent algorithm method by proposing a substantially…

最优化与控制 · 数学 2026-03-31 Guido Tapia-Riera , Camille Castera , Nicolas Papadakis

The proximal gradient algorithm has been popularly used for convex optimization. Recently, it has also been extended for nonconvex problems, and the current state-of-the-art is the nonmonotone accelerated proximal gradient algorithm.…

最优化与控制 · 数学 2017-05-24 Quanming Yao , James T. Kwok , Fei Gao , Wei Chen , Tie-Yan Liu

We consider a class of Riemannian optimization problems where the objective is the sum of a smooth function and a nonsmooth function, considered in the ambient space. This class of problems finds important applications in machine learning…

最优化与控制 · 数学 2024-11-27 Jiaxiang Li , Shiqian Ma , Tejes Srivastava

This paper studies a novel algorithm for nonconvex composite minimization which can be interpreted in terms of dual space nonlinear preconditioning for the classical proximal gradient method. The proposed scheme can be applied to additive…

最优化与控制 · 数学 2024-12-24 Emanuel Laude , Panagiotis Patrinos

In this paper, we present a new ellipsoid-type algorithm for solving nonsmooth problems with convex structure. Examples of such problems include nonsmooth convex minimization problems, convex-concave saddle-point problems and variational…

最优化与控制 · 数学 2021-06-28 Anton Rodomanov , Yurii Nesterov

In this paper, we propose a new algorithm to speed-up the convergence of accelerated proximal gradient (APG) methods. In order to minimize a convex function $f(\mathbf{x})$, our algorithm introduces a simple line search step after each…

机器学习 · 统计学 2014-06-19 Ziming Zhang , Venkatesh Saligrama

In this paper, we study an algorithm for solving a class of nonconvex and nonsmooth nonseparable optimization problems. Based on proximal alternating linearized minimization (PALM), we propose a new iterative algorithm which combines…

最优化与控制 · 数学 2023-06-14 Chenzheng Guo , Jing Zhao

In this paper, we consider nonconvex optimization problems with nonsmooth nonconvex objective function and nonlinear equality constraints. We assume that both the objective function and the functional constraints can be separated into 2…

最优化与控制 · 数学 2025-03-04 Lahcen El Bourkhissi , Ion Necoara

We study the convergence rate of the proximal incremental aggregated gradient (PIAG) method for minimizing the sum of a large number of smooth component functions (where the sum is strongly convex) and a non-smooth convex function. At each…

最优化与控制 · 数学 2016-11-28 Nuri Denizcan Vanli , Mert Gurbuzbalaban , Asu Ozdaglar

This paper explores a new class of constrained difference programming problems, where the objective and constraints are formulated as differences of functions, without requiring their convexity. To investigate such problems, novel variants…

最优化与控制 · 数学 2026-04-21 Boris S. Mordukhovich , Yixia Song , Shangzhi Zeng , Jin Zhang

We tackle highly nonconvex, nonsmooth composite optimization problems whose objectives comprise a Moreau-Yosida regularized term. Classical nonconvex proximal splitting algorithms, such as nonconvex ADMM, suffer from lack of convergence for…

最优化与控制 · 数学 2018-02-28 Emanuel Laude , Tao Wu , Daniel Cremers

In this paper we study nonconvex and nonsmooth optimization problems with semi-algebraic data, where the variables vector is split into several blocks of variables. The problem consists of one smooth function of the entire variables vector…

最优化与控制 · 数学 2017-02-09 Thomas Pock , Shoham Sabach

In this paper, for solving a broad class of large-scale nonconvex and nonsmooth optimization problems, we propose a stochastic two step inertial Bregman proximal alternating linearized minimization (STiBPALM) algorithm with variance-reduced…

最优化与控制 · 数学 2023-07-12 Chenzheng Guo , Jing Zhao , Qiao-Li Dong