中文
相关论文

相关论文: Sparse SVM with Hard-Margin Loss: a Newton-Augment…

200 篇论文

We propose a computational framework named iterative local adaptive majorize-minimization (I-LAMM) to simultaneously control algorithmic complexity and statistical error when fitting high dimensional models. I-LAMM is a two-stage…

统计理论 · 数学 2017-04-06 Jianqing Fan , Han Liu , Qiang Sun , Tong Zhang

This paper presents a stochastic approximation proximal subgradient (SAPS) method for stochastic convex-concave minimax optimization. By accessing unbiased and variance bounded approximate subgradients, we show that this algorithm exhibits…

最优化与控制 · 数学 2024-04-01 Yu-Hong Dai , Jiani Wang , Liwei Zhang

Existing support vector machines(SVM) models are sensitive to noise and lack sparsity, which limits their performance. To address these issues, we combine the elastic net loss with a robust loss framework to construct a sparse…

机器学习 · 统计学 2026-04-10 Haiyan Du , Hu Yang

This paper proposes and analyzes a proximal augmented Lagrangian (NL-IAPIAL) method for solving smooth nonconvex composite optimization problems with nonlinear $\cal K$-convex constraints, i.e., the constraints are convex with respect to…

最优化与控制 · 数学 2022-07-06 Weiwei Kong , Jefferson G. Melo , Renato D. C. Monteiro

The sparse nonlinear programming (SNP) problem has wide applications in signal and image processing, machine learning, pattern recognition, finance and management, etc. However, the computational challenge posed by SNP has not yet been well…

最优化与控制 · 数学 2021-05-26 Chen Zhao , Naihua Xiu , Hou-Duo Qi , Ziyan Luo

Support vector machine (SVM) has attracted great attentions for the last two decades due to its extensive applications, and thus numerous optimization models have been proposed. To distinguish all of them, in this paper, we introduce a new…

最优化与控制 · 数学 2021-04-06 Huajun Wang , Yuanhai Shao , Shenglong Zhou , Ce Zhang , Naihua Xiu

This paper presents a new linear hyperspectral unmixing method of the minimum volume class, termed \emph{simplex identification via split augmented Lagrangian} (SISAL). Following Craig's seminal ideas, hyperspectral linear unmixing amounts…

最优化与控制 · 数学 2016-11-17 Jose Bioucas-Dias

Despite the rise to fame of incremental variance-reduced methods in recent years, their use in nonsmooth optimization is still limited to few simple cases. This is due to the fact that existing methods require to evaluate the proximity…

最优化与控制 · 数学 2019-01-28 Fabian Pedregosa , Kilian Fatras , Mattia Casotto

We propose QPALM, a nonconvex quadratic programming (QP) solver based on the proximal augmented Lagrangian method. This method solves a sequence of inner subproblems which can be enforced to be strongly convex and which therefore admit a…

最优化与控制 · 数学 2024-04-17 Ben Hermans , Andreas Themelis , Panagiotis Patrinos

Robust statistical estimators offer resilience against outliers but are often computationally challenging, particularly in high-dimensional sparse settings. Modern optimization techniques are utilized for robust sparse association…

统计计算 · 统计学 2025-02-03 Pia Pfeiffer , Andreas Alfons , Peter Filzmoser

We introduce SPRING, a novel stochastic proximal alternating linearized minimization algorithm for solving a class of non-smooth and non-convex optimization problems. Large-scale imaging problems are becoming increasingly prevalent due to…

最优化与控制 · 数学 2021-01-20 Derek Driggs , Junqi Tang , Jingwei Liang , Mike Davies , Carola-Bibiane Schönlieb

Sparse inverse covariance selection is a fundamental problem for analyzing dependencies in high dimensional data. However, such a problem is difficult to solve since it is NP-hard. Existing solutions are primarily based on convex…

数值分析 · 计算机科学 2018-04-05 Ganzhao Yuan , Haoxian Tan , Wei-Shi Zheng

In this paper, we propose new methods to efficiently solve convex optimization problems encountered in sparse estimation, which include a new quasi-Newton method that avoids computing the Hessian matrix and improves efficiency, and we prove…

最优化与控制 · 数学 2023-09-06 Ryosuke Shimmura , Joe Suzuki

We propose an efficient algorithm for sparse signal reconstruction problems. The proposed algorithm is an augmented Lagrangian method based on the dual sparse reconstruction problem. It is efficient when the number of unknown variables is…

机器学习 · 统计学 2010-10-06 Ryota Tomioka , Masashi Sugiyama

We propose a new fast algorithm for solving one of the standard approaches to ill-posed linear inverse problems (IPLIP), where a (possibly non-smooth) regularizer is minimized under the constraint that the solution explains the observations…

最优化与控制 · 数学 2012-10-10 Manya V. Afonso , José M. Bioucas-Dias , Mário A. T. Figueiredo

We present a sparse Gauss-Newton solver for accelerated sensitivity analysis with applications to a wide range of equilibrium-constrained optimization problems. Dense Gauss-Newton solvers have shown promising convergence rates for inverse…

最优化与控制 · 数学 2021-07-12 Jonas Zehnder , Stelian Coros , Bernhard Thomaszewski

We develop a new inexact interior-point Lagrangian decomposition method to solve a wide range class of constrained composite convex optimization problems. Our method relies on four techniques: Lagrangian dual decomposition, self-concordant…

最优化与控制 · 数学 2019-04-22 Deyi Liu , Quoc Tran-Dinh

Stochastic proximal point methods have recently garnered renewed attention within the optimization community, primarily due to their desirable theoretical properties. Notably, these methods exhibit a convergence rate that is independent of…

最优化与控制 · 数学 2024-12-19 Elnur Gasanov , Peter Richtárik

This paper establishes the iteration-complexity of an inner accelerated inexact proximal augmented Lagrangian (IAIPAL) method for solving linearly-constrained smooth nonconvex composite optimization problems that is based on the classical…

最优化与控制 · 数学 2022-06-15 Jefferson G. Melo , Renato D. C. Monteiro , Weiwei Kong

In this paper, a proximal augmented Lagrangian homotopy (PAL-Hom) method for solving convex quadratic programming problems is proposed. This method takes the proximal augmented Lagrangian method as the outer iteration. To solve the proximal…

最优化与控制 · 数学 2020-01-22 Guoqiang Wang , Bo Yu