中文
相关论文

相关论文: A convexity preserving nonconvex regularization fo…

200 篇论文

A fruitful approach for solving signal deconvolution problems consists of resorting to a frame-based convex variational formulation. In this context, parallel proximal algorithms and related alternating direction methods of multipliers have…

其他计算机科学 · 计算机科学 2015-05-28 Nelly Pustelnik , Jean-Christophe Pesquet , Caroline Chaux

High-dimensional matrix regression has been studied in various aspects, such as statistical properties, computational efficiency and application to specific instances including multivariate regression, system identification and matrix…

统计理论 · 数学 2024-03-06 Xin Li , Dongya Wu

We study the problem of estimation and testing in logistic regression with class-conditional noise in the observed labels, which has an important implication in the Positive-Unlabeled (PU) learning setting. With the key observation that the…

统计方法学 · 统计学 2020-08-14 Hyebin Song , Ran Dai , Garvesh Raskutti , Rina Foygel Barber

In high dimension, it is customary to consider Lasso-type estimators to enforce sparsity. For standard Lasso theory to hold, the regularization parameter should be proportional to the noise level, yet the latter is generally unknown in…

机器学习 · 统计学 2017-10-19 Mathurin Massias , Olivier Fercoq , Alexandre Gramfort , Joseph Salmon

We propose a variable smoothing algorithm for solving nonconvexly constrained nonsmooth optimization problems. The target problem has two issues that need to be addressed: (i) the nonconvex constraint and (ii) the nonsmooth term. To handle…

最优化与控制 · 数学 2024-04-04 Keita Kume , Isao Yamada

Sparsity promoting norms are frequently used in high dimensional regression. A limitation of such Lasso-type estimators is that the optimal regularization parameter depends on the unknown noise level. Estimators such as the concomitant…

机器学习 · 统计学 2020-09-04 Quentin Bertrand , Mathurin Massias , Alexandre Gramfort , Joseph Salmon

In this paper, we consider a nonconvex optimization problem with nonlinear equality constraints. We assume that both, the objective function and the functional constraints are locally smooth. For solving this problem, we propose a…

最优化与控制 · 数学 2025-05-08 Lahcen El Bourkhissi , Ion Necoara

We propose a general formulation of nonconvex and nonsmooth sparse optimization problems with convex set constraint, which can take into account most existing types of nonconvex sparsity-inducing terms, bringing strong applicability to a…

信息论 · 计算机科学 2021-08-23 Hao Wang , Fan Zhang , Yuanming Shi , Yaohua Hu

Classical analysis of convex and non-convex optimization methods often requires the Lipshitzness of the gradient, which limits the analysis to functions bounded by quadratics. Recent work relaxed this requirement to a non-uniform smoothness…

最优化与控制 · 数学 2023-11-06 Haochuan Li , Jian Qian , Yi Tian , Alexander Rakhlin , Ali Jadbabaie

Nonconvex methods have emerged as a dominant approach for low-rank matrix estimation, a problem that arises widely in machine learning and AI for learning and representing high-dimensional data. Existing analyses for these methods often…

机器学习 · 统计学 2026-05-08 Chengyu Cui , Gongjun Xu

We propose a communication- and computation-efficient distributed optimization algorithm using second-order information for solving ERM problems with a nonsmooth regularization term. Current second-order and quasi-Newton methods for this…

最优化与控制 · 数学 2018-05-29 Ching-pei Lee , Cong Han Lim , Stephen J. Wright

The Bayesian approach has proved to be a coherent approach to handle ill posed Inverse problems. However, the Bayesian calculations need either an optimization or an integral calculation. The maximum a posteriori (MAP) estimation requires…

数据分析、统计与概率 · 物理学 2007-05-23 A. Mohammad-Djafari

Optimization problems with convex quadratic cost and polyhedral constraints are ubiquitous in signal processing, automatic control and decision-making. We consider here an enlarged problem class that allows to encode logical conditions and…

最优化与控制 · 数学 2026-04-09 Alberto De Marchi

Concave regularization methods provide natural procedures for sparse recovery. However, they are difficult to analyze in the high dimensional setting. Only recently a few sparse recovery results have been established for some specific local…

机器学习 · 统计学 2012-02-14 Cun-Hui Zhang , Tong Zhang

The stripe noise existing in remote sensing images badly degrades the visual quality and restricts the precision of data analysis. Therefore, many destriping models have been proposed in recent years. In contrast to these existing models,…

数值分析 · 数学 2023-08-21 Chengjing Wang , Xile Zhao , Qingsong Wang , Zepei Ma , Peipei Tang

The multivariate linear regression model with shuffled data and additive Gaussian noise arises in various correspondence estimation and matching problems. Focusing on the denoising aspect of this problem, we provide a characterization the…

机器学习 · 统计学 2017-04-26 Ashwin Pananjady , Martin J. Wainwright , Thomas A. Courtade

We propose a method to reconstruct sparse signals degraded by a nonlinear distortion and acquired at a limited sampling rate. Our method formulates the reconstruction problem as a nonconvex minimization of the sum of a data fitting term and…

最优化与控制 · 数学 2023-01-19 Arthur Marmin , Marc Castella , Jean-Christophe Pesquet , Laurent Duval

In this paper, we analyse the recovery properties of nonconvex regularized $M$-estimators, under the assumption that the true parameter is of soft sparsity. In the statistical aspect, we establish the recovery bound for any stationary point…

统计理论 · 数学 2019-11-20 Xin Li , Dongya Wu , Chong Li , Jinhua Wang , Jen-Chih Yao

Consider the problem of simultaneous estimation and support recovery of the coefficient vector in a linear data model with additive Gaussian noise. We study the problem of estimating the model coefficients based on a recently proposed…

统计理论 · 数学 2022-11-15 Soham Jana , Henry Li , Yutaro Yamada , Ofir Lindenbaum

A computationally efficient method to solve non-convex programming problems with linear equality constraints is presented. The proposed method is based on a recursively feasible and descending sequential convex programming procedure proven…

最优化与控制 · 数学 2018-10-25 Josep Virgili-Llop , Marcello Romano