中文
相关论文

相关论文: A Unifying Framework of High-Dimensional Sparse Es…

200 篇论文

Sparse estimation for Gaussian graphical models is a crucial technique for making the relationships among numerous observed variables more interpretable and quantifiable. Various methods have been proposed, including graphical lasso, which…

机器学习 · 计算机科学 2024-08-09 Tomokaze Shiratori , Yuichi Takano

Recently, several nonconvex sparse regularizers which can preserve the convexity of the cost function have received increasing attention. This paper proposes a general class of such convexity-preserving (CP) regularizers, termed partially…

信号处理 · 电气工程与系统科学 2023-11-30 Yi Zhang , Isao Yamada

With the increasing interest in applying the methodology of difference-of-convex (dc) optimization to diverse problems in engineering and statistics, this paper establishes the dc property of many well-known functions not previously known…

最优化与控制 · 数学 2019-02-20 Maher Nouiehed , Jong-Shi Pang , Meisam Razaviyayn

We present the framework of slowly varying regression under sparsity, allowing sparse regression models to exhibit slow and sparse variations. The problem of parameter estimation is formulated as a mixed-integer optimization problem. We…

机器学习 · 计算机科学 2023-11-14 Dimitris Bertsimas , Vassilis Digalakis , Michael Linghzi Li , Omar Skali Lami

In this work we consider numerical efficiency and convergence rates for solvers of non-convex multi-penalty formulations when reconstructing sparse signals from noisy linear measurements. We extend an existing approach, based on reduction…

信息论 · 计算机科学 2021-01-15 Zeljko Kereta , Johannes Maly , Valeriya Naumova

We develop two penalty based difference of convex (DC) algorithms for solving chance constrained programs. First, leveraging a rank-based DC decomposition of the chance constraint, we propose a proximal penalty based DC algorithm in the…

最优化与控制 · 数学 2026-03-16 Zhiping Li , Nan Jiang , Rujun Jiang

Difference-of-Convex (DC) minimization, referring to the problem of minimizing the difference of two convex functions, has been found rich applications in statistical learning and studied extensively for decades. However, existing methods…

最优化与控制 · 数学 2022-12-20 Ganzhao Yuan

We consider optimization problems containing nonconvex quadratic functions for which semidefinite programming (SDP) relaxations often yield strong bounds. We investigate linear inequalities that outer approximate the positive semidefinite…

最优化与控制 · 数学 2026-03-11 Oktay Günlük , Paul Jünger , Jeff Linderoth , Andrea Lodi , James Luedtke

High-dimensional learning problems, where the number of features exceeds the sample size, often require sparse regularization for effective prediction and variable selection. While established for fully supervised data, these techniques…

机器学习 · 计算机科学 2026-01-01 The Tien Mai , Mai Anh Nguyen , Trung Nghia Nguyen

By the asymptotic oracle property, non-convex penalties represented by minimax concave penalty (MCP) and smoothly clipped absolute deviation (SCAD) have attracted much attentions in high-dimensional data analysis, and have been widely used…

统计计算 · 统计学 2021-11-24 Peili Li , Min Liu , Zhou Yu

We propose a local regularization of elliptic optimal control problems which involves the nonconvex $L^q$ fractional penalizations in the cost function. The proposed \emph{Huber type} regularization allows us to formulate the PDE…

最优化与控制 · 数学 2019-04-23 Pedro Merino

In this paper, we consider the optimization problem of minimizing a continuously differentiable function subject to both convex constraints and sparsity constraints. By exploiting a mixed-integer reformulation from the literature, we define…

最优化与控制 · 数学 2021-04-28 M. Lapucci , T. Levato , F. Rinaldi , M. Sciandrone

In high-dimensional regression modelling, the number of candidate covariates to be included in the predictor is quite large, and variable selection is crucial. In this work, we propose a new penalty able to guarantee both sparse variable…

统计方法学 · 统计学 2022-12-19 Daniele Cuntrera , Luigi Augugliaro , Vito M. R. Muggeo

Nonconvex penalty methods for sparse modeling in linear regression have been a topic of fervent interest in recent years. Herein, we study a family of nonconvex penalty functions that we call the trimmed Lasso and that offers exact control…

统计方法学 · 统计学 2017-08-16 Dimitris Bertsimas , Martin S. Copenhaver , Rahul Mazumder

Sparse Gaussian graphical models characterize sparse dependence relationships between random variables in a network. To estimate multiple related Gaussian graphical models on the same set of variables, we formulate a hierarchical model,…

统计方法学 · 统计学 2014-06-10 Yuancheng Zhu , Rina Foygel Barber

In exact sparse optimization problems on Rd (also known as sparsity constrained problems), one looks for solution that have few nonzero components. In this paper, we consider problems where sparsity is exactly measured either by the…

最优化与控制 · 数学 2019-02-14 Jean-Philippe Chancelier , Michel De Lara , Ponts Paristech

This paper addresses the problem of sparsity penalized least squares for applications in sparse signal processing, e.g. sparse deconvolution. This paper aims to induce sparsity more strongly than L1 norm regularization, while avoiding…

机器学习 · 计算机科学 2015-06-15 Ivan W. Selesnick , Ilker Bayram

We address the minimization of a smooth objective function under an $\ell_0$-constraint and simple convex constraints. When the problem has no constraints except the $\ell_0$-constraint, some efficient algorithms are available; for example,…

最优化与控制 · 数学 2017-01-31 Katsuya Tono , Akiko Takeda , Jun-ya Gotoh

In this paper we study nonconvex penalization using Bernstein functions whose first-order derivatives are completely monotone. The Bernstein function can induce a class of nonconvex penalty functions for high-dimensional sparse estimation…

机器学习 · 统计学 2015-10-30 Zhihua Zhang

High-dimensional sparse modeling with censored survival data is of great practical importance, as exemplified by modern applications in high-throughput genomic data analysis and credit risk analysis. In this article, we propose a class of…

统计方法学 · 统计学 2014-03-19 Wei Lin , Jinchi Lv