中文
相关论文

相关论文: Dynamic Sasvi: Strong Safe Screening for Norm-Regu…

200 篇论文

The problems of Lasso regression and optimal design of experiments share a critical property: their optimal solutions are typically \emph{sparse}, i.e., only a small fraction of the optimal variables are non-zero. Therefore, the…

统计方法学 · 统计学 2023-12-07 Guillaume Sagnol , Luc Pronzato

Fused Lasso was proposed to characterize the sparsity of the coefficients and the sparsity of their successive differences for the linear regression. Due to its wide applications, there are many existing algorithms to solve fused Lasso.…

统计计算 · 统计学 2024-04-17 Pan Shang , Huangyue Chen , Lingchen Kong

Variable selection is a challenging problem in high-dimensional sparse learning, especially when group structures exist. Group SLOPE performs well for the adaptive selection of groups of predictors. However, the block non-separable group…

机器学习 · 计算机科学 2025-06-12 Runxue Bao , Quanchao Lu , Yanfu Zhang

In high dimensional settings, sparse structures are crucial for efficiency, either in term of memory, computation or performance. In some contexts, it is natural to handle more refined structures than pure sparsity, such as for instance…

机器学习 · 统计学 2016-02-24 Eugene Ndiaye , Olivier Fercoq , Alexandre Gramfort , Joseph Salmon

In high-dimensional settings, sparse structures are critical for efficiency in term of memory and computation complexity. For a linear system, to find the sparsest solution provided with an over-complete dictionary of features directly is…

机器学习 · 统计学 2020-07-09 Yiping Jiang , Tianshi Chen

We give safe screening rules to eliminate variables from regression with $\ell_0$ regularization or cardinality constraint. These rules are based on guarantees that a feature may or may not be selected in an optimal solution. The screening…

机器学习 · 统计学 2020-04-21 Alper Atamtürk , Andrés Gómez

Sparse classifiers such as the support vector machines (SVM) are efficient in test-phases because the classifier is characterized only by a subset of the samples called support vectors (SVs), and the rest of the samples (non SVs) have no…

机器学习 · 统计学 2014-01-28 Kohei Ogawa , Yoshiki Suzuki , Shinya Suzumura , Ichiro Takeuchi

Screening is an effective technique for speeding up the training process of a sparse learning model by removing the features that are guaranteed to be inactive the process. In this paper, we present a efficient screening technique for…

机器学习 · 计算机科学 2013-11-01 Zheng Zhao , Jun Liu

Group Ordered Weighted $L_{1}$-Norm (Group OWL) regularized models have emerged as a useful procedure for high-dimensional sparse multi-task learning with correlated features. Proximal gradient methods are used as standard approaches to…

机器学习 · 计算机科学 2025-04-09 Runxue Bao , Quanchao Lu , Yanfu Zhang

We investigate fast methods that allow to quickly eliminate variables (features) in supervised learning problems involving a convex loss function and a $l_1$-norm penalty, leading to a potentially substantial reduction in the number of…

机器学习 · 计算机科学 2010-10-28 Laurent El Ghaoui , Vivian Viallon , Tarek Rabbani

Robust support vector machine (RSVM) has been shown to perform remarkably well to improve the generalization performance of support vector machine under the noisy environment. Unfortunately, in order to handle the non-convexity induced by…

机器学习 · 计算机科学 2019-12-25 Zhou Zhai , Bin Gu , Xiang Li , Heng Huang

We consider adaptive system identification problems with convex constraints and propose a family of regularized Least-Mean-Square (LMS) algorithms. We show that with a properly selected regularization parameter the regularized LMS provably…

统计方法学 · 统计学 2010-12-24 Yilun Chen , Yuantao Gu , Alfred O. Hero

Recently dictionary screening has been proposed as an effective way to improve the computational efficiency of solving the lasso problem, which is one of the most commonly used method for learning sparse representations. To address today's…

机器学习 · 计算机科学 2016-08-29 Yun Wang , Peter J. Ramadge

Support vector machine (SVM) has achieved many successes in machine learning, especially for a small sample problem. As a famous extension of the traditional SVM, the $\nu$ support vector machine ($\nu$-SVM) has shown outstanding…

机器学习 · 计算机科学 2024-03-05 Zhiji Yang , Wanyi Chen , Huan Zhang , Yitian Xu , Lei Shi , Jianhua Zhao

Recent computational strategies based on screening tests have been proposed to accelerate algorithms addressing penalized sparse regression problems such as the Lasso. Such approaches build upon the idea that it is worth dedicating some…

机器学习 · 统计学 2015-10-28 Antoine Bonnefoy , Valentin Emiya , Liva Ralaivola , Rémi Gribonval

Optimization-based filtering smoothes an image by minimizing a fidelity function and simultaneously preserves edges by exploiting a sparse norm penalty over gradients. It has obtained promising performance in practical problems, such as…

图形学 · 计算机科学 2013-05-20 Chengxi Ye , Dacheng Tao , Mingli Song , David W. Jacobs , Min Wu

In this paper, we propose a successive convex approximation framework for sparse optimization where the nonsmooth regularization function in the objective function is nonconvex and it can be written as the difference of two convex…

机器学习 · 计算机科学 2018-10-26 Yang Yang , Marius Pesavento , Symeon Chatzinotas , Björn Ottersten

Sure screening technique has been considered as a powerful tool to handle the ultrahigh dimensional variable selection problems, where the dimensionality p and the sample size n can satisfy the NP dimensionality log p=O(n^a) for some a>0…

统计理论 · 数学 2019-12-04 Xu Han

The success of compressed sensing relies essentially on the ability to efficiently find an approximately sparse solution to an under-determined linear system. In this paper, we developed an efficient algorithm for the sparsity promoting…

信息论 · 计算机科学 2015-06-18 Qibin Fan , Yuling Jiao , Xiliang Lu

We present a novel screening methodology to safely discard irrelevant nodes within a generic branch-and-bound (BnB) algorithm solving the l0-penalized least-squares problem. Our contribution is a set of two simple tests to detect sets of…

信号处理 · 电气工程与系统科学 2022-02-04 Théo Guyard , Cédric Herzet , Clément Elvira