English
Related papers

Related papers: Variable selection in convex quantile regression: …

200 papers

The wavelet frame systems have been widely investigated and applied for image restoration and many other image processing problems over the past decades, attributing to their good capability of sparsely approximating piece-wise smooth…

Computer Vision and Pattern Recognition · Computer Science 2015-10-13 Liangtian He , Yilun Wang

We consider the problem of minimizing a sum of several convex non-smooth functions. We introduce a new algorithm called the selective linearization method, which iteratively linearizes all but one of the functions and employs simple…

Optimization and Control · Mathematics 2016-08-16 Yu Du , Xiaodong Lin , Andrzej Ruszczynski

This paper studies the matrix completion problem under arbitrary sampling schemes. We propose a new estimator incorporating both max-norm and nuclear-norm regularization, based on which we can conduct efficient low-rank matrix recovery…

Machine Learning · Statistics 2016-09-27 Ethan X. Fang , Han Liu , Kim-Chuan Toh , Wen-Xin Zhou

The iteratively reweighted l1 algorithm is a widely used method for solving various regularization problems, which generally minimize a differentiable loss function combined with a nonconvex regularizer to induce sparsity in the solution.…

Optimization and Control · Mathematics 2021-01-12 Hao Wang , Hao Zeng , Jiashan Wang

The 1-norm is a good convex regularization for the recovery of sparse vectors from under-determined linear measurements. No other convex regularization seems to surpass its sparse recovery performance. How can this be explained? To answer…

Information Theory · Computer Science 2018-06-25 Yann Traonmilin , Samuel Vaiter , Rémi Gribonval

In variable selection, most existing screening methods focus on marginal effects and ignore dependence between covariates. To improve the performance of selection, we incorporate pairwise effects in covariates for screening and…

Methodology · Statistics 2019-02-12 Siliang Gong , Kai Zhang , Yufeng Liu

In numerous substitution models for the $\l_{0}$-norm minimization problem $(P_{0})$, the $\l_{p}$-norm minimization $(P_{p})$ with $0<p<1$ have been considered as the most natural choice. However, the non-convex optimization problem…

Optimization and Control · Mathematics 2018-04-27 Angang Cui , Jigen Peng , Haiyang Li

Linear regression without correspondences concerns the recovery of a signal in the linear regression setting, where the correspondences between the observations and the linear functionals are unknown. The associated maximum likelihood…

Information Theory · Computer Science 2020-09-15 Liangzu Peng , Manolis C. Tsakiris

We propose \textit{Meta-Regularization}, a novel approach for the adaptive choice of the learning rate in first-order gradient descent methods. Our approach modifies the objective function by adding a regularization term on the learning…

Machine Learning · Computer Science 2021-04-13 Guangzeng Xie , Hao Jin , Dachao Lin , Zhihua Zhang

We consider the problem of reconstructing 2D images from randomly under-sampled confocal microscopy samples. The well known and widely celebrated total variation regularization, which is the L1 norm of derivatives, turns out to be…

Image and Video Processing · Electrical Eng. & Systems 2019-09-04 Bibin Francis , Manoj Mathew , Muthuvel Arigovindan

In this work we consider numerical efficiency and convergence rates for solvers of non-convex multi-penalty formulations when reconstructing sparse signals from noisy linear measurements. We extend an existing approach, based on reduction…

Information Theory · Computer Science 2021-01-15 Zeljko Kereta , Johannes Maly , Valeriya Naumova

We propose VL Norm (Variance-reduced Length-dependent Normalization), a simple yet effective loss aggregation method tailored to the characteristic of dynamic generation lengths in Reinforcement Learning with Verifiable Rewards (RLVR).…

Machine Learning · Computer Science 2025-10-14 Zhiyuan He , Xufang Luo , Yike Zhang , Yuqing Yang , Lili Qiu

This paper presents a study on an $\ell_1$-penalized covariance regression method. Conventional approaches in high-dimensional covariance estimation often lack the flexibility to integrate external information. As a remedy, we adopt the…

Methodology · Statistics 2025-02-24 Kwan-Young Bak , Seongoh Park

The problem of joint feature selection across a group of related tasks has applications in many areas including biomedical informatics and computer vision. We consider the l2,1-norm regularized regression model for joint feature selection…

Machine Learning · Computer Science 2012-05-14 Jun Liu , Shuiwang Ji , Jieping Ye

Low-rank learning has attracted much attention recently due to its efficacy in a rich variety of real-world tasks, e.g., subspace segmentation and image categorization. Most low-rank methods are incapable of capturing low-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2016-11-16 Ping Li , Jun Yu , Meng Wang , Luming Zhang , Deng Cai , Xuelong Li

In compressed sensing, the l0-norm minimization of sparse signal reconstruction is NP-hard. Recent work shows that compared with the best convex relaxation (l1-norm), nonconvex penalties can better approximate the l0-norm and can…

Signal Processing · Electrical Eng. & Systems 2018-05-03 Hao Wang , Zhanglei Shi , Chi-Sing Leung , Hing Cheung So

In this paper, we study the problem of image recovery from given partial (corrupted) observations. Recovering an image using a low-rank model has been an active research area in data analysis and machine learning. But often, images are not…

Computer Vision and Pattern Recognition · Computer Science 2020-03-13 Pawan Goyal , Hussam Al Daas , Peter Benner

Covariance estimation for high-dimensional datasets is a fundamental problem in modern day statistics with numerous applications. In these high dimensional datasets, the number of variables p is typically larger than the sample size n. A…

Methodology · Statistics 2016-10-11 Kshitij Khare , Sang Oh , Syed Rahman , Bala Rajaratnam

Estimation of a precision matrix (i.e., inverse covariance matrix) is widely used to exploit conditional independence among continuous variables. The influence of abnormal observations is exacerbated in a high dimensional setting as the…

Methodology · Statistics 2021-05-17 Peng Tang , Huijing Jiang , Heeyoung Kim , Xinwei Deng

We study iterative regularization for linear models, when the bias is convex but not necessarily strongly convex. We characterize the stability properties of a primal-dual gradient based approach, analyzing its convergence in the presence…

Machine Learning · Statistics 2020-10-30 Cesare Molinari , Mathurin Massias , Lorenzo Rosasco , Silvia Villa
‹ Prev 1 8 9 10 Next ›