English
Related papers

Related papers: Sparse Polynomial Regression under Anomalous Data

200 papers

Many problems of interest in computer vision can be formulated as a problem of finding consistent correspondences between two feature sets. Feature correspondence (matching) problem with one-to-one mapping constraint is usually formulated…

Computer Vision and Pattern Recognition · Computer Science 2018-09-21 Bo Jiang

Quadratic programming (QP) is a well-studied fundamental NP-hard optimization problem which optimizes a quadratic objective over a set of linear constraints. In this paper, we reformulate QPs as a mixed-integer linear problem (MILP). This…

Optimization and Control · Mathematics 2018-07-17 Wei Xia , Juan Vera , Luis F. Zuluaga

In this paper, we propose a Sparse Low-rank Quaternion Approximation (SLRQA) model for color image processing problems with noisy observations. %Different from the existing color image processing models, The proposed SLRQA is a quaternion…

Optimization and Control · Mathematics 2025-02-11 Zhanwang Deng , Yuqiu Su , Wen Huang

We present several algorithms aimed at constructing sparse and structured sparse (row-sparse) generalized inverses, with application to the efficient computation of least-squares solutions, for inconsistent systems of linear equations, in…

Optimization and Control · Mathematics 2025-07-09 Gabriel Ponte , Marcia Fampa , Jon Lee , Luze Xu

Based on a new atomic norm, we propose a new convex formulation for sparse matrix factorization problems in which the number of nonzero elements of the factors is assumed fixed and known. The formulation counts sparse PCA with multiple…

Machine Learning · Statistics 2014-12-05 Emile Richard , Guillaume Obozinski , Jean-Philippe Vert

Empirical research in economics increasingly relies on restricted-access data held by multiple firms or agencies, making it impossible to construct the estimator of interest on the pooled sample. At the same time, heavy-tailed distributions…

Methodology · Statistics 2026-05-06 Wen Zhang , Songshan Yang , Liping Zhu

We provide a novel -- and to the best of our knowledge, the first -- algorithm for high dimensional sparse regression with constant fraction of corruptions in explanatory and/or response variables. Our algorithm recovers the true sparse…

Machine Learning · Computer Science 2019-05-31 Liu Liu , Yanyao Shen , Tianyang Li , Constantine Caramanis

We study the Sparse Plus Low-Rank decomposition problem (SLR), which is the problem of decomposing a corrupted data matrix into a sparse matrix of perturbations plus a low-rank matrix containing the ground truth. SLR is a fundamental…

Machine Learning · Statistics 2023-11-15 Dimitris Bertsimas , Ryan Cory-Wright , Nicholas A. G. Johnson

Convex quadratic programs (QPs) constitute a fundamental computational primitive across diverse domains including financial optimization, control systems, and machine learning. The alternating direction method of multipliers (ADMM) has…

Optimization and Control · Mathematics 2025-05-15 Xi Gao , Jinxin Xiong , Linxin Yang , Akang Wang , Weiwei Xu , Jiang Xue

Pre-trained large models attract widespread attention in recent years, but they face challenges in applications that require high interpretability or have limited resources, such as physical sensing, medical imaging, and bioinformatics.…

Machine Learning · Computer Science 2025-01-24 Chaoqing Tang , Huanze Zhuang , Guiyun Tian , Zhenli Zeng , Yi Ding , Wenzhong Liu , Xiang Bai

The composite quantile regression (CQR) was introduced by Zou and Yuan [Ann. Statist. 36 (2008) 1108--1126] as a robust regression method for linear models with heavy-tailed errors while achieving high efficiency. Its penalized counterpart…

Methodology · Statistics 2023-10-16 Haeseong Moon , Wen-Xin Zhou

Quadratically constrained quadratic programs (QCQPs) are an expressive family of optimization problems that occur naturally in many applications. It is often of interest to seek out sparse solutions, where many of the entries of the…

Optimization and Control · Mathematics 2022-10-03 Kevin Shu

We introduce a new method for sparse principal component analysis, based on the aggregation of eigenvector information from carefully-selected axis-aligned random projections of the sample covariance matrix. Unlike most alternative…

Methodology · Statistics 2019-05-07 Milana Gataric , Tengyao Wang , Richard J. Samworth

We propose an l1-regularized likelihood method for estimating the inverse covariance matrix in the high-dimensional multivariate normal model in presence of missing data. Our method is based on the assumption that the data are missing at…

Methodology · Statistics 2012-02-28 Nicolas Städler , Peter Bühlmann

In this paper, we study a class of nonsmooth fractional programs {\rm (FP, for short)} with SOS-convex semi-algebraic functions. Under suitable assumptions, we derive a strong duality result between the problem (FP) and its semidefinite…

Optimization and Control · Mathematics 2024-01-31 Chengmiao Yang , Liguo Jiao , Jae Hyoung Lee

This paper introduces the Bi-linear consensus Alternating Direction Method of Multipliers (Bi-cADMM), aimed at solving large-scale regularized Sparse Machine Learning (SML) problems defined over a network of computational nodes.…

Machine Learning · Computer Science 2024-06-27 Alireza Olama , Andreas Lundell , Jan Kronqvist , Elham Ahmadi , Eduardo Camponogara

The maximum correntropy criterion (MCC) has been employed to design outlier-robust adaptive filtering algorithms, among which the recursive MCC (RMCC) algorithm is a typical one. Motivated by the success of our recently proposed…

Signal Processing · Electrical Eng. & Systems 2023-10-10 Zhen Qin , Jun Tao , Le Yang , Ming Jiang

Pseudoinverses are ubiquitous tools for handling over- and under-determined systems of equations. For computational efficiency, sparse pseudoinverses are desirable. Recently, sparse left and right pseudoinverses were introduced, using…

Numerical Analysis · Mathematics 2016-06-23 Victor K. Fuentes , Marcia Fampa , Jon Lee

We present new large-scale algorithms for fitting a subgradient regularized multivariate convex regression function to $n$ samples in $d$ dimensions -- a key problem in shape constrained nonparametric regression with applications in…

Optimization and Control · Mathematics 2023-12-06 Wenyu Chen , Rahul Mazumder

Image super-resolution (SR) has witnessed extensive neural network designs from CNN to transformer architectures. However, prevailing SR models suffer from prohibitive memory footprint and intensive computations, which limits further…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Jiamian Wang , Huan Wang , Yulun Zhang , Yun Fu , Zhiqiang Tao