中文
相关论文

相关论文: Sparse Linear Regression with Constraints: A Flexi…

200 篇论文

We consider the question of estimating a solution to a system of equations that involve convex nonlinearities, a problem that is common in machine learning and signal processing. Because of these nonlinearities, conventional estimators…

机器学习 · 计算机科学 2018-08-14 Sohail Bahmani , Justin Romberg

In covariance matrix estimation, one of the challenges lies in finding a suitable model and an efficient estimation method. Two commonly used modelling approaches in the literature involve imposing linear restrictions on the covariance…

统计理论 · 数学 2024-05-09 Piotr Zwiernik

The problem of finding the sparsest vector (direction) in a low dimensional subspace can be considered as a homogeneous variant of the sparse recovery problem, which finds applications in robust subspace recovery, dictionary learning,…

机器学习 · 计算机科学 2020-01-22 Qing Qu , Zhihui Zhu , Xiao Li , Manolis C. Tsakiris , John Wright , René Vidal

For high dimensional sparse linear regression problems, we propose a sequential convex relaxation algorithm (iSCRA-TL1) by solving inexactly a sequence of truncated $\ell_1$-norm regularized minimization problems, in which the working index…

统计理论 · 数学 2024-11-05 Shujun Bi , Yonghua Yang , Shaohua Pan

In scientific machine learning, the task of identifying partial differential equations accurately from sparse and noisy data poses a significant challenge. Current sparse regression methods may identify inaccurate equations on sparse and…

机器学习 · 计算机科学 2025-04-08 Su Chen , Yi Ding , Hiroe Miyake , Xiaojun Li

For statistical analysis of network data, the $\beta$-model has emerged as a useful tool, thanks to its flexibility in incorporating nodewise heterogeneity and theoretical tractability. To generalize the $\beta$-model, this paper proposes…

统计理论 · 数学 2024-10-01 Stefan Stein , Rui Feng , Chenlei Leng

The problem of estimating a random vector x from noisy linear measurements y = A x + w with unknown parameters on the distributions of x and w, which must also be learned, arises in a wide range of statistical learning and linear inverse…

信息论 · 计算机科学 2017-06-20 Alyson K. Fletcher , Mojtaba Sahraee-Ardakan , Philip Schniter , Sundeep Rangan

We consider the problem of testing for the presence (or detection) of an unknown sparse signal in additive white noise. Given a fixed measurement budget, much smaller than the dimension of the signal, we consider the general problem of…

信息论 · 计算机科学 2015-03-19 Ramin Zahedi , Ali Pezeshki , Edwin K. P. Chong

We propose an algebraic combinatorial method for solving large sparse linear systems of equations locally - that is, a method which can compute single evaluations of the signal without computing the whole signal. The method scales only in…

统计理论 · 数学 2014-03-05 Franz J Király , Louis Theran

This paper deals with unsupervised clustering with feature selection. The problem is to estimate both labels and a sparse projection matrix of weights. To address this combinatorial non-convex problem maintaining a strict control on the…

机器学习 · 计算机科学 2019-05-27 Cyprien Gilet , Marie Deprez , Jean-Baptiste Caillau , Michel Barlaud

We consider high-dimensional binary classification by sparse logistic regression. We propose a model/feature selection procedure based on penalized maximum likelihood with a complexity penalty on the model size and derive the non-asymptotic…

统计理论 · 数学 2018-11-20 Felix Abramovich , Vadim Grinshtein

In this paper, we consider the challenge of reconstructing jointly sparse vectors from linear measurements. Firstly, we show that by utilizing the rank of the output data matrix we can reduce the problem to a full column rank case. This…

数值分析 · 数学 2019-05-28 Armenak Petrosyan , Hoang Tran , Clayton Webster

We study the problem of multivariate regression where the data are naturally grouped, and a regression matrix is to be estimated for each group. We propose an approach in which a dictionary of low rank parameter matrices is estimated across…

机器学习 · 计算机科学 2012-07-03 Min Xu , John Lafferty

Sparse linear regression is a central problem in high-dimensional statistics. We study the correlated random design setting, where the covariates are drawn from a multivariate Gaussian $N(0,\Sigma)$, and we seek an estimator with small…

数据结构与算法 · 计算机科学 2023-05-29 Jonathan Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

We consider the problem of learning a sparse graph underlying an undirected Gaussian graphical model, a key problem in statistical machine learning. Given $n$ samples from a multivariate Gaussian distribution with $p$ variables, the goal is…

机器学习 · 计算机科学 2026-04-07 Kayhan Behdin , Wenyu Chen , Rahul Mazumder

This paper studies sparse linear regression analysis with outliers in the responses. A parameter vector for modeling outliers is added to the standard linear regression model and then the sparse estimation problem for both coefficients and…

统计理论 · 数学 2015-05-21 Shota Katayama , Hironori Fujisawa

Missing data is an universal problem in statistics. We develop a unified framework for estimating parameters defined by general estimating equations under a missing-at-random (MAR) mechanism, based on generalized entropy calibration…

统计方法学 · 统计学 2026-03-31 Mst Moushumi Pervin , Hengfang Wang , Jae Kwang Kim

Sparse regression on a library of candidate features has developed as the prime method to discover the partial differential equation underlying a spatio-temporal data-set. These features consist of higher order derivatives, limiting model…

机器学习 · 计算机科学 2021-05-05 Gert-Jan Both , Gijs Vermarien , Remy Kusters

Motivated by distributed machine learning settings such as Federated Learning, we consider the problem of fitting a statistical model across a distributed collection of heterogeneous data sets whose similarity structure is encoded by a…

统计理论 · 数学 2021-11-30 Dominic Richards , Sahand N. Negahban , Patrick Rebeschini

To strike a balance between energy efficiency and data quality control, this paper proposes a sensor censoring scheme for distributed sparse signal recovery via compressive-sensing based wireless sensor networks. In the proposed approach,…

信息论 · 计算机科学 2018-01-16 Jwo-Yuh Wu , Ming-Hsun Yang , Tsang-Yi Wang