中文
相关论文

相关论文: Robust-to-outliers square-root LASSO, simultaneous…

200 篇论文

For many inference problems in statistics and econometrics, the unknown parameter is identified by a set of moment conditions. A generic method of solving moment conditions is the Generalized Method of Moments (GMM). However, classical GMM…

机器学习 · 统计学 2021-10-18 Dhruv Rohatgi , Vasilis Syrgkanis

Most existing distance metric learning methods assume perfect side information that is usually given in pairwise or triplet constraints. Instead, in many real-world applications, the constraints are derived from side information, such as…

机器学习 · 计算机科学 2012-03-19 Kaizhu Huang , Rong Jin , Zenglin Xu , Cheng-Lin Liu

We study the problem of outlier robust high-dimensional mean estimation under a finite covariance assumption, and more broadly under finite low-degree moment assumptions. We consider a standard stability condition from the recent robust…

统计理论 · 数学 2021-03-17 Ilias Diakonikolas , Daniel M. Kane , Ankit Pensia

In high-dimensional statistics, the Lasso is a cornerstone method for simultaneous variable selection and parameter estimation. However, its reliance on the squared loss function renders it highly sensitive to outliers and heavy-tailed…

机器学习 · 统计学 2025-11-20 The Tien Mai

We consider the least-square linear regression problem with regularization by the $\ell^1$-norm, a problem usually referred to as the Lasso. In this paper, we first present a detailed asymptotic analysis of model consistency of the Lasso in…

机器学习 · 计算机科学 2009-01-22 Francis Bach

In high dimensional sparse regression, pivotal estimators are estimators for which the optimal regularization parameter is independent of the noise level. The canonical pivotal estimator is the square-root Lasso, formulated along with its…

机器学习 · 统计学 2020-09-04 Mathurin Massias , Quentin Bertrand , Alexandre Gramfort , Joseph Salmon

Robust estimation is an important and timely research subject. In this paper, we investigate performance lower bounds on the mean-square-error (MSE) of any estimator for the Bayesian linear model, corrupted by a noise distributed according…

统计方法学 · 统计学 2017-07-12 Virginie Ollier , Rémy Boyer , Mohammed Nabil El Korso , Pascal Larzabal

Using a Bayesian approach, we consider the problem of recovering sparse signals under additive sparse and dense noise. Typically, sparse noise models outliers, impulse bursts or data loss. To handle sparse noise, existing methods…

机器学习 · 统计学 2015-01-13 Martin Sundin , Saikat Chatterjee , Magnus Jansson

To perform regression analysis in high dimensions, lasso or ridge estimation are a common choice. However, it has been shown that these methods are not robust to outliers. Therefore, alternatives as penalized M-estimation or the sparse…

统计理论 · 数学 2025-02-03 Viktoria Öllerer , Christophe Croux , Andreas Alfons

We develop a technique to design efficiently computable estimators for sparse linear regression in the simultaneous presence of two adversaries: oblivious and adaptive. We design several robust algorithms that outperform the state of the…

机器学习 · 计算机科学 2024-11-01 Chih-Hung Liu , Gleb Novikov

Measurement outliers are unavoidable when solving real-world robot state estimation problems. A large family of robust loss functions (RLFs) exists to mitigate the effects of outliers, including newly developed adaptive methods that do not…

机器人学 · 计算机科学 2023-06-13 Thomas Hitchcox , James Richard Forbes

We consider the problem of recovering the unknown noise variance in the linear regression model. To estimate the nuisance (a vector of regression coefficients) we use a family of spectral regularisers of the maximum likelihood estimator.…

统计理论 · 数学 2017-11-28 Yuri Golubev , Ekaterina Krymova

We study the problem of designing minimax procedures in linear regression under the quantile risk. We start by considering the realizable setting with independent Gaussian noise, where for any given noise level and distribution of inputs,…

统计理论 · 数学 2024-06-19 Ayoub El Hanchi , Chris J. Maddison , Murat A. Erdogdu

Optimal estimation and inference for both the minimizer and minimum of a convex regression function under the white noise and nonparametric regression models are studied in a nonasymptotic local minimax framework, where the performance of a…

统计理论 · 数学 2024-03-12 T. Tony Cai , Ran Chen , Yuancheng Zhu

In regularized risk minimization, the associated optimization problem becomes particularly difficult when both the loss and regularizer are nonsmooth. Existing approaches either have slow or unclear convergence properties, are restricted to…

机器学习 · 计算机科学 2016-10-14 Shuai Zheng , Ruiliang Zhang , James T. Kwok

Nonlinear estimation in robotics and vision is typically plagued with outliers due to wrong data association, or to incorrect detections from signal processing and machine learning methods. This paper introduces two unifying formulations…

计算机视觉与模式识别 · 计算机科学 2021-07-05 Pasquale Antonante , Vasileios Tzoumas , Heng Yang , Luca Carlone

Many problems in signal processing require finding sparse solutions to under-determined, or ill-conditioned, linear systems of equations. When dealing with real-world data, the presence of outliers and impulsive noise must also be accounted…

统计理论 · 数学 2017-05-08 Jasin Machkour , Michael Muma , Bastian Alt , Abdelhak M. Zoubir

We consider the problem of linear fitting of noisy data in the case of broad (say $\alpha$-stable) distributions of random impacts ("noise"), which can lack even the first moment. This situation, common in statistical physics of small…

数据分析、统计与概率 · 物理学 2015-05-27 Eugene B. Postnikov , Igor M. Sokolov

When recovering an unknown signal from noisy measurements, the computational difficulty of performing optimal Bayesian MMSE (minimum mean squared error) inference often necessitates the use of maximum a posteriori (MAP) inference, a special…

机器学习 · 统计学 2016-09-23 Madhu Advani , Surya Ganguli

We consider the high-dimensional linear regression model and assume that a fraction of the measurements are altered by an adversary with complete knowledge of the data and the underlying distribution. We are interested in a scenario where…

统计理论 · 数学 2023-12-11 Stanislav Minsker , Mohamed Ndaoud , Lang Wang