中文
相关论文

相关论文: Robust-to-outliers square-root LASSO, simultaneous…

200 篇论文

Data subject to heavy-tailed errors are commonly encountered in various scientific fields, especially in the modern era with explosion of massive data. To address this problem, procedures based on quantile regression and Least Absolute…

统计理论 · 数学 2014-10-09 Jianqing Fan , Quefeng Li , Yuyan Wang

In high-dimensional data, many sparse regression methods have been proposed. However, they may not be robust against outliers. Recently, the use of density power weight has been studied for robust parameter estimation and the corresponding…

统计方法学 · 统计学 2018-02-14 Takayuki Kawashima , Hironori Fujisawa

We consider the problem of learning a coefficient vector x_0\in R^N from noisy linear observation y=Ax_0+w \in R^n. In many contexts (ranging from model selection to image processing) it is desirable to construct a sparse estimator x'. In…

统计理论 · 数学 2015-12-16 Mohsen Bayati , Andrea Montanari

Sharpness-Aware Minimization (SAM) has emerged as a powerful method for improving generalization in machine learning models by minimizing the sharpness of the loss landscape. However, despite its success, several important questions…

最优化与控制 · 数学 2025-03-05 Dimitris Oikonomou , Nicolas Loizou

We propose a robust inferential procedure for assessing uncertainties of parameter estimation in high-dimensional linear models, where the dimension $p$ can grow exponentially fast with the sample size $n$. Our method combines the…

机器学习 · 统计学 2015-03-19 Tianqi Zhao , Mladen Kolar , Han Liu

We consider variational inequalities coming from monotone operators, a setting that includes convex minimization and convex-concave saddle-point problems. We assume an access to potentially noisy unbiased values of the monotone operators…

机器学习 · 计算机科学 2019-02-06 Francis Bach , Kfir Y. Levy

This paper proposes a novel non-parametric multidimensional convex regression estimator which is designed to be robust to adversarial perturbations in the empirical measure. We minimize over convex functions the maximum (over Wasserstein…

统计理论 · 数学 2020-07-28 Jose Blanchet , Peter W. Glynn , Jun Yan , Zhengqing Zhou

We propose methods for estimating correspondence between two point sets under the presence of outliers in both the source and target sets. The proposed algorithms expand upon the theory of the regression without correspondence problem to…

机器学习 · 统计学 2019-10-29 Amin Nejatbakhsh , Erdem Varol

Phase retrieval (PR) is a popular research topic in signal processing and machine learning. However, its performance degrades significantly when the measurements are corrupted by noise or outliers. To address this limitation, we propose a…

最优化与控制 · 数学 2025-05-30 Jun Fan , Ailing Yan , Xianchao Xiu , Wanquan Liu

Estimating unknown rotations from noisy measurements is an important step in SfM and other 3D vision tasks. Typically, local optimization methods susceptible to returning suboptimal local minima are used to solve the rotation averaging…

计算机视觉与模式识别 · 计算机科学 2019-06-17 Matthew Giamou , Filip Maric , Valentin Peretroukhin , Jonathan Kelly

We consider a robust linear regression model $y=X\beta^* + \eta$, where an adversary oblivious to the design $X\in \mathbb{R}^{n\times d}$ may choose $\eta$ to corrupt all but an $\alpha$ fraction of the observations $y$ in an arbitrary…

机器学习 · 计算机科学 2021-05-26 Tommaso d'Orsi , Gleb Novikov , David Steurer

We study a set of regularization methods for high-dimensional linear regression models. These penalized estimators have the square root of the residual sum of squared errors as loss function, and any weakly decomposable norm as penalty…

统计理论 · 数学 2016-06-28 Benjamin Stucky , Sara van de Geer

In this paper we discuss the variable selection method from \ell0-norm constrained regression, which is equivalent to the problem of finding the best subset of a fixed size. Our study focuses on two aspects, consistency and computation. We…

统计方法学 · 统计学 2013-03-20 Shifeng Xiong

We consider the problem of mean estimation assuming only finite variance. We study a new class of mean estimators constructed by integrating over random noise applied to a soft-truncated empirical mean estimator. For appropriate choices of…

统计理论 · 数学 2019-06-26 Matthew J. Holland

State-space models (SSMs) provide a flexible framework for modelling time series data, but their reliance on Gaussian error assumptions makes them highly sensitive to outliers. We propose a robust estimation method, ROAMS, that mitigates…

统计方法学 · 统计学 2025-11-20 Rajan Shankar , Ines Wilms , Jakob Raymaekers , Garth Tarr

Seemingly unrelated regression models generalize linear regression models by considering multiple regression equations that are linked by contemporaneously correlated disturbances. Robust inference for seemingly unrelated regression models…

统计方法学 · 统计学 2018-05-15 Kris Peremans , Stefan Van Aelst

We propose a new formulation of robust regression by integrating all realizations of the uncertainty set and taking an averaged approach to obtain the optimal solution for the ordinary least squares regression problem. We show that this…

机器学习 · 计算机科学 2024-10-10 Dimitris Bertsimas , Yu Ma

We study stochastic optimization from a joint continuous-discrete point of view. Starting from a second-order stochastic differential equation interpreted as a noisy accelerated gradient flow, we discretize the dynamics by a fully implicit…

最优化与控制 · 数学 2026-05-07 Valentin Leplat , Roland Hildebrand

Linear regression models contaminated by Gaussian noise (inlier) and possibly unbounded sparse outliers are common in many signal processing applications. Sparse recovery inspired robust regression (SRIRR) techniques are shown to deliver…

机器学习 · 统计学 2018-12-26 Sreejith Kallummil , Sheetal Kalyani

We consider the robust estimation of the parameters of multivariate Gaussian linear regression models. To this aim we consider robust version of the usual (Mahalanobis) least-square criterion, with or without Ridge regularization. We…

统计理论 · 数学 2025-10-13 Antoine Godichon-Baggioni , Stephane S. Robin , Laure Sansonnet