中文
相关论文

相关论文: Robust and Sparse Regression via $\gamma$-divergen…

200 篇论文

High-dimensional sparse modeling via regularization provides a powerful tool for analyzing large-scale data sets and obtaining meaningful, interpretable models. The use of nonconvex penalty functions shows advantage in selecting important…

统计方法学 · 统计学 2016-05-12 Zemin Zheng , Yingying Fan , Jinchi Lv

Randomized smoothing has shown promising certified robustness against adversaries in classification tasks. Despite such success with only zeroth-order access to base models, randomized smoothing has not been extended to a general form of…

机器学习 · 计算机科学 2024-05-16 Aref Miri Rekavandi , Olga Ohrimenko , Benjamin I. P. Rubinstein

We study Gaussian sparse estimation tasks in Huber's contamination model with a focus on mean estimation, PCA, and linear regression. For each of these tasks, we give the first sample and computationally efficient robust estimators with…

机器学习 · 计算机科学 2024-03-18 Ilias Diakonikolas , Daniel M. Kane , Sushrut Karmalkar , Ankit Pensia , Thanasis Pittas

Generalized linear models (GLMs) form one of the most popular classes of models in statistics. The gamma variant is used, for instance, in actuarial science for the modelling of claim amounts in insurance. A flaw of GLMs is that they are…

统计方法学 · 统计学 2024-02-12 Philippe Gagnon , Yuxi Wang

This paper presents objective priors for robust Bayesian estimation against outliers based on divergences. The minimum $\gamma$-divergence estimator is well-known to work well estimation against heavy contamination. The robust Bayesian…

统计方法学 · 统计学 2021-02-03 Tomoyuki Nakagawa , Shintaro Hashimoto

High-dimensional linear regression is a fundamental tool in modern statistics, particularly when the number of predictors exceeds the sample size. The classical Lasso, which relies on the squared loss, performs well under Gaussian noise…

统计方法学 · 统计学 2025-06-10 The Tien Mai

The inflated beta regression model is widely used for modeling continuous proportions with values at the boundaries. Maximum likelihood estimation for these models is well-known for its sensitivity to outliers, which can severely distort…

统计方法学 · 统计学 2026-05-15 Francisco Felipe Queiroz , Silvia Lopes de Paula Ferrari

Missing data is frequently encountered in many areas of statistics. Propensity score weighting is a popular method for handling missing data. The propensity score method employs a response propensity model, but correct specification of the…

统计方法学 · 统计学 2024-03-28 Hengfang Wang , Jae Kwang Kim , Jeongseop Han , Youngjo Lee

The analysis of panel count data has garnered considerable attention in the literature, leading to the development of multiple statistical techniques. In inferential analysis, most works focus on leveraging estimating equation-based…

统计方法学 · 统计学 2025-10-08 Udita Goswami , Shuvashree Mondal

When applying a statistical method in practice it often occurs that some observations deviate from the usual assumptions. However, many classical methods are sensitive to outliers. The goal of robust statistics is to develop methods that…

统计方法学 · 统计学 2008-08-06 Mia Hubert , Peter J. Rousseeuw , Stefan Van Aelst

We consider robust estimation when outputs are adversarially contaminated. Nguyen and Tran (2012) proposed an extended Lasso for robust parameter estimation and then they showed the convergence rate of the estimation error. Recently,…

统计理论 · 数学 2024-05-27 Takeyuki Sasai , Hironori Fujisawa

The paper algorithmizes the problem of regime change point identification for data measured in a system exhibiting impulsive behaviors. This is a fundamental challenge for annotation of measurement data relevant, e.g., for designing…

We propose a robust elastic net (REN) model for high-dimensional sparse regression and give its performance guarantees (both the statistical error bound and the optimization bound). A simple idea of trimming the inner product is applied to…

机器学习 · 计算机科学 2016-05-03 Weiyang Liu , Rongmei Lin , Meng Yang

To conduct regression analysis for data contaminated with outliers, many approaches have been proposed for simultaneous outlier detection and robust regression, so is the approach proposed in this manuscript. This new approach is called…

统计方法学 · 统计学 2016-03-25 Xiaoli Gao , Yixin Fang

Traditional methods for linear regression generally assume that the underlying error distribution, equivalently the distribution of the responses, is normal. Yet, sometimes real life response data may exhibit a skewed pattern, and assuming…

统计方法学 · 统计学 2025-01-07 Amarnath Nandy , Ayanendranath Basu , Abhik Ghosh

Linear regression is ubiquitous in statistical analysis. It is well understood that conflicting sources of information may contaminate the inference when the classical normality of errors is assumed. The contamination caused by the light…

统计方法学 · 统计学 2019-06-13 Philippe Gagnon , Alain Desgagné , Mylène Bédard

Nonparametric regression models offer a way to understand and quantify relationships between variables without having to identify an appropriate family of possible regression functions. Although many estimation methods for these models have…

统计方法学 · 统计学 2023-04-07 Matias Salibian-Barrera

In real-world applications, it is important for machine learning algorithms to be robust against data outliers or corruptions. In this paper, we focus on improving the robustness of a large class of learning algorithms that are formulated…

机器学习 · 计算机科学 2021-06-04 Quanming Yao , Hangsi Yang , En-Liang Hu , James Kwok

Approximate Bayesian computation (ABC) is a likelihood-free inference method that has been employed in various applications. However, ABC can be sensitive to outliers if a data discrepancy measure is chosen inappropriately. In this paper,…

机器学习 · 统计学 2021-03-08 Masahiro Fujisawa , Takeshi Teshima , Issei Sato , Masashi Sugiyama

We study the performance of sparse regression methods and propose new techniques to distill the governing equations of dynamical systems from data. We first look at the generic methodology of learning interpretable equation forms from data,…

机器学习 · 计算机科学 2019-03-25 Chinmay S. Kulkarni