中文
相关论文

相关论文: A Statistical Learning Assessment of Huber Regress…

200 篇论文

Drawing statistical inferences from large datasets in a model-robust way is an important problem in statistics and data science. In this paper, we propose methods that are robust to large and unequal noise in different observational units…

统计理论 · 数学 2024-01-10 Edgar Dobriban , Weijie J. Su , Yachong Yang , Zhixiang Zhang

Matrix factor model is drawing growing attention for simultaneous two-way dimension reduction of well-structured matrix-valued observations. This paper focuses on robust statistical inference for matrix factor model in the ``diverging…

统计方法学 · 统计学 2023-06-07 Yong He , Xin-Bing Kong , Dong Liu , Ran Zhao

Ridgeless regression has garnered attention among researchers, particularly in light of the ``Benign Overfitting'' phenomenon, where models interpolating noisy samples demonstrate robust generalization. However, kernel ridgeless regression…

机器学习 · 计算机科学 2024-06-04 Fan He , Mingzhen He , Lei Shi , Xiaolin Huang , Johan A. K. Suykens

Regression neural networks (NNs) are most commonly trained by minimizing the mean squared prediction error, which is highly sensitive to outliers and data contamination. Existing robust training methods for regression NNs are often limited…

机器学习 · 统计学 2026-02-10 Abhik Ghosh , Suryasis Jana

Huber loss, its asymmetric variants and their associated functionals (here named Huber functionals) are studied in the context of point forecasting and forecast evaluation. The Huber functional of a distribution is the set of minimizers of…

统计理论 · 数学 2022-02-17 Robert J. Taggart

We propose a generalized formulation of the Huber loss. We show that with a suitable function of choice, specifically the log-exp transform; we can achieve a loss function which combines the desirable properties of both the absolute and the…

机器学习 · 统计学 2021-08-31 Kaan Gokcesu , Hakan Gokcesu

Prediction with the possibility of abstention (or selective prediction) is an important problem for error-critical machine learning applications. While well-studied in the classification setup, selective approaches to regression are much…

机器学习 · 统计学 2023-09-29 Fedor Noskov , Alexander Fishkov , Maxim Panov

In the nonparametric regression setting, we construct an estimator which is a continuous function interpolating the data points with high probability, while attaining minimax optimal rates under mean squared risk on the scale of H\"older…

统计理论 · 数学 2022-06-28 Julien Chhor , Suzanne Sigalla , Alexandre B. Tsybakov

Learning and the ability to learn are important factors in development and evolutionary processes [1]. Depending on the level, the complexity of learning can strongly vary. While associative learning can explain simple learning behaviour…

神经元与认知 · 定量生物学 2007-05-23 Reimer Kuehn , Ion-Olimpiu Stamatescu

Linear regression on network-linked observations has been an essential tool in modeling the relationship between response and covariates with additional network structures. Previous methods either lack inference tools or rely on restrictive…

统计方法学 · 统计学 2022-08-22 Can M. Le , Tianxi Li

In this article we consider the nonparametric robust estimation problem for regression models in continuous time with semi-Markov noises observed in discrete time moments. An adaptive model selection procedure is proposed. A sharp…

统计理论 · 数学 2020-05-15 Vlad Stefan Barbu , Slim Beltaief , Serguei Pergamenshchikov

Regression adjustment is broadly applied in randomized trials under the premise that it usually improves the precision of a treatment effect estimator. However, previous work has shown that this is not always true. To further understand…

统计方法学 · 统计学 2022-10-11 Katarzyna Reluga , Ting Ye , Qingyuan Zhao

This paper investigates the nonparametric estimation of a circular regression function in an errors-in-variables framework. Two settings are studied, depending on whether the covariates are circular or linear. Adaptive estimators are…

统计理论 · 数学 2025-08-27 Tien Dat Nguyen , Thanh Mai Pham Ngoc

Calibration error is commonly adopted for evaluating the quality of uncertainty estimators in deep neural networks. In this paper, we argue that such a metric is highly beneficial for training predictive models, even when we do not…

机器学习 · 统计学 2019-11-01 Jayaraman J. Thiagarajan , Bindya Venkatesh , Deepta Rajan

Robustness under perturbation and contamination is a prominent issue in statistical learning. We address the robust nonlinear regression based on the so-called interval conditional value-at-risk (In-CVaR), which is introduced to enhance…

最优化与控制 · 数学 2026-01-19 Yulei You , Junyi Liu

Randomized smoothing has shown promising certified robustness against adversaries in classification tasks. Despite such success with only zeroth-order access to base models, randomized smoothing has not been extended to a general form of…

机器学习 · 计算机科学 2024-05-16 Aref Miri Rekavandi , Olga Ohrimenko , Benjamin I. P. Rubinstein

In this paper we develop a nonparametric regression method that is simultaneously adaptive over a wide range of function classes for the regression function and robust over a large collection of error distributions, including those that are…

统计理论 · 数学 2008-10-28 Lawrence D. Brown , T. Tony Cai , Harrison H. Zhou

We study the problem of linear regression where both covariates and responses are potentially (i) heavy-tailed and (ii) adversarially contaminated. Several computationally efficient estimators have been proposed for the simpler setting…

统计理论 · 数学 2021-05-18 Ankit Pensia , Varun Jog , Po-Ling Loh

We consider new formulations and methods for sparse quantile regression in the high-dimensional setting. Quantile regression plays an important role in many applications, including outlier-robust exploratory analysis in gene selection. In…

机器学习 · 统计学 2014-02-20 Aleksandr Y. Aravkin , Anju Kambadur , Aurelie C. Lozano , Ronny Luss

This paper investigates the theoretical underpinnings of two fundamental statistical inference problems, the construction of confidence sets and large-scale simultaneous hypothesis testing, in the presence of heavy-tailed data. With…

统计理论 · 数学 2019-03-19 Xi Chen , Wen-Xin Zhou