English
Related papers

Related papers: Efficient Truncated Linear Regression with Unknown…

200 papers

Noise in data appears to be inevitable in most real-world machine learning applications and would cause severe overfitting problems. Not only can data features contain noise, but labels are also prone to be noisy due to human input. In this…

Machine Learning · Computer Science 2025-05-09 Weipeng Huang , Qin Li , Yang Xiao , Cheng Qiao , Tie Cai , Junwei Liang , Neil J. Hurley , Guangyuan Piao

This article proposes a new method of truncated estimation to estimate the tail index $\alpha$ of the extremely heavy-tailed distribution with infinite mean or variance. We not only present two truncated estimators $\hat{\alpha}$ and…

Statistics Theory · Mathematics 2022-09-13 F. Q. Tang , D. Han

We introduce the truncated Gaussian graphical model (TGGM) as a novel framework for designing statistical models for nonlinear learning. A TGGM is a Gaussian graphical model (GGM) with a subset of variables truncated to be nonnegative. The…

Machine Learning · Statistics 2016-11-22 Qinliang Su , Xuejun Liao , Changyou Chen , Lawrence Carin

In learning with noisy labels, the sample selection approach is very popular, which regards small-loss data as correctly labeled during training. However, losses are generated on-the-fly based on the model being trained with noisy labels,…

Machine Learning · Computer Science 2021-06-02 Xiaobo Xia , Tongliang Liu , Bo Han , Mingming Gong , Jun Yu , Gang Niu , Masashi Sugiyama

Robust and sparse estimation of linear regression coefficients is investigated. The situation addressed by the present paper is that covariates and noises are sampled from heavy-tailed distributions, and the covariates and noises are…

Machine Learning · Statistics 2022-10-11 Takeyuki Sasai

In this study, we explore the effects of including noise predictors and noise observations when fitting linear regression models. We present empirical and theoretical results that show that double descent occurs in both cases, albeit with…

Statistics Theory · Mathematics 2024-08-16 Insha Ullah , A. H. Welsh

We study the problem of estimating the parameters of a Boolean product distribution in $d$ dimensions, when the samples are truncated by a set $S \subset \{0, 1\}^d$ accessible through a membership oracle. This is the first time that the…

Machine Learning · Computer Science 2026-05-05 Dimitris Fotakis , Alkis Kalavasis , Christos Tzamos

Residual variance and the signal-to-noise ratio are important quantities in many statistical models and model fitting procedures. They play an important role in regression diagnostics, in determining the performance limits in estimation and…

Methodology · Statistics 2012-09-04 Lee H. Dicker

We study the robustness of conformal prediction, a powerful tool for uncertainty quantification, to label noise. Our analysis tackles both regression and classification problems, characterizing when and how it is possible to construct…

Machine Learning · Computer Science 2024-11-27 Bat-Sheva Einbinder , Shai Feldman , Stephen Bates , Anastasios N. Angelopoulos , Asaf Gendler , Yaniv Romano

Low-rank tensor models are widely used in statistics. However, most existing methods rely heavily on the assumption that data follows a sub-Gaussian distribution. To address the challenges associated with heavy-tailed distributions…

Methodology · Statistics 2025-09-16 Xiaoyu Zhang , Di Wang , Guodong Li , Defeng Sun

There has been a surge of interest in developing robust estimators for models with heavy-tailed and bounded variance data in statistics and machine learning, while few works impose unbounded variance. This paper proposes two type of robust…

Machine Learning · Statistics 2022-10-12 Lihu Xu , Fang Yao , Qiuran Yao , Huiming Zhang

Mixed linear regression is a well-studied problem in parametric statistics and machine learning. Given a set of samples, tuples of covariates and labels, the task of mixed linear regression is to find a small list of linear relationships…

Machine Learning · Statistics 2024-06-04 Avishek Ghosh , Arya Mazumdar

Reduced-rank approach has been used for decades in robust linear estimation of both deterministic and random vector of parameters in linear model y=Hx+\sqrt{epsilon}n. In practical settings, estimation is frequently performed under…

Optimization and Control · Mathematics 2024-08-05 Tomasz Piotrowski , Isao Yamada

Learning with noisy label (LNL) is a classic problem that has been extensively studied for image tasks, but much less for video in the literature. A straightforward migration from images to videos without considering the properties of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Zixiao Wang , Junwu Weng , Chun Yuan , Jue Wang

We reexamine the classical linear regression model when the model is subject to two types of uncertainty: (i) some of covariates are either missing or completely inaccessible, and (ii) the variance of the measurement error is undetermined…

Statistics Theory · Mathematics 2021-08-05 Shuzhen Yang , Jianfeng Yao

Learning with a {\it convex loss} function has been a dominating paradigm for many years. It remains an interesting question how non-convex loss functions help improve the generalization of learning with broad applicability. In this paper,…

Machine Learning · Computer Science 2018-05-22 Yi Xu , Shenghuo Zhu , Sen Yang , Chi Zhang , Rong Jin , Tianbao Yang

Convolutional Neural Networks (CNNs) have recently emerged as the dominant model in computer vision. If provided with enough training data, they predict almost any visual quantity. In a discrete setting, such as classification, CNNs are not…

Computer Vision and Pattern Recognition · Computer Science 2015-11-25 Deepak Pathak , Philipp Krähenbühl , Stella X. Yu , Trevor Darrell

Distant and weak supervision allow to obtain large amounts of labeled training data quickly and cheaply, but these automatic annotations tend to contain a high amount of errors. A popular technique to overcome the negative effects of these…

Machine Learning · Computer Science 2021-03-02 Michael A. Hedderich , Dawei Zhu , Dietrich Klakow

Doubly truncated data are found in astronomy, econometrics and survival analysis literature. They arise when each observation is confined to an interval, i.e., only those which fall within their respective intervals are observed along with…

Methodology · Statistics 2017-01-05 Zhiliang Ying , Wen Yu , Ziqiang Zhao , Ming Zheng

Scaled sparse linear regression jointly estimates the regression coefficients and noise level in a linear model. It chooses an equilibrium with a sparse regression method by iteratively estimating the noise level via the mean residual…

Machine Learning · Statistics 2012-06-22 Tingni Sun , Cun-Hui Zhang