English
Related papers

Related papers: Robust M-Estimation for Additive Single-Index Coin…

200 papers

There has been a surge of interest in developing robust estimators for models with heavy-tailed and bounded variance data in statistics and machine learning, while few works impose unbounded variance. This paper proposes two type of robust…

Machine Learning · Statistics 2022-10-12 Lihu Xu , Fang Yao , Qiuran Yao , Huiming Zhang

It is of importance to develop statistical techniques to analyze high-dimensional data in the presence of both complex dependence and possible outliers in real-world applications such as imaging data analyses. We propose a new robust…

Methodology · Statistics 2021-10-01 Bingyuan Liu , Qi Zhang , Lingzhou Xue , Peter X. K. Song , Jian Kang

A new single-index model that reflects the time-dynamic effects of the single index is proposed for longitudinal and functional response data, possibly measured with errors, for both longitudinal and time-invariant covariates. With…

Statistics Theory · Mathematics 2011-03-10 Ci-Ren Jiang , Jane-Ling Wang

The computation of integrals is a fundamental task in the analysis of functional data, which are typically considered as random elements in a space of squared integrable functions. Borrowing ideas from recent advances in the Monte Carlo…

Methodology · Statistics 2025-01-16 Valentin Patilea , Sunny G. W. Wang

It has been observed that certain loss functions can render deep-learning pipelines robust against flaws in the data. In this paper, we support these empirical findings with statistical theory. We especially show that empirical-risk…

Machine Learning · Computer Science 2020-09-15 Johannes Lederer

Estimating causal effects of continuous treatments is a common problem in practice, for example, in studying average dose-response functions. Classical analyses typically assume that all confounders are fully observed, whereas in real-world…

Statistics Theory · Mathematics 2026-04-14 Shuyuan Chen , Peng Zhang , Yifan Cui

Location estimation is a central problem in functional data analysis. In this paper, we investigate penalized spline estimators of location for discretely sampled functional data under a broad class of convex loss functions. Our framework…

Methodology · Statistics 2025-08-19 Ioannis Kalogridis

Many modern datasets are collected automatically and are thus easily contaminated by outliers. This led to a regain of interest in robust estimation, including new notions of robustness such as robustness to adversarial contamination of the…

Statistics Theory · Mathematics 2023-05-05 Pierre Alquier , Mathieu Gerber

Many modern statistical estimation problems are defined by three major components: a statistical model that postulates the dependence of an output variable on the input features; a loss function measuring the error between the observed…

Optimization and Control · Mathematics 2018-10-09 Ying Cui , Jong-Shi Pang , Bodhisattva Sen

In this paper, we propose an optimization-based method for robust phase retrieval problem where the goal is to estimate an unknown signal from a quadratic measurement corrupted by outliers. To enhance the robustness of existing optimization…

Optimization and Control · Mathematics 2026-04-17 Kumataro Yazawa , Keita Kume , Isao Yamada

Penalized estimation can conduct variable selection and parameter estimation simultaneously. The general framework is to minimize a loss function subject to a penalty designed to generate sparse variable selection. The…

Computation · Statistics 2024-01-11 Zhu Wang

A generic out-of-sample error estimate is proposed for robust $M$-estimators regularized with a convex penalty in high-dimensional linear regression where $(X,y)$ is observed and $p,n$ are of the same order. If $\psi$ is the derivative of…

Statistics Theory · Mathematics 2023-03-31 Pierre C Bellec

We propose a generalized partially linear functional single index risk score model for repeatedly measured outcomes where the index itself is a function of time. We fuse the nonparametric kernel method and regression spline method, and…

Statistics Theory · Mathematics 2015-10-15 Fei Jiang , Yanyuan Ma , Yuanjia Wang

We characterize the full classes of M-estimators for semiparametric models of general functionals by formally connecting the theory of consistent loss functions from forecast evaluation with the theory of M-estimation. This novel…

Statistics Theory · Mathematics 2023-05-10 Timo Dimitriadis , Tobias Fissler , Johanna Ziegel

Generalized Linear Models (GLMs) and Single Index Models (SIMs) provide powerful generalizations of linear regression, where the target variable is assumed to be a (possibly unknown) 1-dimensional function of a linear predictor. In general,…

Artificial Intelligence · Computer Science 2011-04-14 Sham Kakade , Adam Tauman Kalai , Varun Kanade , Ohad Shamir

In this article we consider the nonparametric robust estimation problem for regression models in continuous time with semi-Markov noises observed in discrete time moments. An adaptive model selection procedure is proposed. A sharp…

Statistics Theory · Mathematics 2020-05-15 Vlad Stefan Barbu , Slim Beltaief , Serguei Pergamenshchikov

We consider the problem of estimating an additive regression function in an inverse regres- sion model with a convolution type operator. A smooth backfitting procedure is developed and asymptotic normality of the resulting estimator is…

Methodology · Statistics 2016-11-26 Nicolai Bissantz , Holger Dette , Thimo Hildebrandt

Trustworthy machine learning necessitates meticulous regulation of model reliance on non-robust features. We propose a framework to delineate and regulate such features by attributing model predictions to the input. Within our approach,…

Machine Learning · Computer Science 2024-07-10 Peiyu Yang , Naveed Akhtar , Mubarak Shah , Ajmal Mian

Highly robust and efficient estimators for the generalized linear model with a dispersion parameter are proposed. The estimators are based on three steps. In the first step the maximum rank correlation estimator is used to consistently…

Methodology · Statistics 2017-03-29 Michael Amiguet , Alfio Marazzi , Marina Valdora , Victor Yohai

We propose a unified framework for establishing existence of nonparametric M-estimators, computing the corresponding estimates, and proving their strong consistency when the class of functions is exceptionally rich. In particular, the…

Statistics Theory · Mathematics 2019-09-11 Johannes O. Royset , Roger J-B Wets