中文
相关论文

相关论文: Sharp estimation in sup norm with random design

200 篇论文

We focus on \emph{row sampling} based approximations for matrix algorithms, in particular matrix multipication, sparse matrix reconstruction, and \math{\ell_2} regression. For \math{\matA\in\R^{m\times d}} (\math{m} points in \math{d\ll m}…

数据结构与算法 · 计算机科学 2011-03-29 Malik Magdon-Ismail

We study the fixed design segmented regression problem: Given noisy samples from a piecewise linear function $f$, we want to recover $f$ up to a desired accuracy in mean-squared error. Previous rigorous approaches for this problem rely on…

机器学习 · 计算机科学 2016-07-15 Jayadev Acharya , Ilias Diakonikolas , Jerry Li , Ludwig Schmidt

We study the problem of estimating an unknown function from noisy data using shallow ReLU neural networks. The estimators we study minimize the sum of squared data-fitting errors plus a regularization term proportional to the squared…

机器学习 · 统计学 2023-01-24 Rahul Parhi , Robert D. Nowak

Many economic parameters are identified by ``thin sets'' (submanifolds with Lebesgue measure zero) and hence difficult to recover from data in an ambient space. This paper provides a unified theory for estimation and inference of such…

计量经济学 · 经济学 2026-03-09 Xiaohong Chen , Wayne Yuan Gao

A nonparametric procedure for robust regression estimation and for quantile regression is proposed which is completely data-driven and adapts locally to the regularity of the regression function. This is achieved by considering in each…

统计理论 · 数学 2009-04-06 Markus Reiss , Yves Rozenholc , Charles-Andre Cuenod

Recovery of the sparsity pattern (or support) of an unknown sparse vector from a small number of noisy linear measurements is an important problem in compressed sensing. In this paper, the high-dimensional setting is considered. It is shown…

信息论 · 计算机科学 2013-02-06 Galen Reeves , Michael Gastpar

We consider the problem of estimating the slope parameter in functional linear instrumental regression, where in the presence of an instrument W, i.e., an exogenous random function, a scalar response Y is modeled in dependence of an…

统计理论 · 数学 2016-03-16 Jan Johannes

This paper proposes a new test for a change point in the mean of high-dimensional data based on the spatial sign and self-normalization. The test is easy to implement with no tuning parameters, robust to heavy-tailedness and theoretically…

统计方法学 · 统计学 2022-06-07 Feiyu Jiang , Runmin Wang , Xiaofeng Shao

This paper discusses the problem of determining optimal designs for regression models, when the observations are dependent and taken on an interval. A complete solution of this challenging optimal design problem is given for a broad class…

统计方法学 · 统计学 2015-02-25 Holger Dette , Andrey Pepelyshev , Anatoly Zhigljavsky

We derive upper bounds for random design linear regression with dependent ($\beta$-mixing) data absent any realizability assumptions. In contrast to the strictly realizable martingale noise regime, no sharp instance-optimal non-asymptotics…

机器学习 · 计算机科学 2023-10-30 Ingvar Ziemann , Stephen Tu , George J. Pappas , Nikolai Matni

A robust estimator for a wide family of mixtures of linear regression is presented. Robustness is based on the joint adoption of the Cluster Weighted Model and of an estimator based on trimming and restrictions. The selected model provides…

统计方法学 · 统计学 2015-02-05 L. A. Garcia-Escudero , A. Gordaliza , F. Greselin , S. Ingrassia , A. Mayo-Iscar

Offline reinforcement learning aims to learn from pre-collected datasets without active exploration. This problem faces significant challenges, including limited data availability and distributional shifts. Existing approaches adopt a…

机器学习 · 计算机科学 2024-10-01 Yue Wang , Jinjun Xiong , Shaofeng Zou

Building on previous research of Chi and Chi (2022), the current paper revisits estimation in robust structured regression under the $\text{L}_2\text{E}$ criterion. We adopt the majorization-minimization (MM) principle to design a new…

统计方法学 · 统计学 2023-04-25 Xiaoqian Liu , Eric C. Chi , Kenneth Lange

This paper presents uniform convergence rates for kernel regression estimators, in the setting of a structural nonlinear cointegrating regression model. We generalise the existing literature in three ways. First, the domain to which these…

统计理论 · 数学 2015-05-08 James A. Duffy

Previous analysis of regularized functional linear regression in a reproducing kernel Hilbert space (RKHS) typically requires the target function to be contained in this kernel space. This paper studies the convergence performance of…

机器学习 · 统计学 2024-02-20 Jiading Liu , Lei Shi

This paper addresses the problem of estimating a convex regression function under both the sup-norm risk and the pointwise risk using B-splines. The presence of the convex constraint complicates various issues in asymptotic analysis,…

统计理论 · 数学 2012-05-02 Xiao Wang , Jinglai Shen

This paper presents uniform estimation and inference theory for a large class of nonparametric partitioning-based M-estimators. The main theoretical results include: (i) uniform consistency for convex and non-convex objective functions;…

统计理论 · 数学 2025-09-01 Matias D. Cattaneo , Yingjie Feng , Boris Shigida

In this paper, we construct a parameter estimation framework for robust low-rank tensor regression based on a truncation method and Huber loss, specifically focusing on models with random noise having only finite second-order moments.…

统计理论 · 数学 2025-12-05 Kangqiang Li , Bingqi Liu , Yang Yang , Li Wang

We consider the problem of recovering linear image of unknown signal belonging to a given convex compact signal set from noisy observation of another linear image of the signal. We develop a simple generic efficiently computable nonlinear…

统计理论 · 数学 2019-04-12 Anatoli Juditsky , Arkadi Nemirovski

We present algorithms for nonparametric regression in settings where the data are obtained sequentially. While traditional estimators select bandwidths that depend upon the sample size, for sequential data the effective sample size is…

统计方法学 · 统计学 2012-07-03 Haijie Gu , John Lafferty