English
Related papers

Related papers: Convergence rates for Penalised Least Squares Esti…

200 papers

This paper is concerned with exponentially ill-posed operator equations with additive impulsive noise on the right hand side, i.e. the noise is large on a small part of the domain and small or zero outside. It is well known that Tikhonov…

Numerical Analysis · Mathematics 2016-03-18 Claudia König , Frank Werner , Thorsten Hohage

This article investigates the least squares estimators (LSE) for the unknown parameters in stochastic differential equations (SDEs) that are affected by L\'evy noise, particularly when the sample paths are sparse. Specifically, given $n$…

Methodology · Statistics 2026-01-01 Brijesh Kumar Jha , Subhra Sankar Dhar , Akash Ashirbad Panda

Fractional Ornstein-Uhlenbeck process of the second kind $(\text{fOU}_{2})$ is solution of the Langevin equation $\mathrm{d}X_t = -\theta X_t\,\mathrm{d}t+\mathrm{d}Y_t^{(1)}, \ \theta >0$ with driving noise $ Y_t^{(1)} := \int^t_0 e^{-s}…

Probability · Mathematics 2013-02-26 Ehsan Azmoodeh , Jose Igor Morlanes

We consider nonparametric regression with functional covariates, that is, they are elements of an infinite-dimensional Hilbert space. A locally polynomial estimator is constructed, where an orthonormal basis and various tuning parameters…

Statistics Theory · Mathematics 2025-04-09 Moritz Jirak , Alois Kneip , Alexander Meister , Mario Pahl

We consider the least angle regression and forward stagewise algorithms for solving penalized least squares regression problems. In Efron, Hastie, Johnstone & Tibshirani (2004) it is proved that the least angle regression algorithm, with a…

Statistics Theory · Mathematics 2007-05-23 Trevor Hastie , Jonathan Taylor , Robert Tibshirani , Guenther Walther

We consider an on-line least squares regression problem with optimal solution $\theta^*$ and Hessian matrix H, and study a time-average stochastic gradient descent estimator of $\theta^*$. For $k\ge2$, we provide an unbiased estimator of…

Machine Learning · Statistics 2025-11-18 Nabil Kahalé

The performance of Least Squares (LS) estimators is studied in isotonic, unimodal and convex regression. Our results have the form of sharp oracle inequalities that account for the model misspecification error. In isotonic and unimodal…

Statistics Theory · Mathematics 2016-08-09 Pierre C. Bellec

We consider the statistical inverse problem of recovering a parameter $\theta\in H^\alpha$ from data arising from the Gaussian regression problem \begin{equation*} Y = \mathscr{G}(\theta)(Z)+\varepsilon \end{equation*} with nonlinear…

Statistics Theory · Mathematics 2025-09-30 Maximilian Siebel

We propose a sparse regression method based on the non-concave penalized density power divergence loss function which is robust against infinitesimal contamination in very high dimensionality. Present methods of sparse and robust regression…

Methodology · Statistics 2021-05-18 Abhik Ghosh , Subhabrata Majumdar

We study the problem of parameter estimation for discretely observed stochastic differential equations driven by small fractional noise. Under some conditions, we obtain strong consistency and rate of convergence of the least square…

Statistics Theory · Mathematics 2022-01-24 S. Nakajima , S. Nakamura , Y. Shimizu

We study a class of fused lasso problems where the estimated parameters in a sequence are regressed toward their respective observed values (fidelity loss), with $\ell_1$ norm penalty (regularization loss) on the differences between…

Data Structures and Algorithms · Computer Science 2020-05-14 Cheng Lu

In this work, we investigate the inverse problem of recovering a potential coefficient in an elliptic partial differential equation from the observations at deterministic sampling points in the domain subject to random noise. We employ a…

Numerical Analysis · Mathematics 2025-05-30 Bangti Jin , Qimeng Quan , Wenlong Zhang

We consider a semiparametric convolution model. We observe random variables having a distribution given by the convolution of some unknown density $f$ and some partially known noise density $g$. In this work, $g$ is assumed exponentially…

Statistics Theory · Mathematics 2008-10-03 Cristina Butucea , Catherine Matias , Christophe Pouet

We consider the problem of heteroscedastic linear regression, where, given $n$ samples $(\mathbf{x}_i, y_i)$ from $y_i = \langle \mathbf{w}^{*}, \mathbf{x}_i \rangle + \epsilon_i \cdot \langle \mathbf{f}^{*}, \mathbf{x}_i \rangle$ with…

Machine Learning · Statistics 2023-07-04 Dheeraj Baby , Aniket Das , Dheeraj Nagaraj , Praneeth Netrapalli

Spatially inhomogeneous functions, which may be smooth in some regions and rough in other regions, are modelled naturally in a Bayesian manner using so-called Besov priors which are given by random wavelet expansions with…

Statistics Theory · Mathematics 2022-10-27 Sergios Agapiou , Sven Wang

The $\ell_1$-penalized method, or the Lasso, has emerged as an important tool for the analysis of large data sets. Many important results have been obtained for the Lasso in linear regression which have led to a deeper understanding of…

Machine Learning · Statistics 2011-12-30 Jian Huang , Cun-Hui Zhang

It is shown that over-parameterized neural networks can achieve minimax optimal rates of convergence (up to logarithmic factors) for learning functions from certain smooth function classes, if the weights are suitably constrained or…

Machine Learning · Statistics 2024-06-05 Yunfei Yang , Ding-Xuan Zhou

The \emph{Chow parameters} of a Boolean function $f: \{-1,1\}^n \to \{-1,1\}$ are its $n+1$ degree-0 and degree-1 Fourier coefficients. It has been known since 1961 (Chow, Tannenbaum) that the (exact values of the) Chow parameters of any…

Computational Complexity · Computer Science 2012-06-06 Anindya De , Ilias Diakonikolas , Vitaly Feldman , Rocco A. Servedio

We investigate the problem of estimating a function $f$ based on observations from its noisy convolution when the noise exhibits long-range dependence. We construct an adaptive estimator based on the kernel method, derive minimax lower…

Statistics Theory · Mathematics 2017-06-28 Rida Benhaddou

The stochastic time-fractional equation $\partial_t \psi -\Delta\partial_t^{1-\alpha} \psi = f + \dot W$ with space-time white noise $\dot W$ is discretized in time by a backward-Euler convolution quadrature for which the sharp-order error…

Numerical Analysis · Mathematics 2018-08-09 Max Gunzburger , Buyang Li , Jilu Wang
‹ Prev 1 4 5 6 7 8 10 Next ›