English
Related papers

Related papers: Some results on random design regression with long…

200 papers

We consider nonparametric estimation of the derivative of a probability density function with the bounded support on $[0,\infty)$. Estimates are looked up in the class of estimates with asymmetric gamma kernel functions. The use of gamma…

Probability · Mathematics 2014-07-10 A. V. Dobrovidov , L. A Markovich

Recently there has been a great deal of interest surrounding the calibration of quantum sensors using machine learning techniques. In this work, we explore the use of regression to infer a machine-learned point estimate of an unknown…

Quantum Physics · Physics 2024-06-19 Samuel P. Nolan , Luca Pezzè , Augusto Smerzi

Threshold and ambiguity phenomena are studied in Part 1 of this work where approximations for the mean-squared-error (MSE) of the maximum likelihood estimator are proposed using the method of interval estimation (MIE), and where approximate…

Applications · Statistics 2015-06-19 Achraf Mallat , Sinan Gezici , Davide Dardari , Luc Vandendorpe

Meta-learning involves training models on a variety of training tasks in a way that enables them to generalize well on new, unseen test tasks. In this work, we consider meta-learning within the framework of high-dimensional multivariate…

Statistics Theory · Mathematics 2024-04-01 Yanhao Jin , Krishnakumar Balasubramanian , Debashis Paul

Small area estimators that ignore the sampling design lack design consistency when the sampling mechanism is complex and may be severely biased under informative designs. Existing procedures that account for the survey weights under…

Methodology · Statistics 2026-03-12 William Acero , Domingo Morales , Isabel Molina

A common challenge in nonparametric inference is its high computational complexity when data volume is large. In this paper, we develop computationally efficient nonparametric testing by employing a random projection strategy. In the…

Statistics Theory · Mathematics 2018-02-20 Meimei Liu , Zuofeng Shang , Guang Cheng

The Mean Square Error (MSE) has shown its strength when applied in deep generative models such as Auto-Encoders to model reconstruction loss. However, in image domain especially, the limitation of MSE is obvious: it assumes pixel…

Computer Vision and Pattern Recognition · Computer Science 2019-05-01 Yingjing Lu

The performance of kernel density estimators is usually studied via Taylor expansions and asymptotic approximation arguments, in which the bandwidth parameter tends to zero with increasing sample size. In contrast, this paper focusses…

Statistics Theory · Mathematics 2026-02-25 Nils Lid Hjort , Nikolai G. Ushakov

We provide a theoretical foundation for non-parametric estimation of functions of random variables using kernel mean embeddings. We show that for any continuous function $f$, consistent estimators of the mean embedding of a random variable…

Machine Learning · Statistics 2018-06-04 Carl-Johann Simon-Gabriel , Adam Ścibior , Ilya Tolstikhin , Bernhard Schölkopf

This paper presents a Bayesian sampling approach to bandwidth estimation for the local linear estimator of the regression function in a nonparametric regression model. In the Bayesian sampling approach, the error density is approximated by…

Methodology · Statistics 2020-11-10 Han Lin Shang , Xibin Zhang

Additive regression models are actively researched in the statistical field because of their usefulness in the analysis of responses determined by non-linear relationships with multivariate predictors. In this kind of statistical models,…

Applications · Statistics 2018-03-14 German A. Schnaidt Grez , Brani Vidakovic

Nested simulation encompasses the estimation of functionals linked to conditional expectations through simulation techniques. In this paper, we treat conditional expectation as a function of the multidimensional conditioning variable and…

Statistics Theory · Mathematics 2025-04-16 Ruoxue Liu , Liang Ding , Wenjia Wang , Lu Zou

We propose a new method for input variable selection in nonlinear regression. The method is embedded into a kernel regression machine that can model general nonlinear functions, not being a priori limited to additive models. This is the…

Machine Learning · Computer Science 2018-09-05 Magda Gregorová , Jason Ramapuram , Alexandros Kalousis , Stéphane Marchand-Maillet

This paper is devoted to the performance study of the Linear Minimum Mean Squared Error estimator for multidimensional signals in the large dimension regime. Such an estimator is frequently encountered in wireless communications and in…

Information Theory · Computer Science 2008-10-13 Abla Kammoun , Malika Kharouf , Walid Hachem , Jamal Najim

High-dimensional data analysis has been an active area, and the main focuses have been variable selection and dimension reduction. In practice, it occurs often that the variables are located on an unknown, lower-dimensional nonlinear…

Statistics Theory · Mathematics 2012-07-31 Ming-Yen Cheng , Hau-tieng Wu

This article develops nonparametric cointegrating regression models with endogeneity and semi-long memory. We assume that semi-long memory is produced in the regressor process by tempering of random shock coefficients. The fundamental…

Econometrics · Economics 2025-01-31 Sepideh Mosaferi , Mark S. Kaiser

In this paper we propose an automatic selection of the bandwidth of the semi-recursive kernel estimators of a regression function defined by the stochastic approximation algorithm. We showed that, using the selected bandwidth and some…

Statistics Theory · Mathematics 2016-07-05 Yousri Slaoui

Automatic Speech Recognition (ASR) is traditionally evaluated using Word Error Rate (WER), a metric that is insensitive to meaning. Embedding-based semantic metrics are better correlated with human perception, but decoder-based Large…

There is an intense and partly recent literature focussing on the problem of selecting the bandwidth parameter for kernel density estimators. Available methods are largely `very nonparametric', in the sense of not requiring any knowledge…

Methodology · Statistics 2026-02-17 Nils Lid Hjort

Deep learning based speech enhancement has made rapid development towards improving quality, while models are becoming more compact and usable for real-time on-the-edge inference. However, the speech quality scales directly with the model…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-24 Sebastian Braun , Hannes Gamper