English
Related papers

Related papers: Limitations Of Richardson Extrapolation For Kernel…

200 papers

This paper investigates the effectiveness of using the Random Projection Ensemble (RPE) approach in Quadratic Discriminant Analysis (QDA) for ultrahigh-dimensional classification problems. Classical methods such as Linear Discriminant…

Methodology · Statistics 2025-07-10 Annesha Deb , Minerva Mukhopadhyay , Subhajit Dutta

A method is developed to numerically solve chance constrained optimal control problems. The chance constraints are reformulated as nonlinear constraints that retain the probability properties of the original constraint. The reformulation…

Optimization and Control · Mathematics 2020-05-29 Rachel E. Keil , Alexander T. Miller , Mrinal Kumar , Anil V. Rao

Sample reweighting is one of the most widely used methods for correcting the error of least squares learning algorithms in reproducing kernel Hilbert spaces (RKHS), that is caused by future data distributions that are different from the…

Machine Learning · Computer Science 2023-07-24 Duc Hoan Nguyen , Sergei V. Pereverzyev , Werner Zellinger

The present article is concerned scattered data approximation for higher dimensional data sets which exhibit an anisotropic behavior in the different dimensions. Tailoring sparse polynomial interpolation to this specific situation, we…

Numerical Analysis · Mathematics 2024-02-16 Helmut Harbrecht , Michael Multerer , Jacopo Quizi

A striking result of [Acharya et al. 2017] showed that to estimate symmetric properties of discrete distributions, plugging in the distribution that maximizes the likelihood of observed multiset of frequencies, also known as the profile…

Statistics Theory · Mathematics 2020-11-03 Yanjun Han , Kirankumar Shiragur

Many common estimators in machine learning and causal inference are linear smoothers, where the prediction is a weighted average of the training outcomes. Some estimators, such as ordinary least squares and kernel ridge regression, allow…

Machine Learning · Computer Science 2026-04-02 David Arbour , Harsh Parikh , Bijan Niknam , Elizabeth Stuart , Kara Rudolph , Avi Feller

Many interesting machine learning problems are best posed by considering instances that are distributions, or sample sets drawn from distributions. Previous work devoted to machine learning tasks with distributional inputs has done so…

Machine Learning · Statistics 2021-01-15 Danica J. Sutherland , Junier B. Oliva , Barnabás Póczos , Jeff Schneider

In this paper, we develop an approach for the exact determination of the minimum sample size for the estimation of a Poisson parameter with prescribed margin of error and confidence level. The exact computation is made possible by reducing…

Statistics Theory · Mathematics 2008-06-19 Xinjia Chen

A fundamental task in kernel methods is to pick nodes and weights, so as to approximate a given function from an RKHS by the weighted sum of kernel translates located at the nodes. This is the crux of kernel density estimation, kernel…

Machine Learning · Statistics 2020-02-25 Ayoub Belhadji , Rémi Bardenet , Pierre Chainais

Kernel density estimation and kernel regression are powerful but computationally expensive techniques: a direct evaluation of kernel density estimates at $M$ evaluation points given $N$ input sample points requires a quadratic…

Computation · Statistics 2020-02-18 Nicolas Langrené , Xavier Warin

We apply the discrepancy method and a chaining approach to give improved bounds on the coreset complexity of a wide class of kernel functions. Our results give randomized polynomial time algorithms to produce coresets of size…

Machine Learning · Computer Science 2023-10-13 Rainie Bozzai , Thomas Rothvoss

Density estimation is a crucial component of many machine learning methods, and manifold learning in particular, where geometry is to be constructed from data alone. A significant practical limitation of the current density estimation…

Classical Analysis and ODEs · Mathematics 2016-01-06 Tyrus Berry , Timothy Sauer

The kernel estimator is known not to be adequate for estimating the density of a positive random variable X. The main reason is the well-known boundary bias problems that it suffers from, but also its poor behaviour in the long right tail…

Methodology · Statistics 2016-02-17 Gery Geenens , Craig Wang

The panel data regression models have become one of the most widely applied statistical approaches in different fields of research, including social, behavioral, environmental sciences, and econometrics. However, traditional…

Methodology · Statistics 2021-08-06 Abhijit Mandal , Beste Hamiye Beyaztas , Soutir Bandyopadhyay

In this study, we employ Euler's method and Richardson's extrapolation to solve a triple integral, which is then transformed into a third-order initial value problem. Our objective is to resolve the computational challenges associated with…

Numerical Analysis · Mathematics 2026-02-17 Shubhangini Gupta , Prashant Sharma , Tamal Pramanick

We study the problem of efficient compression of a stochastic source of probability distributions. It can be viewed as a generalization of Shannon's source coding problem. It has relation to the theory of common randomness, as well as to…

Quantum Physics · Physics 2016-09-08 Andreas Winter

Various methods in statistical learning build on kernels considered in reproducing kernel Hilbert spaces. In applications, the kernel is often selected based on characteristics of the problem and the data. This kernel is then employed to…

Machine Learning · Statistics 2024-03-12 Paul Dommel , Alois Pichler

A Local Orthogonal Polynomial Expansion (LOrPE) of the empirical density function is proposed as a novel method to estimate the underlying density. The estimate is constructed by matching localized expectation values of orthogonal…

Applications · Statistics 2015-05-05 D. P. Amali Dassanayake , Igor Volobouev , A. Alexandre Trindade

Experimental data in Particle and Nuclear physics, Particle Astrophysics and Radiation Protection Dosimetry are obtained from experimental facilities comprising a complex array of sensors, electronics and software. Computer simulation is…

Data Analysis, Statistics and Probability · Physics 2025-03-06 Nikolay D. Gagunashvili

In approximation of functions based on point values, least-squares methods provide more stability than interpolation, at the expense of increasing the sampling budget. We show that near-optimal approximation error can nevertheless be…

Numerical Analysis · Mathematics 2024-02-14 Abdellah Chkifa , Matthieu Dolbeault