English
Related papers

Related papers: Higher-order stochastic integration through cubic …

200 papers

Model performance evaluation is a critical and expensive task in machine learning and computer vision. Without clear guidelines, practitioners often estimate model accuracy using a one-time completely random selection of the data. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Riccardo Fogliato , Pratik Patil , Mathew Monfort , Pietro Perona

This paper develops new variance-reduction techniques for the forward-reflected-backward splitting (FRBS) method to solve a class of possibly nonmonotone stochastic composite inclusions. Unlike unbiased estimators such as mini-batching,…

Machine Learning · Computer Science 2026-03-17 Quoc Tran-Dinh , Nghia Nguyen-Trung

The numerical analysis of stochastic time fractional evolution equations presents considerable challenges due to the limited regularity of the model caused by the nonlocal operator and the presence of noise. The existing time-stepping…

Numerical Analysis · Mathematics 2024-01-22 Minghua Chen , Jiankang Shi , Zhen Song , Yubin Yan , Zhi Zhou

We study the problem of nonparametric estimation of a multivariate function $g:\mathbb {R}^d\to\mathbb{R}$ that can be represented as a composition of two unknown smooth functions $f:\mathbb{R}\to\mathbb{R}$ and $G:\mathbb{R}^d\to…

Statistics Theory · Mathematics 2009-06-05 Anatoli B. Juditsky , Oleg V. Lepski , Alexandre B. Tsybakov

The computation of integrals is a fundamental task in the analysis of functional data, which are typically considered as random elements in a space of squared integrable functions. Borrowing ideas from recent advances in the Monte Carlo…

Methodology · Statistics 2025-01-16 Valentin Patilea , Sunny G. W. Wang

We address numerical differentiation under coarse, non-uniform sampling and Gaussian noise. A maximum-likelihood estimator with $L_2$-norm constraint on a higher-order derivative is obtained, yielding spline-based solution. We introduce a…

Methodology · Statistics 2025-07-31 Konstantin E. Avrachenkov , Leonid B. Freidovich

We establish two new estimates which control a function (after subtracting its average) in $L^1$ by only the $L^1$ norm of its radial derivative. While the interior estimate holds for all superharmonic functions, the boundary version is…

Analysis of PDEs · Mathematics 2025-06-26 Xavier Cabre

This paper presents an algorithmic framework for solving unconstrained stochastic optimization problems using only stochastic function evaluations. We employ central finite-difference based gradient estimation methods to approximate the…

Optimization and Control · Mathematics 2025-01-14 Raghu Bollapragada , Cem Karamanli

Density level sets can be estimated using plug-in methods, excess mass algorithms or a hybrid of the two previous methodologies. The plug-in algorithms are based on replacing the unknown density by some nonparametric estimator, usually the…

Statistics Theory · Mathematics 2016-11-26 A. Rodríguez-Casal , P. Saavedra-Nieves

Non-parametric inference for functional data over two-dimensional domains entails additional computational and statistical challenges, compared to the one-dimensional case. Separability of the covariance is commonly assumed to address these…

Methodology · Statistics 2021-03-19 Tomas Masak , Tomas Rubin , Victor Panaretos

Sequential testing problems involve a complex system with several components, each of which is "working" with some independent probability. The outcome of each component can be determined by performing a test, which incurs some cost. The…

Data Structures and Algorithms · Computer Science 2023-08-22 Rohan Ghuge , Anupam Gupta , Viswanath Nagarajan

A short intrinsic proof is given for the Bourgain-Brezis-Mironescu theorem with an extension for higher-order gradient forms. This argument illustrates the role of functional geometry and Fourier analysis for obtaining embedding estimates.…

Analysis of PDEs · Mathematics 2012-08-02 William Beckner

A method of ``algebraic estimates'' is developed, and used to study the stability properties of integrals of the form \int_B|f(z)|^{-\d}dV, under small deformations of the function f. The estimates are described in terms of a stratification…

Number Theory · Mathematics 2016-09-07 D. H. Phong , Jacob Sturm

In this paper, we introduce a new approach to constructing unbiased estimators when computing expectations of path functionals associated with stochastic differential equations (SDEs). Our randomization idea is closely related to…

Computational Finance · Quantitative Finance 2012-07-11 Chang-han Rhee , Peter W. Glynn

We study the problem of estimating the derivatives of a regression function, which has a wide range of applications as a key nonparametric functional of unknown functions. Standard analysis may be tailored to specific derivative orders, and…

Machine Learning · Statistics 2023-08-29 Zejian Liu , Meng Li

We design and implement a novel algorithm for computing a multilevel Monte Carlo (MLMC) estimator of the cumulative distribution function of a quantity of interest in problems with random input parameters or initial conditions. Our approach…

Numerical Analysis · Mathematics 2020-08-26 Søren Taverniers , Daniel M. Tartakovsky

This paper aims at achieving a "good" estimator for the gradient of a function on a high-dimensional space. Often such functions are not sensitive in all coordinates and the gradient of the function is almost sparse. We propose a method for…

Machine Learning · Statistics 2016-07-27 Vivek S. Borkar , Vikranth R. Dwaracherla , Neeraja Sahasrabudhe

A method is presented for forming polynomial interpolants on squares and cubes, which are more efficient in the so-called Euclidean degree than other commonly used methods with the same number of collocation points. These methods have…

Numerical Analysis · Mathematics 2024-12-11 R. Connor Greene

We introduce a new family of estimators for unnormalized statistical models. Our family of estimators is parameterized by two nonlinear functions and uses a single sample from an auxiliary distribution, generalizing Maximum Likelihood Monte…

Machine Learning · Computer Science 2012-03-19 Miika Pihlaja , Michael Gutmann , Aapo Hyvarinen

This survey paper discusses the history of approximation formulas for n-th order derivatives by integrals involving orthogonal polynomials. There is a large but rather disconnected corpus of literature on such formulas. We give some results…

Classical Analysis and ODEs · Mathematics 2021-01-19 Enno Diekema , Tom H. Koornwinder