English
Related papers

Related papers: High-Order Statistical Functional Expansion and It…

200 papers

The density estimation is one of the core problems in statistics. Despite this, existing techniques like maximum likelihood estimation are computationally inefficient due to the intractability of the normalizing constant. For this reason an…

Machine Learning · Computer Science 2021-01-14 Tsimboy Olga , Yermek Kapushev , Evgeny Burnaev , Ivan Oseledets

This paper considers the problem of estimating a periodic function in a continuous time regression model with an additive stationary gaussian noise having unknown correlation function. A general model selection procedure on the basis of…

Statistics Theory · Mathematics 2010-11-10 Victor Konev , Serguei Pergamenchtchikov

A novel approach to perform unsupervised sequential learning for functional data is proposed. Our goal is to extract reference shapes (referred to as templates) from noisy, deformed and censored realizations of curves and images. Our model…

Methodology · Statistics 2016-04-05 Florian Maire , Eric Moulines , Sidonie Lefebvre

The error or variability of machine learning algorithms is often assessed by repeatedly re-fitting a model with different weighted versions of the observed data. The ubiquitous tools of cross-validation (CV) and the bootstrap are examples…

Methodology · Statistics 2020-02-10 Ryan Giordano , Will Stephenson , Runjing Liu , Michael I. Jordan , Tamara Broderick

By combining the Malliavin calculus with Fourier techniques, we develop a high-order asymptotic expansion theory for a sequence of vector-valued random variables. Our asymptotic expansion formulas give the development of the characteristic…

Probability · Mathematics 2019-09-20 Ciprian Tudor , Nakahiro Yoshida

We consider the problem of estimating an unknown function f* and its partial derivatives from a noisy data set of n observations, where we make no assumptions about f* except that it is smooth in the sense that it has square integrable…

Machine Learning · Statistics 2024-05-17 Eunji Lim

We consider the problem of state estimation in dynamical systems and propose a different mechanism for handling unmodeled system uncertainties. Instead of injecting random process noise, we assign different weights to measurements so that…

Information Theory · Computer Science 2020-09-08 Yaron Shulami , Daniel Sigalov

We consider the problem of density estimation in the context of multiscale Langevin diffusion processes, where a single-scale homogenized surrogate model can be derived. In particular, our aim is to learn the density of the invariant…

Numerical Analysis · Mathematics 2025-10-30 Jaroslav I. Borodavka , Max Hirsch , Sebastian Krumscheid , Andrea Zanoni

This paper provides a new approach to derive various arbitrary high order finite difference formulae for the numerical differentiation of analytic functions. In this approach, various first and second order formulae for the numerical…

Numerical Analysis · Mathematics 2020-05-26 Saint-Cyr E. R. Koyaguerebo-Imé , Yves Bourgault

The non-parametric estimation of covariance lies at the heart of functional data analysis, whether for curve or surface-valued data. The case of a two-dimensional domain poses both statistical and computational challenges, which are…

Statistics Theory · Mathematics 2022-01-19 Tomas Masak , Soham Sarkar , Victor M. Panaretos

A COMPARISON OF TWO SMOOTHING METHODS FOR WORD BIGRAM MODELS Linda Bauman Peto Department of Computer Science University of Toronto Abstract Word bigram models estimated from text corpora require smoothing methods to estimate the…

cmp-lg · Computer Science 2008-02-03 Linda Bauman Peto

Inferring the parameters of a stochastic model based on experimental observations is central to the scientific method. A particularly challenging setting is when the model is strongly indeterminate, i.e. when distinct sets of parameters…

Machine Learning · Statistics 2021-11-10 Pedro L. C. Rodrigues , Thomas Moreau , Gilles Louppe , Alexandre Gramfort

The Taylor expansion of wave fields with respect to shape parameters has a wide range of applications in wave scattering problems, including inverse scattering, optimal design, and uncertainty quantification. However, deriving the high…

Numerical Analysis · Mathematics 2025-03-24 Gang Bao , Haoran Ma , Jun Lai , Jingzhi Li

Let $X$ be a random vector with distribution $P_{\theta}$ where $\theta$ is an unknown parameter. When estimating $\theta$ by some estimator $\varphi(X)$ under a loss function $L(\theta,\varphi)$, classical decision theory advocates that…

Methodology · Statistics 2012-03-23 Dominique Fourdrinier , Martin T. Wells

The relaxation in the calculus of variation motivates the numerical analysis of a class of degenerate convex minimization problems with non-strictly convex energy densities with some convexity control and two-sided $p$-growth. The…

Numerical Analysis · Mathematics 2024-07-03 C. Carstensen , N. T. Tran

In supervised learning, the output variable to be predicted is often represented as a function, such as a spectrum or probability distribution. Despite its importance, functional output regression remains relatively unexplored. In this…

Machine Learning · Statistics 2025-03-19 Minoru Kusaba , Megumi Iwayama , Ryo Yoshida

The numerical evaluation of statistics plays a crucial role in statistical physics and its applied fields. It is possible to evaluate the statistics for a stochastic differential equation with Gaussian white noise via the corresponding…

Numerical Analysis · Mathematics 2023-07-04 Jun Ohkubo

We develop a new approach for estimating the expected values of nonlinear functions applied to multivariate random variables with arbitrary distributions. Rather than assuming a particular distribution, we assume that we are only given the…

Numerical Analysis · Mathematics 2020-06-25 Deanna Easley , Tyrus Berry

The article is devoted to the construction of explicit one-step strong numerical methods with the orders 2.0 and 2.5 of convergence for Ito stochastic differential equations with multidimensional non-commutative noise. We consider the…

Probability · Mathematics 2022-09-13 Dmitriy F. Kuznetsov

This chapter provides an introduction to Hybrid High-Order (HHO) methods. These are new generation numerical methods for PDEs with several advantageous features: the support of arbitrary approximation orders on general polyhedral meshes,…

Numerical Analysis · Mathematics 2017-04-21 Daniele A. Di Pietro , Roberta Tittarelli