English
Related papers

Related papers: Large and moderate deviation principles for recurs…

200 papers

The Gaussian kernel and its traditional normalizations (e.g., row-stochastic) are popular approaches for assessing similarities between data points. Yet, they can be inaccurate under high-dimensional noise, especially if the noise magnitude…

Statistics Theory · Mathematics 2023-07-12 Boris Landa , Xiuyuan Cheng

In this letter, an accelerated quadratic programming (QP) algorithm is proposed based on the proximal gradient method. The algorithm can achieve convergence rate $O(1/p^{\alpha})$, where $p$ is the iteration number and $\alpha$ is the given…

Optimization and Control · Mathematics 2022-01-25 Jia Wang , Ying Yang

Consider an intersection measure $\ell_t ^{\mathrm{IS}}$ of $p$ independent (possibly different) $m$-symmetric Hunt processes up to time $t$ in a metric measure space $E$ with a Radon measure $m$. We derive a Donsker-Varadhan type large…

Probability · Mathematics 2018-05-22 Takahiro Mori

We propose a novel deterministic sampling method to approximate a target distribution $\rho^*$ by minimizing the kernel discrepancy, also known as the Maximum Mean Discrepancy (MMD). By employing the general \emph{energetic variational…

Machine Learning · Statistics 2025-03-12 Yindong Chen , Yiwei Wang , Lulu Kang , Chun Liu

Bayesian inference problems require sampling or approximating high-dimensional probability distributions. The focus of this paper is on the recently introduced Stein variational gradient descent methodology, a class of algorithms that rely…

Machine Learning · Statistics 2023-02-14 A. Duncan , N. Nuesken , L. Szpruch

We introduce a new nonparametric density estimator inspired by Markov Chains, and generalizing the well-known Kernel Density Estimator (KDE). Our estimator presents several benefits with respect to the usual ones and can be used…

Methodology · Statistics 2020-09-15 Andrea De Simone , Alessandro Morandini

We propose a new threshold selection method for the nonparametric estimation of the extremal index of stochastic processes. The so-called discrepancy method was proposed as a data-driven smoothing tool for estimation of a probability…

Statistics Theory · Mathematics 2020-09-07 Natalia M. Markovich , Igor V. Rodionov

This paper considers sparse linear discriminant analysis of high-dimensional data. In contrast to the existing methods which are based on separate estimation of the precision matrix $\O$ and the difference $\de$ of the mean vectors, we…

Methodology · Statistics 2011-07-19 Tony Cai , Weidong Liu

This paper introduces a multilevel kernel-based approximation method to estimate efficiently solutions to elliptic partial differential equations (PDEs) with periodic random coefficients. Building upon the work of Kaarnioja, Kazashi, Kuo,…

Numerical Analysis · Mathematics 2025-04-23 Alexander D. Gilbert , Michael B. Giles , Frances Y. Kuo , Ian H. Sloan , Abirami Srikumar

The semimartingale stochastic approximation procedure, namely, the Robbins-Monro type SDE is introduced which naturally includes both generalized stochastic approximation algorithms with martingale noises and recursive parameter estimation…

Probability · Mathematics 2007-05-23 N. Lazrieva , T. Sharia , T. Toronjadze

Distances between probability distributions that take into account the geometry of their sample space,like the Wasserstein or the Maximum Mean Discrepancy (MMD) distances have received a lot of attention in machine learning as they can, for…

Machine Learning · Computer Science 2020-04-29 Gaëtan Hadjeres , Frank Nielsen

We provide new asymptotic theory for kernel density estimators, when these are applied to autoregressive processes exhibiting moderate deviations from a unit root. This fills a gap in the existing literature, which has to date considered…

Statistics Theory · Mathematics 2019-08-19 James A. Duffy

This paper introduces a kernel discrepancy-based framework for rerandomization to enhance the precision of causal inference in controlled experiments. We demonstrate that the kernel discrepancy is the key part of the variance upper bound…

Methodology · Statistics 2025-11-05 Yiou Li , Lulu Kang

Stochastic processes are random variables with values in some space of paths. However, reducing a stochastic process to a path-valued random variable ignores its filtration, i.e. the flow of information carried by the process through time.…

Machine Learning · Statistics 2021-11-05 Cristopher Salvi , Maud Lemercier , Chong Liu , Blanka Hovarth , Theodoros Damoulas , Terry Lyons

We introduce sparse random projection, an important dimension-reduction tool from machine learning, for the estimation of discrete-choice models with high-dimensional choice sets. Initially, high-dimensional data are compressed into a…

Machine Learning · Statistics 2016-04-21 Khai X. Chiong , Matthew Shum

Approximate dynamic programming is a popular method for solving large Markov decision processes. This paper describes a new class of approximate dynamic programming (ADP) methods- distributionally robust ADP-that address the curse of…

Machine Learning · Statistics 2012-05-22 Marek Petrik

Stochastic gradient descent (SGD) is a cornerstone of machine learning. When the number N of data items is large, SGD relies on constructing an unbiased estimator of the gradient of the empirical risk using a small subset of the original…

Machine Learning · Statistics 2021-12-14 Remi Bardenet , Subhro Ghosh , Meixia Lin

A Local Orthogonal Polynomial Expansion (LOrPE) of the empirical density function is proposed as a novel method to estimate the underlying density. The estimate is constructed by matching localized expectation values of orthogonal…

Applications · Statistics 2015-05-05 D. P. Amali Dassanayake , Igor Volobouev , A. Alexandre Trindade

This paper provides the relevant literature with a complete toolkit for conducting robust estimation and inference about the parameters of interest involved in a high-dimensional panel data framework. Specifically, (1) we allow for…

Econometrics · Economics 2025-02-13 Jiti Gao , Fei Liu , Bin Peng , Yayi Yan

In this work, we investigate the McKean-Vlasov stochastic partial differential equations driven by Poisson random measure. By adapting the variational framework, we prove the well-posedness and large deviation principle for a class of…

Probability · Mathematics 2025-08-05 Yuhang Jiang , Jinming Li , Shihu Li
‹ Prev 1 8 9 10 Next ›