English
Related papers

Related papers: Large and moderate deviations principles for kerne…

200 papers

The Large Deviation Principle is established for stochastic models defined by past-dependent non linear recursions with small noise. In the Markov case we use the result to obtain an explicit expression for the asymptotics of exit time.

Probability · Mathematics 2007-05-23 F. Klebaner , R. Liptser

Consistent weighted least square estimators are proposed for a wide class of nonparametric regression models with random regression function, where this real-valued random function of $k$ arguments is assumed to be continuous with…

Statistics Theory · Mathematics 2023-07-04 Yu. Yu. Linke , I. S. Borisov , P. S. Ruzankin

In this paper we propose a convolution estimator for estimating the density of a response variable that employs an underlying multiple regression framework to enhance the accuracy of density estimates through the incorporation of auxiliary…

Statistics Theory · Mathematics 2021-06-04 Brian Fitzpatrick , James Loughman , Daniel Ian Flitcroft

Distributed learning is an effective way to analyze big data. In distributed regression, a typical approach is to divide the big data into multiple blocks, apply a base regression algorithm on each of them, and then simply average the…

Machine Learning · Computer Science 2017-08-08 Zhengchu Guo , Lei Shi , Qiang Wu

A moderate deviation principle for functionals, with at most quadratic growth, of moving average processes is established. The main assumptions on the moving average process are a Logarithmic Sobolev inequality for the driving random…

Probability · Mathematics 2007-06-13 Hacene Djellout , Arnaud Guillin , Liming Wu

Consider a random vector (X, T), where X is d-dimensional and T is one-dimensional. We suppose that the random variable T is subject to random right censoring and satisfies the $\alpha$-mixing property. The aim of this paper is to study the…

Statistics Theory · Mathematics 2019-10-07 Bouhadjera Feriel , Elias Ould Said

We consider the theory of regression on a manifold using reproducing kernel Hilbert space methods. Manifold models arise in a wide variety of modern machine learning problems, and our goal is to help understand the effectiveness of various…

Machine Learning · Statistics 2020-10-19 Andrew McRae , Justin Romberg , Mark Davenport

In this paper, we consider the problem of estimating a conditional density in moderately large dimensions. Much more informative than regression functions, conditional densities are of main interest in recent methods, particularly in the…

Methodology · Statistics 2018-01-22 Minh-Lien Jeanne Nguyen

This paper considers panel data models where the conditional quantiles of the dependent variables are additively separable as unknown functions of the regressors and the individual effects. We propose two estimators of the quantile partial…

Econometrics · Economics 2020-09-30 Liang Chen

We prove an large deviation principle for multivalued sdes

Probability · Mathematics 2011-04-28 Jiagang Ren , Siyan Xu , Xicheng Zhang

This paper provides new uniform rate results for kernel estimators of absolutely regular stationary processes that are uniform in the bandwidth and in infinite-dimensional classes of dependent variables and regressors. Our results are…

Econometrics · Economics 2020-05-21 Juan Carlos Escanciano

I propose kernel ridge regression estimators for nonparametric dose response curves and semiparametric treatment effects in the setting where an analyst has access to a selected sample rather than a random sample; only for select…

Econometrics · Economics 2022-08-24 Rahul Singh

We consider the problem of jointly optimum modulation and estimation of a real-valued random parameter, conveyed over an additive white Gaussian noise (AWGN) channel, where the performance metric is the large deviations behavior of the…

Information Theory · Computer Science 2016-11-17 Neri Merhav

This paper studies probabilistic rates of convergence for consensus+innovations type of algorithms in random, generic networks. For each node, we find a lower and also a family of upper bounds on the large deviations rate function, thus…

Information Theory · Computer Science 2022-08-11 Dragana Bajovic

Quantum computing, with its potential to enhance various machine learning tasks, allows significant advancements in kernel calculation and model precision. Utilizing the one-class Support Vector Machine alongside a quantum kernel, known for…

In this paper, we expand and generalize the findings presented in our previous work on the law of large numbers and the large deviation principle for Poisson processes with uniform catastrophes. We study three distinct scalings: sublinear…

Probability · Mathematics 2025-05-29 A. Logachov , O. Logachova , A. Yambartsev

Distributed machine learning systems have been receiving increasing attentions for their efficiency to process large scale data. Many distributed frameworks have been proposed for different machine learning tasks. In this paper, we study…

Machine Learning · Computer Science 2020-07-01 Hongwei Sun , Qiang Wu

We find large deviations rates for consensus-based distributed inference for directed networks. When the topology is deterministic, we establish the large deviations principle and find exactly the corresponding rate function, equal at all…

Information Theory · Computer Science 2016-06-29 Dragana Bajović , José M. F. Moura , João Xavier , Bruno Sinopoli

We propose a new method for construction of the absolute permeability map consistent with the interpreted results of well logging and well test measurements in oil reservoirs. Nadaraya-Watson kernel regression is used to approximate…

Neural kernels have drastically increased performance on diverse and nonstandard data modalities but require significantly more compute, which previously limited their application to smaller datasets. In this work, we address this by…

Machine Learning · Statistics 2023-03-10 Ben Adlam , Jaehoon Lee , Shreyas Padhy , Zachary Nado , Jasper Snoek