English
Related papers

Related papers: Uniform convergence of kernel averages under fixed…

200 papers

Learning with kernels is an important concept in machine learning. Standard approaches for kernel methods often use predefined kernels that require careful selection of hyperparameters. To mitigate this burden, we propose in this paper a…

Machine Learning · Computer Science 2020-06-26 Yufan Zhou , Changyou Chen , Jinhui Xu

We present a novel framework for kernel learning with sequential data of any kind, such as time series, sequences of graphs, or strings. Our approach is based on signature features which can be seen as an ordered variant of sample…

Machine Learning · Statistics 2016-02-01 Franz J Király , Harald Oberhauser

Non-conservative uncertainty bounds are key for both assessing an estimation algorithm's accuracy and in view of downstream tasks, such as its deployment in safety-critical contexts. In this paper, we derive a tight, non-asymptotic…

Machine Learning · Computer Science 2026-01-16 Amon Lahr , Johannes Köhler , Anna Scampicchio , Melanie N. Zeilinger

We consider uniform moment convergence of lag-window spectral density estimates for univariate and multivariate stationary processes. Optimal rates of convergence are obtained under mild and easily verifiable conditions. Our theory…

Methodology · Statistics 2015-05-15 Wei Biao Wu , Paolo Zaffaroni

In this paper, we discuss the convergence analysis of the conjugate gradient-based algorithm for the functional linear model in the reproducing kernel Hilbert space framework, utilizing early stopping results in regularization against…

Statistics Theory · Mathematics 2023-10-05 Naveen Gupta , S. Sivananthan , Bharath K. Sriperumbudur

Variational methods are widely used for approximate posterior inference. However, their use is typically limited to families of distributions that enjoy particular conjugacy properties. To circumvent this limitation, we propose a family of…

Machine Learning · Computer Science 2012-06-22 Samuel Gershman , Matt Hoffman , David Blei

We construct a kernel density estimator on symmetric spaces of non-compact type and establish an upper bound for its convergence rate, analogous to the minimax rate for classical kernel density estimators on Euclidean space. Symmetric…

Statistics Theory · Mathematics 2022-06-30 Dena Marie Asta

This work is concerned with model reduction of stochastic differential equations and builds on the idea of replacing drift and noise coefficients of preselected relevant, e.g. slow variables by their conditional expectations. We extend…

Analysis of PDEs · Mathematics 2020-03-05 Carsten Hartmann , Lara Neureither , Upanshu Sharma

We consider families of fast-slow skew product maps of the form \begin{align*} x_{n+1} = x_n+\epsilon a(x_n,y_n,\epsilon), \quad y_{n+1} = T_\epsilon y_n, \end{align*} where $T_\epsilon$ is a family of nonuniformly expanding maps, and prove…

Dynamical Systems · Mathematics 2017-05-02 A. Korepanov , Z. Kosloff , I. Melbourne

We study the convergence of Bernstein type operators leading to two results. The first: The kernel $K_n$ of the Bernstein-Durrmeyer operator at each point $x \in (0, 1)$ $\unicode{x2013}$ that is $K_n(x, t) dt$ $\unicode{x2013}$ once…

Classical Analysis and ODEs · Mathematics 2023-12-05 Mohammed Taariq Mowzer

Kernel Stein discrepancies (KSDs) measure the quality of a distributional approximation and can be computed even when the target density has an intractable normalizing constant. Notable applications include the diagnosis of approximate MCMC…

Machine Learning · Statistics 2025-06-24 Heishiro Kanagawa , Alessandro Barp , Arthur Gretton , Lester Mackey

This paper introduces and analyzes a framework that accommodates general heterogeneity in regression modeling. It demonstrates that regression models with fixed or time-varying parameters can be estimated using the OLS and time-varying OLS…

Econometrics · Economics 2025-11-11 Liudas Giraitis , George Kapetanios , Yufei Li , Alexia Ventouri

We extend the use of random evolving sets to time-varying conductance models and utilize it to provide tight heat kernel upper bounds. It yields the transience of any uniformly lazy random walk, on Z^d, d>=3, equipped with uniformly bounded…

Probability · Mathematics 2016-03-22 Amir Dembo , Ruojun Huang , Ben Morris , Yuval Peres

Recent work on background subtraction has shown developments on two major fronts. In one, there has been increasing sophistication of probabilistic models, from mixtures of Gaussians at each pixel [7], to kernel density estimates at each…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Manjunath Narayana , Allen Hanson , Erik Learned-Miller

We consider nonadaptive group testing where each item is placed in a constant number of tests. The tests are chosen uniformly at random with replacement, so the testing matrix has (almost) constant column weights. We show that performance…

Information Theory · Computer Science 2016-08-23 Matthew Aldridge , Oliver Johnson , Jonathan Scarlett

Recent work has developed Bayesian methods for the automatic statistical analysis and description of single time series as well as of homogeneous sets of time series data. We extend prior work to create an interpretable kernel embedding for…

Machine Learning · Computer Science 2019-08-27 Andre T. Nguyen , Edward Raff

This paper introduces a novel statistical regression framework that allows the incorporation of consistency constraints. A linear and nonlinear (kernel-based) formulation are introduced, and both imply closed-form analytical solutions. The…

Methodology · Statistics 2020-12-10 Emiliano Díaz , Adrián Pérez-Suay , Valero Laparra , Gustau Camps-Valls

We find conditions for the connectivity of inhomogeneous random graphs with intermediate density. Our results generalize the classical result for G(n, p), when p = c log n/n. We draw n independent points X_i from a general distribution on a…

Probability · Mathematics 2012-10-25 Luc Devroye , Nicolas Fraiman

Many scientific and engineering challenges -- ranging from pharmacokinetic drug dosage allocation and personalized medicine to marketing mix (4Ps) recommendations -- require an understanding of the unobserved heterogeneity in order to…

Methodology · Statistics 2017-08-17 Jelena Bradic , Gerda Claeskens , Thomas Gueuning

Existing convergence of distributed optimization methods in non-Euclidean geometries typically rely on kernel assumptions: (i) global Lipschitz smoothness and (ii) bi-convexity of the associated Bregman divergence function. Unfortunately,…

Optimization and Control · Mathematics 2026-03-16 Junwen Qiu , Ziyang Zeng , Leilei Mei , Junyu Zhang