English
Related papers

Related papers: Stochastic expansions using continuous dictionarie…

200 papers

In this paper, we study nonparametric models allowing for locally stationary regressors and a regression function that changes smoothly over time. These models are a natural extension of time series models with time-varying coefficients. We…

Statistics Theory · Mathematics 2013-02-19 Michael Vogt

We study natural invariance properties of functionals defined on L\'evy processes and show that they can be described by a simplified structure of the deterministic chaos kernels in It\^o's chaos expansion. These structural properties of…

Probability · Mathematics 2016-06-20 F. Baumgartner , S. Geiss

We present a novel approach to learn a kernel-based regression function. It is based on the useof conical combinations of data-based parameterized kernels and on a new stochastic convex optimization procedure of which we establish…

Machine Learning · Computer Science 2012-01-13 Pierre Machart , Thomas Peel , Liva Ralaivola , Sandrine Anthoine , Hervé Glotin

We consider the problem of learning Stochastic Differential Equations of the form $dX_t = f(X_t)dt+\sigma(X_t)dW_t $ from one sample trajectory. This problem is more challenging than learning deterministic dynamical systems because one…

Machine Learning · Statistics 2022-12-28 Matthieu Darcy , Boumediene Hamzi , Giulia Livieri , Houman Owhadi , Peyman Tavallali

Kernel adaptive filters, a class of adaptive nonlinear time-series models, are known by their ability to learn expressive autoregressive patterns from sequential data. However, for trivial monotonic signals, they struggle to perform…

Machine Learning · Statistics 2017-07-14 Felipe Tobar

We show that a conditional characteristic function of generalized L\'evy stochastic areas can be viewed as a product a selfdecomposable distribution (i.e., L\'evy class L distribution) and its background driving characteristic function.…

Probability · Mathematics 2010-09-21 Zbigniew J. Jurek

We consider the prediction problem of a continuous-time stochastic process on an entire time-interval in terms of its recent past. The approach we adopt is based on functional kernel nonparametric regression estimation techniques where…

Statistics Theory · Mathematics 2007-06-13 Anestis Antoniadis , Efstathios Paparoditis , Theofanis Sapatinas

In this study, we develop an asymptotic theory of nonparametric regression for locally stationary random fields (LSRFs) $\{{\bf X}_{{\bf s}, A_{n}}: {\bf s} \in R_{n} \}$ in $\mathbb{R}^{p}$ observed at irregularly spaced locations in…

Statistics Theory · Mathematics 2022-07-07 Daisuke Kurisu

Structured additive distributional regression models offer a versatile framework for estimating complete conditional distributions by relating all parameters of a parametric distribution to covariates. Although these models efficiently…

Methodology · Statistics 2023-11-14 Jana Kleinemeier , Nadja Klein

This paper investigates stochastic nondeterminism on continuous state spaces by relating nondeterministic kernels and stochastic effectivity functions to each other. Nondeterministic kernels are functions assigning each state a set o…

Logic in Computer Science · Computer Science 2015-07-07 Ernst-Erich Doberkat , Pedro Sánchez Terraf

Gaussian processes are flexible function approximators, with inductive biases controlled by a covariance kernel. Learning the kernel is the key to representation learning and strong predictive performance. In this paper, we develop…

Machine Learning · Computer Science 2019-10-31 Gregory W. Benton , Wesley J. Maddox , Jayson P. Salkey , Julio Albinati , Andrew Gordon Wilson

We propose a new method for input variable selection in nonlinear regression. The method is embedded into a kernel regression machine that can model general nonlinear functions, not being a priori limited to additive models. This is the…

Machine Learning · Computer Science 2018-09-05 Magda Gregorová , Jason Ramapuram , Alexandros Kalousis , Stéphane Marchand-Maillet

The problem of adaptive multivariate function estimation in the single-index regression model with random design and weak assumptions on the noise is investigated. A novel estimation procedure that adapts simultaneously to the unknown index…

Statistics Theory · Mathematics 2014-01-29 Oleg Lepski , Nora Serdyukova

In the present paper, we give a condensed review, for the nonspecialist reader, of a new modelling framework for spatio-temporal processes, based on L\'{e}vy theory. We show the potential of the approach in stochastic geometry and spatial…

Statistics Theory · Mathematics 2008-12-18 Kristjana Ýr Jónsdóttir , Jürgen Schmiegel , Eva B. Vedel Jensen

This paper derives limit properties of nonparametric kernel regression estimators without requiring existence of density for regressors in $\mathbb{R}^{q}.$ In functional regression limit properties are established for multivariate…

Econometrics · Economics 2026-01-08 Marcia Schafgans , Victoria Zinde-Walsh

We introduce a novel approach for learning memory kernels in Generalized Langevin Equations. This approach initially utilizes a regularized Prony method to estimate correlation functions from trajectory data, followed by regression over a…

Machine Learning · Statistics 2025-05-22 Quanjun Lang , Jianfeng Lu

In this paper, we consider an unknown functional estimation problem in a general nonparametric regression model with the feature of having both multiplicative and additive noise.We propose two new wavelet estimators in this general context.…

Statistics Theory · Mathematics 2020-12-25 Christophe Chesneau , Salima El Kolei , Junke Kou , Fabien Navarro

We connect shift-invariant characteristic kernels to infinitely divisible distributions on $\mathbb{R}^{d}$. Characteristic kernels play an important role in machine learning applications with their kernel means to distinguish any two…

Machine Learning · Statistics 2016-10-26 Yu Nishiyama , Kenji Fukumizu

In many applications (in particular information systems, such as pattern recognition, machine learning, cheminformatics, bioinformatics to name but a few) the assessment of uncertainty is essential - i.e., the estimation of the underlying…

Machine Learning · Statistics 2016-09-26 Hamse Y. Mussa , Avid M. Afzal

Modern Bayesian optimization and adaptive sampling methods increasingly rely on nonlinear parametric models, yet theoretical guarantees for such models under adaptive data collection remain limited. Existing analyses largely focus on…

Machine Learning · Statistics 2026-05-14 Rafael Oliveira