English
Related papers

Related papers: Kernel Estimation for Nonlinear Dynamics

200 papers

Depth measures are powerful tools for defining level sets in emerging, non--standard, and complex random objects such as high-dimensional multivariate data, functional data, and random graphs. Despite their favorable theoretical properties,…

Many statistical estimation techniques for high-dimensional or functional data are based on a preliminary dimension reduction step, which consists in projecting the sample $\bX_1, \hdots, \bX_n$ onto the first $D$ eigenvectors of the…

Statistics Theory · Mathematics 2010-04-26 Gérard Biau , André Mas

In this article a surprising result is demonstrated using the neural tangent kernel. This kernel is defined as the inner product of the vector of the gradient of an underlying model evaluated at training points. This kernel is used to…

Artificial Intelligence · Computer Science 2021-04-14 Matt Calder

Kernel ridge regression (KRR) is widely used for nonparametric regression over reproducing kernel Hilbert spaces. It offers powerful modeling capabilities at the cost of significant computational costs, which typically require $O(n^3)$…

Methodology · Statistics 2024-03-18 Xiaowu Dai , Huiying Zhong

Software effort estimation models are typically developed based on an underlying assumption that all data points are equally relevant to the prediction of effort for future projects. The dynamic nature of several aspects of the software…

Software Engineering · Computer Science 2021-07-06 Michael Franklin Bosu , Stephen G. MacDonell , Peter A. Whigham

Modeling dynamical systems with ordinary differential equations implies a mechanistic view of the process underlying the dynamics. However in many cases, this knowledge is not available. To overcome this issue, we introduce a general…

Machine Learning · Computer Science 2014-11-20 Markus Heinonen , Florence d'Alché-Buc

We propose a general matrix-valued multiple kernel learning framework for high-dimensional nonlinear multivariate regression problems. This framework allows a broad class of mixed norm regularizers, including those that induce sparsity, to…

Machine Learning · Computer Science 2014-08-12 Vikas Sindhwani , Ha Quang Minh , Aurelie Lozano

We propose a general matrix-valued multiple kernel learning framework for high-dimensional nonlinear multivariate regression problems. This framework allows a broad class of mixed norm regularizers, including those that induce sparsity, to…

Machine Learning · Statistics 2013-03-11 Vikas Sindhwani , Minh Ha Quang , Aurelie C. Lozano

In this paper we present a nonparametric method for extending functional regression methodology to the situation where more than one functional covariate is used to predict a functional response. Borrowing the idea from Kadri et al.…

Machine Learning · Statistics 2013-01-16 Hachem Kadri , Philippe Preux , Emmanuel Duflos , Stéphane Canu

Gaussian process regression is a widely-applied method for function approximation and uncertainty quantification. The technique has gained popularity recently in the machine learning community due to its robustness and interpretability. The…

Machine Learning · Statistics 2022-10-12 Marcus M. Noack , James A. Sethian

Local polynomial regression (Fan and Gijbels 1996) is an important class of methods for nonparametric density estimation and regression problems. However, straightforward implementation of local polynomial regression has quadratic time…

Computation · Statistics 2020-09-01 Yining Wang , Yi Wu , Simon S. Du

Regularized kernel methods such as, e.g., support vector machines and least-squares support vector regression constitute an important class of standard learning algorithms in machine learning. Theoretical investigations concerning…

Machine Learning · Statistics 2012-03-21 Robert Hable

Fisher's linear discriminant analysis is a classical method for classification, yet it is limited to capturing linear features only. Kernel discriminant analysis as an extension is known to successfully alleviate the limitation through a…

Machine Learning · Statistics 2022-07-29 Jiae Kim , Yoonkyung Lee , Zhiyu Liang

In this work, we develop and study an empirical projection operator scheme for solving nonparametric regression problems. This scheme is based on an approximate projection of the regression function over a suitable reproducing kernel…

Statistics Theory · Mathematics 2020-02-04 Bilel Bousselmi , Jean-François Dupuy , Abderrazek Karoui

We consider parameter estimation in a regression model corresponding to an iid sequence of censored observations of a finite state modulated renewal process. The model assumes a similar form as in Cox regression except that the baseline…

Statistics Theory · Mathematics 2007-06-13 Dorota M. Dabrowska , Wai Tung Ho

In this article, basing on NQD samples, we investigate the fixed design nonparametric regression model, where the errors are pairwise NQD random errors, with fixed design points, and an unknown function. Nonparametric weighted estimator…

Statistics Theory · Mathematics 2013-12-04 Jian-hua Shi , Xiao-ping Chen , Yong Zhou

Empirical data can often be considered as samples from a set of probability distributions. Kernel methods have emerged as a natural approach for learning to classify these distributions. Although numerous kernels between distributions have…

Machine Learning · Computer Science 2024-12-02 Oleksii Kachaiev , Stefano Recanatesi

For some spatially nonlocal diffusion models with a finite range of nonlocal interactions measured by a positive parameter $\delta$, we review their formulation defined on a bounded domain subject to various conditions that correspond to…

Analysis of PDEs · Mathematics 2022-12-27 Qiang Du , Xiaochuan Tian , Zhi Zhou

In this draft, fault diagnosis in nonlinear dynamic systems is addressed. The objective of this work is to establish a framework, in which not only model-based but also data-driven and machine learning based fault diagnosis strategies can…

Systems and Control · Electrical Eng. & Systems 2023-10-27 Steven X. Ding , Linlin Li

Learning from non-independent and non-identically distributed data poses a persistent challenge in statistical learning. In this study, we introduce data-dependent Bernstein inequalities tailored for vector-valued processes in Hilbert…

Machine Learning · Computer Science 2025-07-11 Erfan Mirzaei , Andreas Maurer , Vladimir R. Kostic , Massimiliano Pontil