English
Related papers

Related papers: Nonparametric Operator-Regularized Covariance Func…

200 papers

Rational function approximations find applications in many areas including macro-modeling of high-frequency circuits, model order reduction for controller design, interpolation and extrapolation of system responses, surrogate models for…

Systems and Control · Electrical Eng. & Systems 2022-11-10 Andrew Ma , Arif Ege Engin

We consider nonparametric estimation of a regression function for a situation where precisely measured predictors are used to estimate the regression curve for coarsened, that is, less precise or contaminated predictors. Specifically, while…

Statistics Theory · Mathematics 2008-12-18 Aurore Delaigle , Peter Hall , Hans-Georg Müller

This paper introduces an iterative algorithm for training nonparametric additive models that enjoys favorable memory storage and computational requirements. The algorithm can be viewed as the functional counterpart of stochastic gradient…

Machine Learning · Statistics 2026-01-01 Xin Chen , Jason M. Klusowski

This paper addresses the fundamental task of estimating covariance matrix functions for high-dimensional functional data/functional time series. We consider two functional factor structures encompassing either functional factors with scalar…

Methodology · Statistics 2025-10-28 Dong Li , Xinghao Qiao , Zihan Wang

We propose a roughness regularization approach in making nonparametric inference for generalized functional linear models. In a reproducing kernel Hilbert space framework, we construct asymptotically valid confidence intervals for…

Statistics Theory · Mathematics 2015-07-31 Zuofeng Shang , Guang Cheng

Kernel ridge regression is an important nonparametric method for estimating smooth functions. We introduce a new set of conditions, under which the actual rates of convergence of the kernel ridge regression estimator under both the L_2 norm…

Statistics Theory · Mathematics 2020-01-03 Rui Tuo , Yan Wang , C. F. Jeff Wu

In this paper, we propose a novel approach to fit a functional linear regression in which both the response and the predictor are functions of a common variable such as time. We consider the case that the response and the predictor…

Methodology · Statistics 2017-11-15 Behdad Mostafaiy , MohammadReza FaridRohani , Shojaeddin Chenouri

In nonparametric classification and regression problems, regularized kernel methods, in particular support vector machines, attract much attention in theoretical and in applied statistics. In an abstract sense, regularized kernel methods…

Machine Learning · Statistics 2011-04-13 Robert Hable

We introduce a new family of estimators for unnormalized statistical models. Our family of estimators is parameterized by two nonlinear functions and uses a single sample from an auxiliary distribution, generalizing Maximum Likelihood Monte…

Machine Learning · Computer Science 2012-03-19 Miika Pihlaja , Michael Gutmann , Aapo Hyvarinen

We consider identification and inference about mean functionals of observed covariates and an outcome variable subject to nonignorable missingness. By leveraging a shadow variable, we establish a necessary and sufficient condition for…

Statistics Theory · Mathematics 2022-04-07 Wei Li , Wang Miao , Eric Tchetgen Tchetgen

We present estimators for smooth Hilbert-valued parameters, where smoothness is characterized by a pathwise differentiability condition. When the parameter space is a reproducing kernel Hilbert space, we provide a means to obtain efficient,…

Statistics Theory · Mathematics 2023-09-28 Alex Luedtke , Incheoul Chung

Transfer operators such as the Perron--Frobenius or Koopman operator play an important role in the global analysis of complex dynamical systems. The eigenfunctions of these operators can be used to detect metastable sets, to project the…

Dynamical Systems · Mathematics 2019-12-02 Stefan Klus , Ingmar Schuster , Krikamol Muandet

We study the problem of estimating a functional or a parameter in the context where outcome is subject to nonignorable missingness. We completely avoid modeling the regression relation, while allowing the propensity to be modeled by a…

Methodology · Statistics 2021-08-12 Samidha Shetty , Yanyuan Ma , Jiwei Zhao

The paper overviews and investigates several nonparametric methods of estimating covariograms. It provides a unified approach and notation to compare the main approaches used in applied research. The primary focus is on methods that utilise…

Methodology · Statistics 2024-08-06 Adam Bilchouris , Andriy Olenko

Devoted to multi-task learning and structured output learning, operator-valued kernels provide a flexible tool to build vector-valued functions in the context of Reproducing Kernel Hilbert Spaces. To scale up these methods, we extend the…

Machine Learning · Computer Science 2018-05-25 Romain Brault , Florence d'Alché-Buc , Markus Heinonen

Koopman analysis provides a general framework from which to analyze a nonlinear dynamical system in terms of a linear operator acting on an infinite-dimensional observable space. This theoretical framework provides a rigorous underpinning…

Dynamical Systems · Mathematics 2022-10-11 Dan Wilson

Functional data analysis has been extensively conducted. In this study, we consider a partially functional model, under which some covariates are scalars and have linear effects, while some other variables are functional and have…

Methodology · Statistics 2023-01-11 Weijuan Liang , Qingzhao Zhang , Shuangge Ma

In system identification, estimating parameters of a model using limited observations results in poor identifiability. To cope with this issue, we propose a new method to simultaneously select and estimate sensitive parameters as key model…

We consider autocovariance operators of a stationary stochastic process on a Polish space that is embedded into a reproducing kernel Hilbert space. We investigate how empirical estimates of these operators converge along realizations of the…

Probability · Mathematics 2023-08-08 Mattes Mollenhauer , Stefan Klus , Christof Schütte , Péter Koltai

New local linear estimators are proposed for a wide class of nonparametric regression models. The estimators are uniformly consistent regardless of satisfying traditional conditions of depen\-dence of design elements. The estimators are the…

Statistics Theory · Mathematics 2022-07-05 Yuliana Linke , Igor Borisov , Pavel Ruzankin , Vladimir Kutsenko , Elena Yarovaya , Svetlana Shalnova