English
Related papers

Related papers: Early stopping and non-parametric regression: An o…

200 papers

In this note we propose a new approach towards solving numerically optimal stopping problems via reinforced regression based Monte Carlo algorithms. The main idea of the method is to reinforce standard linear regression algorithms in each…

Numerical Analysis · Mathematics 2019-07-02 Denis Belomestny , John Schoenmakers , Vladimir Spokoiny , Bakhyt Zharkynbay

Active learning has shown to reduce the number of experiments needed to obtain high-confidence drug-target predictions. However, in order to actually save experiments using active learning, it is crucial to have a method to evaluate the…

Quantitative Methods · Quantitative Biology 2015-04-10 Maja Temerinac-Ott , Armaghan W. Naik , Robert F. Murphy

We suggest two nonparametric approaches, based on kernel methods and orthogonal series to estimating regression functions in the presence of instrumental variables. For the first time in this class of problems, we derive optimal convergence…

Statistics Theory · Mathematics 2007-06-13 Peter Hall , Joel L. Horowitz

In this paper, we study nonparametric models allowing for locally stationary regressors and a regression function that changes smoothly over time. These models are a natural extension of time series models with time-varying coefficients. We…

Statistics Theory · Mathematics 2013-02-19 Michael Vogt

In system identification, estimating parameters of a model using limited observations results in poor identifiability. To cope with this issue, we propose a new method to simultaneously select and estimate sensitive parameters as key model…

This paper proposes a fully data-driven approach for optimal control of nonlinear control-affine systems represented by a stochastic diffusion. The focus is on the scenario where both the nonlinear dynamics and stage cost functions are…

Optimization and Control · Mathematics 2025-11-03 Nicolas Hoischen , Petar Bevanda , Stefan Sosnowski , Sandra Hirche , Boris Houska

Recently, many machine learning and statistical models such as non-linear regressions, the Single Index, Multi-index, Varying Coefficient Index Models and Two-layer Neural Networks can be reduced to or be seen as a special case of a new…

Machine Learning · Computer Science 2020-10-20 Di Wang , Xiangyu Guo , Chaowen Guan , Shi Li , Jinhui Xu

Nonparametric estimation of nonlocal interaction kernels is crucial in various applications involving interacting particle systems. The inference challenge, situated at the nexus of statistical learning and inverse problems, arises from the…

Statistics Theory · Mathematics 2025-04-24 Xiong Wang , Inbar Seroussi , Fei Lu

This study introduces a debiasing method for regression estimators, including high-dimensional and nonparametric regression estimators. For example, nonparametric regression methods allow for the estimation of regression functions in a…

Machine Learning · Statistics 2024-11-27 Masahiro Kato

We consider the problem of adaptive estimation of the regression function in a framework where we replace ergodicity assumptions (such as independence or mixing) by another structural assumption on the model. Namely, we propose adaptive…

Statistics Theory · Mathematics 2010-11-03 Sylvain Delattre , Stéphane Gaïffas

The effectiveness of non-parametric, kernel-based methods for function estimation comes at the price of high computational complexity, which hinders their applicability in adaptive, model-based control. Motivated by approximation techniques…

Statistics Theory · Mathematics 2023-03-17 Anna Scampicchio , Elena Arcari , Melanie N. Zeilinger

Adaptive bandwidth selection is a fundamental challenge in nonparametric regression. This paper introduces a new bandwidth selection procedure inspired by the optimality criteria for $\ell_0$-penalized regression. Although similar in spirit…

Machine Learning · Statistics 2025-05-21 Sabyasachi Chatterjee , Subhajit Goswami , Soumendu Sundar Mukherjee

The notion of generalization in classical Statistical Learning is often attached to the postulate that data points are independent and identically distributed (IID) random variables. While relevant in many applications, this postulate may…

Machine Learning · Computer Science 2020-09-15 Simon Foucart , Chunyang Liao , Shahin Shahrampour , Yinsong Wang

We present a data-driven algorithm for efficiently computing stochastic control policies for general joint chance constrained optimal control problems. Our approach leverages the theory of kernel distribution embeddings, which allows…

Systems and Control · Electrical Eng. & Systems 2022-02-10 Adam J. Thorpe , Thomas Lew , Meeko M. K. Oishi , Marco Pavone

In this work we approach attractor neural networks from a machine learning perspective: we look for optimal network parameters by applying a gradient descent over a regularized loss function. Within this framework, the optimal…

Machine Learning · Computer Science 2024-02-21 Elena Agliari , Francesco Alemanno , Miriam Aquaro , Alberto Fachechi

We study algorithms for online linear optimization in Hilbert spaces, focusing on the case where the player is unconstrained. We develop a novel characterization of a large class of minimax algorithms, recovering, and even improving,…

Machine Learning · Computer Science 2014-05-22 H. Brendan McMahan , Francesco Orabona

We consider a class of statistical inverse problems involving the estimation of a regression operator from a Polish space to a separable Hilbert space, where the target lies in a vector-valued reproducing kernel Hilbert space induced by an…

Machine Learning · Statistics 2026-04-28 Jia-Qi Yang , Lei Shi

We provide a detailed proof of Proposition 3.1 in the paper titled ``Backstepping control of a class of space-time-varying linear parabolic PDEs via time invariant kernel functions''. In the paper titled ``Backstepping control of a class of…

Analysis of PDEs · Mathematics 2023-01-27 Qiaoling Chen , Jun Zheng , Guchuan Zhu

We study generalization properties of distributed algorithms in the setting of nonparametric regression over a reproducing kernel Hilbert space (RKHS). We first investigate distributed stochastic gradient methods (SGM), with mini-batches…

Machine Learning · Statistics 2018-11-06 Junhong Lin , Volkan Cevher

We consider statistics for stochastic evolution equations in Hilbert space with emphasis on stochastic partial differential equations (SPDEs). We observe a solution process under additional measurement errors and want to estimate a real or…

Statistics Theory · Mathematics 2025-05-21 Gregor Pasemann , Markus Reiß