English
Related papers

Related papers: Parameter tuning in pointwise adaptation using a p…

200 papers

We consider the problem of asymptotic reconstruction of the state and parameter values in systems of ordinary differential equations. A solution to this problem is proposed for a class of systems of which the unknowns are allowed to be…

Optimization and Control · Mathematics 2015-03-13 Ivan Y. Tyukin , Erik Steur , Henk Nijmeijer , Cees van Leeuwen

We tackle the problem of building adaptive estimation procedures for ill-posed inverse problems. For general regularization methods depending on tuning parameters, we construct a penalized method that selects the optimal smoothing sequence…

Statistics Theory · Mathematics 2008-07-31 Jean-Michel Loubes , Carenne Ludeña

We address the problem of {\it adaptivity} in the framework of reproducing kernel Hilbert space (RKHS) regression. More precisely, we analyze estimators arising from a linear regularization scheme $g_\lam$. In practical applications, an…

Machine Learning · Statistics 2018-04-17 Nicole Mücke

This is the second part of the research project initiated in Cleanthous et al (2024). We deal with the problem of the adaptive estimation of the $\mathbb{L}_2$-norm of a probability density on $\mathbb{R}^d$, $d\geq 1$, from independent…

Statistics Theory · Mathematics 2024-05-28 Galatia Cleanthous , Athanasios G. Georgiadis , Oleg V. Lepski

This paper presents a new method for spatially adaptive local (constant) likelihood estimation which applies to a broad class of nonparametric models, including the Gaussian, Poisson and binary response models. The main idea of the method…

Statistics Theory · Mathematics 2007-12-18 Denis Belomestny , Vladimir Spokoiny

Ordinary Differential Equations are widespread tools to model chemical, physical, biological process but they usually rely on parameters which are of critical importance in terms of dynamic and need to be estimated directly from the data.…

Methodology · Statistics 2014-10-29 Nicolas Brunel , Quentin Clairon

We present a parameter estimation method in Ordinary Differential Equation (ODE) models. Due to complex relationships between parameters and states the use of standard techniques such as nonlinear least squares can lead to the presence of…

Methodology · Statistics 2018-10-11 Quentin Clairon

We study the adaptive minimax estimation of non-linear integral functionals of a density and extend the results obtained for linear and quadratic functionals to general functionals. The typical rate optimal non-adaptive minimax estimators…

Statistics Theory · Mathematics 2016-01-12 Rajarshi Mukherjee , Eric Tchetgen Tchetgen , James Robins

The article presents new results on the Propagation-Separation Approach by Polzehl and Spokoiny [2006]. This iterative procedure provides a unified approach for nonparametric estimation, sup- posing a local parametric model. The adaptivity…

Methodology · Statistics 2013-12-03 Saskia Becker

We consider a class of systems with time-varying parameters, which are written as linear regressions with bounded disturbances. The task is to estimate such parameters under the condition that the regressor is finitely exciting (FE).…

Systems and Control · Electrical Eng. & Systems 2021-11-24 Anton Glushchenko , Konstantin Lastochkin

We consider non parametric estimation problem for stochastic tomography regression model, i.e. we consider the estimation problem of function of multivariate variables (image) observed through its Radon transformation calculated with the…

Statistics Theory · Mathematics 2018-11-22 Dominique Fourdrinier , Sergey Pergamenshchikov

Importance sampling is a widely used technique to estimate properties of a distribution. This paper investigates trading-off some bias for variance by adaptively winsorizing the importance sampling estimator. The novel winsorizing…

Computation · Statistics 2021-02-10 Paulo Orenstein

Sampling is a fundamental problem in computer science and statistics. However, for a given task and stream, it is often not possible to choose good sampling probabilities in advance. We derive a general framework for adaptively changing the…

Machine Learning · Statistics 2022-06-16 Daniel Ting

For many nonlinear Bayesian state estimation problems, the posterior recursion is not analytically tractable, leading to algorithms that are influenced by numerical approximation errors. These algorithms depend on parameters that affect the…

Systems and Control · Electrical Eng. & Systems 2026-05-14 Ondrej Straka , Felipe Giraldo-Grueso , Renato Zanetti

This paper presents a new parameter estimation algorithm for the adaptive control of a class of time-varying plants. The main feature of this algorithm is a matrix of time-varying learning rates, which enables parameter estimation error…

Optimization and Control · Mathematics 2021-11-18 Joseph E. Gaudio , Anuradha M. Annaswamy , Eugene Lavretsky , Michael A. Bolender

Inverse optimization has been increasingly used to estimate unknown parameters in an optimization model based on decision data. We show that such a point estimation is insufficient in a prescriptive setting where the estimated parameters…

Optimization and Control · Mathematics 2025-02-11 Bo Lin , Erick Delage , Timothy C. Y. Chan

The paper deals with asymptotic properties of the adaptive procedure proposed in the author paper, 2007, for estimating an unknown nonparametric regression. %\cite{GaPe1}. We prove that this procedure is asymptotically efficient for a…

Statistics Theory · Mathematics 2010-02-09 Leonid Galtchouk , Serguei Pergamenchtchikov

This paper addresses the problem of estimating a convex regression function under both the sup-norm risk and the pointwise risk using B-splines. The presence of the convex constraint complicates various issues in asymptotic analysis,…

Statistics Theory · Mathematics 2012-05-02 Xiao Wang , Jinglai Shen

Several classical adaptive optimization algorithms, such as line search and trust region methods, have been recently extended to stochastic settings where function values, gradients, and Hessians in some cases, are estimated via stochastic…

Optimization and Control · Mathematics 2023-10-02 Billy Jin , Katya Scheinberg , Miaolan Xie

We consider the problem of nonparametric regression under shape constraints. The main examples include isotonic regression (with respect to any partial order), unimodal/convex regression, additive shape-restricted regression, and…

Statistics Theory · Mathematics 2018-07-03 Adityanand Guntuboyina , Bodhisattva Sen