English
Related papers

Related papers: Real time estimation in local polynomial regressio…

200 papers

This paper investigates locally linear regression for locally stationary time series and develops theoretical results for locally linear smoothing and transfer learning. Existing analyses have focused on local constant estimators and given…

Statistics Theory · Mathematics 2025-11-19 Jinwoo Park

In modeling multivariate time series, it is important to allow time-varying smoothness in the mean and covariance process. In particular, there may be certain time intervals exhibiting rapid changes and others in which changes are slow. If…

Applications · Statistics 2014-06-02 Daniele Durante , Bruno Scarpa , David B. Dunson

This research focuses on the estimation of a non-parametric regression function designed for data with simultaneous time and space dependencies. In such a context, we study the Trend Filtering, a nonparametric estimator introduced by…

Methodology · Statistics 2023-09-14 Carlos Misael Madrid Padilla , Oscar Hernan Madrid Padilla , Daren Wang

A local projection model is defined by a set of linear regressions that account for the associations between exogenous variables and an endogenous variable observed at different time points. While it is standard practice to separately…

Methodology · Statistics 2020-07-14 Masahiro Tanaka

We consider the problem of pointwise estimation of multi-dimensional signals $s$, from noisy observations $(y_\tau)$ on the regular grid $\bZd$. Our focus is on the adaptive estimation in the case when the signal can be well recovered using…

Statistics Theory · Mathematics 2008-09-05 Anatoli Juditsky , Arkadii S. Nemirovski

Sensitivity indices when the inputs of a model are not independent are estimated by local polynomial techniques. Two original estimators based on local polynomial smoothers are proposed. Both have good theoretical properties which are…

Methodology · Statistics 2008-12-18 Sébastien Da Veiga , François Wahl , Fabrice Gamboa

Real-time analysis of graphs containing temporal information, such as social media streams, Q&A networks, and cyber data sources, plays an important role in various applications. Among them, detecting patterns is one of the fundamental…

Databases · Computer Science 2023-12-19 Seunghwan Min , Jihoon Jang , Kunsoo Park , Dora Giammarresi , Giuseppe F. Italiano , Wook-Shin Han

We consider the problem of discrete-time signal denoising, focusing on a specific family of non-linear convolution-type estimators. Each such estimator is associated with a time-invariant filter which is obtained adaptively, by solving a…

Statistics Theory · Mathematics 2018-06-13 Dmitrii Ostrovskii , Zaid Harchaoui

Random forests are a powerful method for non-parametric regression, but are limited in their ability to fit smooth signals, and can show poor predictive performance in the presence of strong, smooth effects. Taking the perspective of random…

Machine Learning · Statistics 2020-09-08 Rina Friedberg , Julie Tibshirani , Susan Athey , Stefan Wager

Modern applications of machine learning (ML) deal with increasingly heterogeneous datasets comprised of data collected from overlapping latent subpopulations. As a result, traditional models trained over large datasets may fail to recognize…

Machine Learning · Statistics 2019-10-16 Benjamin Lengerich , Bryon Aragam , Eric P. Xing

Modeling nonstationary processes is of paramount importance to many scientific disciplines including environmental science, ecology, and finance, among others. Consequently, flexible methodology that provides accurate estimation across a…

Methodology · Statistics 2014-08-13 Wen-Hsi Yang , Scott H. Holan , Christopher K. Wikle

Time-series classification is an important domain of machine learning and a plethora of methods have been developed for the task. In comparison to existing approaches, this study presents a novel method which decomposes a time-series…

Machine Learning · Computer Science 2015-03-12 Josif Grabocka , Lars Schmidt-Thieme

For time series data observed at non-random and possibly non-equidistant time points, we estimate the trend function nonparametrically. Under the assumption of a bounded total variation of the function and low-order moment conditions on the…

Statistics Theory · Mathematics 2025-02-13 Michael H. Neumann , Anne Leucht

Filtering and parameter estimation under partial information for multiscale problems is studied in this paper. After proving mean square convergence of the nonlinear filter to a filter of reduced dimension, we establish that the conditional…

Probability · Mathematics 2014-09-09 Andrew Papanicolaou , Konstantinos Spiliopoulos

We present an efficient and practical algorithm for the online prediction of discrete-time linear dynamical systems with a symmetric transition matrix. We circumvent the non-convex optimization problem using improper learning: carefully…

Machine Learning · Computer Science 2017-11-08 Elad Hazan , Karan Singh , Cyril Zhang

Many applications involve estimation of a signal matrix from a noisy data matrix. In such cases, it has been observed that estimators that shrink or truncate the singular values of the data matrix perform well when the signal matrix has…

Methodology · Statistics 2018-06-20 David Gerard , Peter Hoff

In many practical applications, signals and environments are time- varying, which makes fixed filters unreliable. Adaptive filtering, on the other hand, updates in real time to suppress noise, track nonstationary signals, and identify…

General Mathematics · Mathematics 2026-03-12 Keshav Raj Acharya , Pitambar Acharya

We present algorithms for nonparametric regression in settings where the data are obtained sequentially. While traditional estimators select bandwidths that depend upon the sample size, for sequential data the effective sample size is…

Methodology · Statistics 2012-07-03 Haijie Gu , John Lafferty

The paper offers a unified approach to the study of three locally adaptive estimation methods in the context of univariate time series from both theoretical and empirical points of view. A general procedure for the computation of critical…

Statistics Theory · Mathematics 2008-12-03 Mstislav Elagin

In this paper, we study nonparametric models allowing for locally stationary regressors and a regression function that changes smoothly over time. These models are a natural extension of time series models with time-varying coefficients. We…

Statistics Theory · Mathematics 2013-02-19 Michael Vogt