English
Related papers

Related papers: A Note on Local Linear Regression for Time Series …

200 papers

A general class of time-varying regression models is considered in this paper. We estimate the regression coefficients by using local linear M-estimation. For these estimators, weak Bahadur representations are obtained and are used to…

Statistics Theory · Mathematics 2021-03-09 Sayar Karmakar , Stefan Richter , Wei Biao Wu

This paper develops a general asymptotic theory of series estimators for spatial data collected at irregularly spaced locations within a sampling region $R_n \subset \mathbb{R}^d$. We employ a stochastic sampling design that can flexibly…

Statistics Theory · Mathematics 2025-03-03 Daisuke Kurisu , Yasumasa Matsuda

This paper addresses the problem of detecting and characterizing local variability in time series and other forms of sequential data. The goal is to identify and characterize statistically significant variations, at the same time…

Instrumentation and Methods for Astrophysics · Physics 2015-06-05 Jeffrey D. Scargle , Jay P. Norris , Brad Jackson , James Chiang

It has been some time since interval-valued linear regression was investigated. In this paper, we focus on linear regression for interval-valued data within the framework of random sets. The model we propose generalizes a series of existing…

Methodology · Statistics 2015-06-12 Yan Sun , Chunyang Li

With regard to a three-step estimation procedure, proposed without theoretical discussion by Li and You in Journal of Applied Statistics and Management, for a nonparametric regression model with time-varying regression function, local…

Statistics Theory · Mathematics 2020-10-27 Jiyanglin Li , Tao Li

Stochastic gradient descent (SGD) and its variants are widely used and highly effective optimization methods in machine learning, especially for neural network training. By using a single datum or a small subset of the data, selected…

Numerical Analysis · Mathematics 2026-01-21 Bangti Jin , Zeljko Kereta , Yuxin Xia

We consider the model of nonregular nonparametric regression where smoothness constraints are imposed on the regression function $f$ and the regression errors are assumed to decay with some sharpness level at their endpoints. The aim of…

Statistics Theory · Mathematics 2014-10-02 Moritz Jirak , Alexander Meister , Markus Reiß

Quantile regression has demonstrated promising utility in longitudinal data analysis. Existing work is primarily focused on modeling cross-sectional outcomes, while outcome trajectories often carry more substantive information in practice.…

Methodology · Statistics 2018-06-19 Huijuan Ma , Limin Peng , Haoda Fu

We present a framework for performing efficient regression in general metric spaces. Roughly speaking, our regressor predicts the value at a new point by computing a Lipschitz extension --- the smoothest function consistent with the…

Machine Learning · Computer Science 2017-04-25 Lee-Ad Gottlieb , Aryeh Kontorovich , Robert Krauthgamer

In this paper, we aim to improve multivariate anomaly detection (AD) by modeling the \textit{time-varying non-linear spatio-temporal correlations} found in multivariate time series data . In multivariate time series data, an anomaly may be…

Machine Learning · Computer Science 2025-09-19 Padmaksha Roy , Almuatazbellah Boker , Lamine Mili

We propose a pointwise inference algorithm for high-dimensional linear models with time-varying coefficients. The method is based on a novel combination of the nonparametric kernel smoothing technique and a Lasso bias-corrected ridge…

Methodology · Statistics 2017-03-17 Xiaohui Chen , Yifeng He

We review various characterizations of uniform convexity and smoothness on norm balls in finite-dimensional spaces and connect results stemming from the geometry of Banach spaces with \textit{scaling inequalities} used in analysing the…

Optimization and Control · Mathematics 2021-02-19 Thomas Kerdreux , Alexandre d'Aspremont , Sebastian Pokutta

We consider estimating the shared mean of a sequence of heavy-tailed random variables taking values in a Banach space. In particular, we revisit and extend a simple truncation-based mean estimator first proposed by Catoni and Giulini. While…

Statistics Theory · Mathematics 2025-03-25 Justin Whitehouse , Ben Chugg , Diego Martinez-Taboada , Aaditya Ramdas

The paper offers a unified approach to the study of three locally adaptive estimation methods in the context of univariate time series from both theoretical and empirical points of view. A general procedure for the computation of critical…

Statistics Theory · Mathematics 2008-12-03 Mstislav Elagin

Alternative iterative methods for a nonexpansive mapping in a Banach space are proposed and proved to be convergent to a common solution to a fixed point problem and a variational inequality. We give rates of asymptotic regularity for such…

Functional Analysis · Mathematics 2009-06-01 Vittorio Colao , Laurentiu Leustean , Genaro Lopez , Victoria Martin-Marquez

Many spatial processes exhibit nonstationary features. We estimate a variance function from a single process observation where the errors are nonstationary and correlated. We propose a difference-based approach for a one-dimensional…

Methodology · Statistics 2016-05-24 Eunice J. Kim , Zhengyuan Zhu

Most estimates for penalised linear regression can be viewed as posterior modes for an appropriate choice of prior distribution. Bayesian shrinkage methods, particularly the horseshoe estimator, have recently attracted a great deal of…

Methodology · Statistics 2017-11-06 Zemei Xu , Daniel F. Schmidt , Enes Makalic , Guoqi Qian , John L. Hopper

Covariance matrix estimation, a classical statistical topic, poses significant challenges when the sample size is comparable to or smaller than the number of features. In this paper, we frame covariance matrix estimation as a compound…

Methodology · Statistics 2025-03-04 Huqin Xin , Sihai Dave Zhao

Though introduced nearly 50 years ago, the infinitesimal jackknife (IJ) remains a popular modern tool for quantifying predictive uncertainty in complex estimation settings. In particular, when supervised learning ensembles are constructed…

Statistics Theory · Mathematics 2021-06-11 Wei Peng , Lucas Mentch , Leonard Stefanski

In recent years, specific evaluation metrics for time series anomaly detection algorithms have been developed to handle the limitations of the classical precision and recall. However, such metrics are heuristically built as an aggregate of…

Machine Learning · Computer Science 2022-10-13 Alexis Huet , Jose Manuel Navarro , Dario Rossi