English
Related papers

Related papers: Adaptive piecewise polynomial estimation via trend…

200 papers

We study additive models built with trend filtering, i.e., additive models whose components are each regularized by the (discrete) total variation of their $k$th (discrete) derivative, for a chosen integer $k \geq 0$. This results in $k$th…

Machine Learning · Statistics 2018-11-26 Veeranjaneyulu Sadhanala , Ryan J. Tibshirani

This paper presents a fast and robust algorithm for trend filtering, a recently developed nonparametric regression tool. It has been shown that, for estimating functions whose derivatives are of bounded variation, trend filtering achieves…

Machine Learning · Statistics 2015-09-01 Aaditya Ramdas , Ryan J. Tibshirani

We introduce a family of adaptive estimators on graphs, based on penalizing the $\ell_1$ norm of discrete graph differences. This generalizes the idea of trend filtering [Kim et al. (2009), Tibshirani (2014)], used for univariate…

Machine Learning · Statistics 2016-06-07 Yu-Xiang Wang , James Sharpnack , Alex Smola , Ryan J. Tibshirani

We study trend filtering, a relatively recent method for univariate nonparametric regression. For a given positive integer $r$, the $r$-th order trend filtering estimator is defined as the minimizer of the sum of squared errors when we…

Statistics Theory · Mathematics 2018-06-26 Adityanand Guntuboyina , Donovan Lieu , Sabyasachi Chatterjee , Bodhisattva Sen

This research focuses on the estimation of a non-parametric regression function designed for data with simultaneous time and space dependencies. In such a context, we study the Trend Filtering, a nonparametric estimator introduced by…

Methodology · Statistics 2023-09-14 Carlos Misael Madrid Padilla , Oscar Hernan Madrid Padilla , Daren Wang

We study quantile trend filtering, a recently proposed method for nonparametric quantile regression with the goal of generalizing existing risk bounds known for the usual trend filtering estimators which perform mean regression. We study…

Statistics Theory · Mathematics 2021-08-31 Oscar Hernan Madrid Padilla , Sabyasachi Chatterjee

Despite increasing accessibility to function data, effective methods for flexibly estimating underlying functional trend are still scarce. We thereby develop functional version of trend filtering for estimating trend of functional data…

Methodology · Statistics 2022-02-22 Tomoya Wakayama , Shonosuke Sugasawa

This paper considers the development of spatially adaptive smoothing splines for the estimation of a regression function with non-homogeneous smoothness across the domain. Two challenging issues that arise in this context are the evaluation…

Statistics Theory · Mathematics 2013-06-11 Xiao Wang , Pang Du , Jinglai Shen

This paper gives a comprehensive treatment of the convergence rates of penalized spline estimators for simultaneously estimating several leading principal component functions, when the functional data is sparsely observed. The penalized…

Statistics Theory · Mathematics 2024-02-09 Shiyuan He , Jianhua Z. Huang , Kejun He

We study a multivariate version of trend filtering, called Kronecker trend filtering or KTF, for the case in which the design points form a lattice in $d$ dimensions. KTF is a natural extension of univariate trend filtering (Steidl et al.,…

Machine Learning · Statistics 2024-04-09 Veeranjaneyulu Sadhanala , Yu-Xiang Wang , Addison J. Hu , Ryan J. Tibshirani

We consider the framework of non-stationary stochastic optimization [Besbes et al, 2015] with squared error losses and noisy gradient feedback where the dynamic regret of an online learner against a time varying comparator sequence is…

Machine Learning · Computer Science 2020-10-02 Dheeraj Baby , Yu-Xiang Wang

We propose a method for adaptive nonlinear sequential modeling of vector-time series data. Data is modeled as a nonlinear function of past values corrupted by noise, and the underlying non-linear function is assumed to be approximately…

Methodology · Statistics 2017-10-11 Qiuyi Han , Jie Ding , Edoardo Airoldi , Vahid Tarokh

We establish adaptive results for trend filtering: least squares estimation with a penalty on the total variation of $(k-1)^{\rm th}$ order differences. Our approach is based on combining a general oracle inequality for the…

Statistics Theory · Mathematics 2020-07-20 Francesco Ortelli , Sara van de Geer

Location estimation is a central problem in functional data analysis. In this paper, we investigate penalized spline estimators of location for discretely sampled functional data under a broad class of convex loss functions. Our framework…

Methodology · Statistics 2025-08-19 Ioannis Kalogridis

This paper investigates risk bounds for quantile additive trend filtering, a method gaining increasing significance in the realms of additive trend filtering and quantile regression. We investigate the constrained version of quantile trend…

Statistics Theory · Mathematics 2025-05-19 Zhi Zhang , Kyle Ritscher , Oscar Hernan Madrid Padilla

Penalized spline smoothing is a popular and flexible method of obtaining estimates in nonparametric regression but the classical least-squares criterion is highly susceptible to model deviations and atypical observations. Penalized spline…

Methodology · Statistics 2021-01-12 Ioannis Kalogridis , Stefan Van Aelst

For time series data observed at non-random and possibly non-equidistant time points, we estimate the trend function nonparametrically. Under the assumption of a bounded total variation of the function and low-order moment conditions on the…

Statistics Theory · Mathematics 2025-02-13 Michael H. Neumann , Anne Leucht

We propose an $L_{2}$-based penalization algorithm for functional linear regression models, where the coefficient function is shrunk towards a data-driven shape template $\gamma$, which is constrained to belong to a class of piecewise…

Methodology · Statistics 2020-11-03 Edoardo Belli , Simone Vantini

This paper reviews a class of univariate piecewise polynomial functions known as discrete splines, which share properties analogous to the better-known class of spline functions, but where continuity in derivatives is replaced by (a…

Statistics Theory · Mathematics 2022-05-26 Ryan J. Tibshirani

We consider the estimation of the value of a linear functional of the slope parameter in functional linear regression, where scalar responses are modeled in dependence of random functions. In Johannes and Schenk [2010] it has been shown…

Statistics Theory · Mathematics 2011-12-14 Jan Johannes , Rudolf Schenk
‹ Prev 1 2 3 10 Next ›