English
Related papers

Related papers: Additive Models with Trend Filtering

200 papers

We study trend filtering, a recently proposed tool of Kim et al. [SIAM Rev. 51 (2009) 339-360] for nonparametric regression. The trend filtering estimate is defined as the minimizer of a penalized least squares criterion, in which the…

Statistics Theory · Mathematics 2014-03-24 Ryan J. Tibshirani

This paper investigates risk bounds for quantile additive trend filtering, a method gaining increasing significance in the realms of additive trend filtering and quantile regression. We investigate the constrained version of quantile trend…

Statistics Theory · Mathematics 2025-05-19 Zhi Zhang , Kyle Ritscher , Oscar Hernan Madrid Padilla

This paper presents a fast and robust algorithm for trend filtering, a recently developed nonparametric regression tool. It has been shown that, for estimating functions whose derivatives are of bounded variation, trend filtering achieves…

Machine Learning · Statistics 2015-09-01 Aaditya Ramdas , Ryan J. Tibshirani

We introduce a family of adaptive estimators on graphs, based on penalizing the $\ell_1$ norm of discrete graph differences. This generalizes the idea of trend filtering [Kim et al. (2009), Tibshirani (2014)], used for univariate…

Machine Learning · Statistics 2016-06-07 Yu-Xiang Wang , James Sharpnack , Alex Smola , Ryan J. Tibshirani

We study a multivariate version of trend filtering, called Kronecker trend filtering or KTF, for the case in which the design points form a lattice in $d$ dimensions. KTF is a natural extension of univariate trend filtering (Steidl et al.,…

Machine Learning · Statistics 2024-04-09 Veeranjaneyulu Sadhanala , Yu-Xiang Wang , Addison J. Hu , Ryan J. Tibshirani

This paper reviews a class of univariate piecewise polynomial functions known as discrete splines, which share properties analogous to the better-known class of spline functions, but where continuity in derivatives is replaced by (a…

Statistics Theory · Mathematics 2022-05-26 Ryan J. Tibshirani

In multivariate nonparametric regression the additive models are very useful when a suitable parametric model is difficult to find. The backfitting algorithm is a powerful tool to estimate the additive components. However, due to complexity…

Methodology · Statistics 2019-06-18 Abhijit Mandal

We study quantile trend filtering, a recently proposed method for nonparametric quantile regression with the goal of generalizing existing risk bounds known for the usual trend filtering estimators which perform mean regression. We study…

Statistics Theory · Mathematics 2021-08-31 Oscar Hernan Madrid Padilla , Sabyasachi Chatterjee

We study trend filtering, a relatively recent method for univariate nonparametric regression. For a given positive integer $r$, the $r$-th order trend filtering estimator is defined as the minimizer of the sum of squared errors when we…

Statistics Theory · Mathematics 2018-06-26 Adityanand Guntuboyina , Donovan Lieu , Sabyasachi Chatterjee , Bodhisattva Sen

We consider the framework of non-stationary stochastic optimization [Besbes et al, 2015] with squared error losses and noisy gradient feedback where the dynamic regret of an online learner against a time varying comparator sequence is…

Machine Learning · Computer Science 2020-10-02 Dheeraj Baby , Yu-Xiang Wang

We develop a generalization of unobserved components models that allows for a wide range of long-run dynamics by modelling the permanent component as a fractionally integrated process. The model does not require stationarity and can be cast…

Econometrics · Economics 2020-05-22 Tobias Hartl , Rolf Tschernig , Enzo Weber

This research focuses on the estimation of a non-parametric regression function designed for data with simultaneous time and space dependencies. In such a context, we study the Trend Filtering, a nonparametric estimator introduced by…

Methodology · Statistics 2023-09-14 Carlos Misael Madrid Padilla , Oscar Hernan Madrid Padilla , Daren Wang

We consider the problem of designing piecewise affine policies for two-stage adjustable robust linear optimization problems under right-hand side uncertainty. It is well known that a piecewise affine policy is optimal although the number of…

Optimization and Control · Mathematics 2018-01-23 Aharon Ben-Tal , Omar El Housni , Vineet Goyal

We investigate the performance of a class of particle filters (PFs) that can automatically tune their computational complexity by evaluating online certain predictive statistics which are invariant for a broad class of state-space models.…

Computation · Statistics 2021-04-26 Víctor Elvira , Joaquín Míguez , Petar M. Djurić

Piecewise regression is a versatile approach used in various disciplines to approximate complex functions from limited, potentially noisy data points. In control, piecewise regression is, e.g., used to approximate the optimal control law of…

Optimization and Control · Mathematics 2024-07-10 Dieter Teichrib , Moritz Schulze Darup

A novel functional additive model is proposed which is uniquely modified and constrained to model nonlinear interactions between a treatment indicator and a potentially large number of functional and/or scalar pretreatment covariates. The…

Methodology · Statistics 2021-01-26 Hyung Park , Eva Petkova , Thaddeus Tarpey , R. Todd Ogden

Despite increasing accessibility to function data, effective methods for flexibly estimating underlying functional trend are still scarce. We thereby develop functional version of trend filtering for estimating trend of functional data…

Methodology · Statistics 2022-02-22 Tomoya Wakayama , Shonosuke Sugasawa

We survey the main results of approximation theory for adaptive piecewise polynomial functions. In such methods, the partition on which the piecewise polynomial approximation is defined is not fixed in advance, but adapted to the given…

Numerical Analysis · Mathematics 2015-03-17 Albert Cohen , Jean-Marie Mirebeau

Adaptive filters are at the core of many signal processing applications, ranging from acoustic noise supression to echo cancelation, array beamforming, channel equalization, to more recent sensor network applications in surveillance, target…

Systems and Control · Electrical Eng. & Systems 2021-12-24 Jerónimo Arenas-García , Luis A. Azpicueta-Ruiz , Magno T. M. Silva , Vitor H. Nascimento , Ali H. Sayed

Learning approaches have recently become very popular in the field of inverse problems. A large variety of methods has been established in recent years, ranging from bi-level learning to high-dimensional machine learning techniques. Most…

Optimization and Control · Mathematics 2017-04-05 Martin Benning , Guy Gilboa , Joana Sarah Grah , Carola-Bibiane Schönlieb
‹ Prev 1 2 3 10 Next ›