English
Related papers

Related papers: Estimating Piecewise Monotone Signals

200 papers

This article introduces a new nonparametric method for estimating a univariate regression function of bounded variation. The method exploits the Jordan decomposition which states that a function of bounded variation can be decomposed as the…

Statistics Theory · Mathematics 2016-08-11 Arnaud Guyader , Nick Hengartner , Nicolas Jégou , Eric Matzner-Løber

To recover a low rank structure from a noisy matrix, truncated singular value decomposition has been extensively used and studied. Recent studies suggested that the signal can be better estimated by shrinking the singular values. We pursue…

Methodology · Statistics 2014-11-25 Julie Josse , Sylvain Sardy

Binomial random intersection graphs can be used as parsimonious statistical models of large and sparse networks, with one parameter for the average degree and another for transitivity, the tendency of neighbours of a node to be connected.…

Social and Information Networks · Computer Science 2018-06-26 Joona Karjalainen , Lasse Leskelä

We develop a Glivenko--Cantelli theory for monotone, almost additive functions of i.\,i.\,d.\ sequences of random variables indexed by~$\Z^d$. Under certain conditions on the random sequence, short range correlations are allowed as well. We…

Probability · Mathematics 2018-09-28 Christoph Schumacher , Fabian Schwarzenberger , Ivan Veselic

In this article we consider the nonparametric robust estimation problem for regression models in continuous time with semi-Markov noises observed in discrete time moments. An adaptive model selection procedure is proposed. A sharp…

Statistics Theory · Mathematics 2020-05-15 Vlad Stefan Barbu , Slim Beltaief , Serguei Pergamenshchikov

This article describes a multivariate polynomial regression method where the uncertainty of the input parameters are approximated with Gaussian distributions, derived from the central limit theorem for large weighted sums, directly from the…

Machine Learning · Statistics 2013-10-04 Peter Kovesarki , Ian C. Brock

We discuss the approach to estimate aggregation and adaptive estimation based upon (nearly optimal) testing of convex hypotheses. We show that in the situation where the observations stem from {\em simple observation schemes} and where set…

Statistics Theory · Mathematics 2021-07-19 Anatoli Juditsky , Arkadi Nemirovski

In this article, we develop methods for estimating a low rank tensor from noisy observations on a subset of its entries to achieve both statistical and computational efficiencies. There have been a lot of recent interests in this problem of…

Machine Learning · Statistics 2018-03-21 Dong Xia , Ming Yuan , Cun-Hui Zhang

This paper addresses the problem of localizing change points in high-dimensional linear regression models with piecewise constant regression coefficients. We develop a dynamic programming approach to estimate the locations of the change…

Methodology · Statistics 2020-10-21 Alessandro Rinaldo , Daren Wang , Qin Wen , Rebecca Willett , Yi Yu

We consider the problem of inference on a regression function at a point when the entire function satisfies a sign or shape restriction under the null. We propose a test that achieves the optimal minimax rate adaptively over a range of…

Statistics Theory · Mathematics 2015-10-15 Timothy Armstrong

We design a new, fast algorithm for agnostically learning univariate probability distributions whose densities are well approximated by piecewise polynomial functions. Let $f$ be the density function of an arbitrary univariate distribution,…

Data Structures and Algorithms · Computer Science 2015-06-03 Jayadev Acharya , Ilias Diakonikolas , Jerry Li , Ludwig Schmidt

Let $(X_i)_{i=1,...,n}$ be a possibly nonstationary sequence such that $\mathscr{L}(X_i)=P_n$ if $i\leq n\theta$ and $\mathscr{L}(X_i)=Q_n$ if $i>n\theta$, where $0<\theta <1$ is the location of the change-point to be estimated. We…

Statistics Theory · Mathematics 2009-09-29 Samir Ben Hariz , Jonathan J. Wylie , Qiang Zhang

We explore why many recently proposed robust estimation problems are efficiently solvable, even though the underlying optimization problems are non-convex. We study the loss landscape of these robust estimation problems, and identify the…

Machine Learning · Statistics 2020-05-29 Banghua Zhu , Jiantao Jiao , Jacob Steinhardt

We discuss a number of estimates of the hazard under the assumption that the hazard is monotone on an interval [0,a]. The usual isotonic least squares estimators of the hazard are inconsistent at the boundary points 0 and a. We use…

Statistics Theory · Mathematics 2011-02-22 Piet Groeneboom , Geurt Jongbloed

We survey the main results of approximation theory for adaptive piecewise polynomial functions. In such methods, the partition on which the piecewise polynomial approximation is defined is not fixed in advance, but adapted to the given…

Numerical Analysis · Mathematics 2015-03-17 Albert Cohen , Jean-Marie Mirebeau

We develop a new methodology for the fitting of nonstationary time series that exhibit nonlinearity, asymmetry, local persistence and changes in location scale and shape of the underlying distribution. In order to achieve this goal, we…

Statistics Theory · Mathematics 2016-09-29 Alexander Aue , Rex C. Y. Cheung , Thomas C. M. Lee , Ming Zhong

We consider a misspecified optimization problem that requires minimizing a function f(x;q*) over a closed and convex set X where q* is an unknown vector of parameters that may be learnt by a parallel learning process. In this context, We…

Optimization and Control · Mathematics 2015-04-17 Hesam Ahmadi , Uday V. Shanbhag

We consider the estimation of quadratic functionals in a Gaussian sequence model where the eigenvalues are supposed to be unknown and accessible through noisy observations only. Imposing smoothness assumptions both on the signal and the…

Statistics Theory · Mathematics 2019-07-16 Martin Kroll

We consider the framework of non-stationary stochastic optimization [Besbes et al, 2015] with squared error losses and noisy gradient feedback where the dynamic regret of an online learner against a time varying comparator sequence is…

Machine Learning · Computer Science 2020-10-02 Dheeraj Baby , Yu-Xiang Wang

In partially linear single-index models, we obtain the semiparametrically efficient profile least-squares estimators of regression coefficients. We also employ the smoothly clipped absolute deviation penalty (SCAD) approach to…

Statistics Theory · Mathematics 2012-11-16 Hua Liang , Xiang Liu , Runze Li , Chih-Ling Tsai