English
Related papers

Related papers: Piecewise Convex Function Estimation and Model Sel…

200 papers

Isotonic regression provides a flexible, tuning-free approach to estimating monotonic functions without imposing global curvature constraints, yet the estimated regression function is inherently a step function. This paper addresses a key…

Methodology · Statistics 2026-05-19 Timo Kuosmanen , Juan F. Monge , José L. Ruiz , Xun Zhou

We study nonparametric change-point estimation from indirect noisy observations. Focusing on the white noise convolution model, we consider two classes of functions that are smooth apart from the change-point. We establish lower bounds on…

Statistics Theory · Mathematics 2007-06-13 A. Goldenshluger , A. Tsybakov , A. Zeevi

We study the problem of variable selection in convex nonparametric regression. Under the assumption that the true regression function is convex and sparse, we develop a screening procedure to select a subset of variables that contains the…

Statistics Theory · Mathematics 2014-11-19 Min Xu , Minhua Chen , John Lafferty

In this paper, we further develop the approach, originating in [14 (arXiv:1311.6765),20 (arXiv:1604.02576)], to "computation-friendly" hypothesis testing and statistical estimation via Convex Programming. Specifically, we focus on…

Statistics Theory · Mathematics 2018-04-16 Anatoli Juditsky , Arkadi Nemirovski

In this paper we are concerned with fully automatic and locally adaptive estimation of functions in a "signal + noise"-model where the regression function may additionally be blurred by a linear operator, e.g. by a convolution. To this end,…

Applications · Statistics 2015-03-17 Klaus Frick , Philipp Marnitz , Axel Munk

Given data $y$ and $k$ covariates $x$ the problem is to decide which covariates to include when approximating $y$ by a linear function of the covariates. The decision is based on replacing subsets of the covariates by i.i.d. normal random…

Statistics Theory · Mathematics 2016-05-09 Laurie Davies

Convex regression is a method for estimating the convex function from a data set. This method has played an important role in operations research, economics, machine learning, and many other areas. However, it has been empirically observed…

Methodology · Statistics 2024-10-17 Zhiqiang Liao , Sheng Dai , Eunji Lim , Timo Kuosmanen

The problem of finding the minimizer of a sum of convex functions is central to the field of optimization. Thus, it is of interest to understand how that minimizer is related to the properties of the individual functions in the sum. In this…

Optimization and Control · Mathematics 2020-03-23 Kananart Kuwaranancharoen , Shreyas Sundaram

Optimal estimation and inference for both the minimizer and minimum of a convex regression function under the white noise and nonparametric regression models are studied in a nonasymptotic local minimax framework, where the performance of a…

Statistics Theory · Mathematics 2024-03-12 T. Tony Cai , Ran Chen , Yuancheng Zhu

We consider the problem of estimating convex boundaries from blurred and noisy observations. In our model, the convolution of an intensity function $f$ is observed with additive Gaussian white noise. The function $f$ is assumed to have…

Statistics Theory · Mathematics 2007-06-13 Alexander Goldenshluger , Assaf Zeevi

In many real world problems, optimization decisions have to be made with limited information. The decision maker may have no a priori or posteriori data about the often nonconvex objective function except from on a limited number of points…

Optimization and Control · Mathematics 2011-11-10 Tansu Alpcan

In practice functional data are sampled on a discrete set of observation points and often susceptible to noise. We consider in this paper the setting where such data are used as explanatory variables in a regression problem. If the primary…

Methodology · Statistics 2021-12-14 Siegfried Hörmann , Fatima Jammoul

In many applications, such as economics, operations research and reinforcement learning, one often needs to estimate a multivariate regression function f subject to a convexity constraint. For example, in sequential decision processes the…

Methodology · Statistics 2011-09-05 Lauren A. Hannah , David B. Dunson

The minimization of convex functions which are only available through partial and noisy information is a key methodological problem in many disciplines. In this paper we consider convex optimization with noisy zero-th order information,…

Machine Learning · Computer Science 2016-05-27 Francis Bach , Vianney Perchet

A variational model for learning convolutional image atoms from corrupted and/or incomplete data is introduced and analyzed both in function space and numerically. Building on lifting and relaxation strategies, the proposed approach is…

Optimization and Control · Mathematics 2018-12-10 Antonin Chambolle , Martin Holler Thomas Pock

Convexity prior is one of the main cue for human vision and shape completion with important applications in image processing, computer vision. This paper focuses on characterization methods for convex objects and applications in image…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Shousheng Luo , Jinfeng Chen , Yunhai Xiao , Xue-Cheng Tai

We consider the problem of estimating the region on which a non-parametric regression function is at its baseline level in two dimensions. The baseline level typically corresponds to the minimum/maximum of the function and estimating such…

Methodology · Statistics 2013-12-24 Atul Mallik , Moulinath Banerjee , Michael Woodroofe

We present a minimax optimal solution to the problem of estimating a compact, convex set from finitely many noisy measurements of its support function. The solution is based on appropriate regularizations of the least squares estimator.…

Statistics Theory · Mathematics 2012-05-31 Adityanand Guntuboyina

Estimation of linear functionals from observed data is an important task in many subjects. Juditsky & Nemirovski [The Annals of Statistics 37.5A (2009): 2278-2300] propose a framework for non-parametric estimation of linear functionals in a…

Statistics Theory · Mathematics 2021-12-08 Akshay Seshadri , Stephen Becker

We propose a novel method for estimating nonseparable selection models. We show that, for a given selection function, the potential outcome distributions are nonparametrically identified from the selected outcome distributions and can be…

Econometrics · Economics 2026-05-05 Fan Wu , Yi Xin