English
Related papers

Related papers: Monotone Least Squares and Isotonic Quantiles

200 papers

This paper provides a unified framework for analyzing tensor estimation problems that allow for nonlinear observations, heteroskedastic noise, and covariate information. We study a general class of high-dimensional models where each…

Information Theory · Computer Science 2025-06-10 Riccardo Rossetti , Galen Reeves

We consider the convolution model where i.i.d. random variables $X_i$ having unknown density $f$ are observed with additive i.i.d. noise, independent of the $X$'s. We assume that the density $f$ belongs to either a Sobolev class or a class…

Statistics Theory · Mathematics 2009-09-29 Cristina Butucea

In this paper we study covariance estimation with missing data. We consider missing data mechanisms that can be independent of the data, or have a time varying dependency. Additionally, observed variables may have arbitrary (non uniform)…

Statistics Theory · Mathematics 2021-06-17 Eduardo Pavez , Antonio Ortega

This article considers algorithmic and statistical aspects of linear regression when the correspondence between the covariates and the responses is unknown. First, a fully polynomial-time approximation scheme is given for the natural least…

Machine Learning · Computer Science 2017-11-09 Daniel Hsu , Kevin Shi , Xiaorui Sun

We consider the problem of testing a particular type of composite null hypothesis under a nonparametric multivariate regression model. For a given quadratic functional $Q$, the null hypothesis states that the regression function $f$…

Statistics Theory · Mathematics 2013-01-09 Laëtitia Comminges , Arnak Dalalyan

Let a function $F: [0,1]^2\rightarrow [0,1]$ be given by $F(x,y)= f^{(-1)}(T(f(x), f(y)))$ where $f :[0,1]\rightarrow [0,1]$ is a monotone function, $f^{(-1)}$ is the pseudo-inverse of $f$ and $T$ is a triangular norm. This article…

General Mathematics · Mathematics 2026-01-19 Meng Chen , Xue-ping Wang

Functional linear regression is an important topic in functional data analysis. It is commonly assumed that samples of the functional predictor are independent realizations of an underlying stochastic process, and are observed over a grid…

Methodology · Statistics 2020-09-15 Cheng Chen , Shaojun Guo , Xinghao Qiao

This paper studies the asymptotic distribution of a constrained lasso-type estimator for denoising signals defined on the nodes of a graph, where the underlying structure encodes relationships between variables. We show that, under suitable…

Statistics Theory · Mathematics 2026-04-24 Vladimir Pastukhov

In general, the solution to a regression problem is the minimizer of a given loss criterion, and depends on the specified loss function. The nonparametric isotonic regression problem is special, in that optimal solutions can be found by…

Statistics Theory · Mathematics 2020-05-06 Alexander I. Jordan , Anja Mühlemann , Johanna F. Ziegel

We consider a nonparametric Bayesian approach to estimation and testing for a multivariate monotone density. Instead of following the conventional Bayesian route of putting a prior distribution complying with the monotonicity restriction,…

Statistics Theory · Mathematics 2023-06-09 Kang Wang , Subhashis Ghosal

In this paper, we study statistical inference in functional quantile regression for scalar response and a functional covariate. Specifically, we consider a functional linear quantile regression model where the effect of the covariate on the…

Methodology · Statistics 2022-08-23 Meng Li , Kehui Wang , Arnab Maity , Ana-Maria Staicu

We propose two estimators of a monotone spectral density, that are based on the periodogram. These are the isotonic regression of the periodogram and the isotonic regression of the log-periodogram. We derive pointwise limit distribution…

Statistics Theory · Mathematics 2011-03-10 Dragi Anevski , Philippe Soulier

We propose a general methodology for the construction and analysis of minimax estimators for a wide class of functionals of finite dimensional parameters, and elaborate on the case of discrete distributions, where the alphabet size $S$ is…

Information Theory · Computer Science 2015-03-11 Jiantao Jiao , Kartik Venkat , Yanjun Han , Tsachy Weissman

In this paper we derive the asymptotic properties of the least squares estimator (LSE) of fractionally integrated autoregressive moving-average (FARIMA) models under the assumption that the errors are uncorrelated but not necessarily…

Applications · Statistics 2021-03-19 Yacouba Boubacar Maïnassara , Youssef Esstafa , Bruno Saussereau

The problem of prediction in functional linear regression is conventionally addressed by reducing dimension via the standard principal component basis. In this paper we show that an alternative basis chosen through weighted least-squares,…

Methodology · Statistics 2009-02-20 Aurore Delaigle , Peter Hall , Tatiyana V. Apanasovich

Isotonic regression is a shape-constrained nonparametric regression in which the regression is an increasing step function. For $n$ data points, the number of steps in the isotonic regression may be as large as $n$. As a result, standard…

Computation · Statistics 2014-12-10 Janis Hardwick , Quentin F. Stout

We propose a new nonparametric estimator for first-price auctions with independent private values that imposes the monotonicity constraint on the estimated inverse bidding strategy. We show that our estimator has a smaller asymptotic…

Econometrics · Economics 2025-03-10 Jun Ma , Vadim Marmer , Artyom Shneyerov , Pai Xu

Suppose $Y^{n}$ is obtained by observing a uniform Bernoulli random vector $X^{n}$ through a binary symmetric channel. Courtade and Kumar asked how large the mutual information between $Y^{n}$ and a Boolean function $\mathsf{b}(X^{n})$…

Information Theory · Computer Science 2016-07-11 Nir Weinberger , Ofer Shayevitz

A partial least squares regression is proposed for estimating the function-on-function regression model where a functional response and multiple functional predictors consist of random curves with quadratic and interaction effects. The…

Methodology · Statistics 2020-12-11 Ufuk Beyaztas , Han Lin Shang

We settle an open problem of several years standing by showing that the least-squares mean for positive definite matrices is monotone for the usual (Loewner) order. Indeed we show this is a special case of its appropriate generalization to…

Metric Geometry · Mathematics 2010-07-28 Jimmie Lawson , Yongdo Lim