English
Related papers

Related papers: Constructive and consistent estimation of quadrati…

200 papers

We develop an approach for estimating models described via conditional moment restrictions, with a prototypical application being non-parametric instrumental variable regression. We introduce a min-max criterion function, under which the…

Econometrics · Economics 2020-06-15 Nishanth Dikkala , Greg Lewis , Lester Mackey , Vasilis Syrgkanis

Motivated by applications in genomics, this paper studies the problem of optimal estimation of a quadratic functional of two normal mean vectors, $Q(\mu, \theta) = \frac{1}{n}\sum_{i=1}^n\mu_i^2\theta_i^2$, with a particular focus on the…

Statistics Theory · Mathematics 2015-05-08 T. Tony Cai , Xin Lu Tan

We consider the fundamental problem of estimating the mean of a vector $y=X\beta+z$, where $X$ is an $n\times p$ design matrix in which one can have far more variables than observations, and $z$ is a stochastic error term--the so-called…

Statistics Theory · Mathematics 2009-08-21 Emmanuel J. Candès , Yaniv Plan

We present a minimax optimal solution to the problem of estimating a compact, convex set from finitely many noisy measurements of its support function. The solution is based on appropriate regularizations of the least squares estimator.…

Statistics Theory · Mathematics 2012-05-31 Adityanand Guntuboyina

We study a minimax risk of estimating inverse functions on a plane, while keeping an estimator is also invertible. Learning invertibility from data and exploiting an invertible estimator are used in many domains, such as statistics,…

Statistics Theory · Mathematics 2023-12-27 Akifumi Okuno , Masaaki Imaizumi

We obtain robust and computationally efficient estimators for learning several linear models that achieve statistically optimal convergence rate under minimal distributional assumptions. Concretely, we assume our data is drawn from a…

Machine Learning · Statistics 2020-12-07 Ainesh Bakshi , Adarsh Prasad

Optimization under uncertainty and risk is indispensable in many practical situations. Our paper addresses stability of optimization problems using composite risk functionals which are subjected to measure perturbations. Our main focus is…

Optimization and Control · Mathematics 2022-01-06 Darinka Dentcheva , Yang Lin , Spiridon Penev

We present a general scheme for the construction of new eficient generalized Schultz iterative methods for computing the inverse matrix. These methods have the form $$ X_{k+1} = X_k(a_0^{(k)}I+a_1^{(k)}AX_k),\quad k\in\mathbb{N}, $$ where…

Numerical Analysis · Mathematics 2026-03-10 Mihailo Krstić , Marko D. Petković , Kostadin Rajković , Marko Kostadinov

Let $Y\in\R^n$ be a random vector with mean $s$ and covariance matrix $\sigma^2P_n\tra{P_n}$ where $P_n$ is some known $n\times n$-matrix. We construct a statistical procedure to estimate $s$ as well as under moment condition on $Y$ or…

Statistics Theory · Mathematics 2012-10-01 Xavier Gendre

We address the statistical estimation of composite functionals which may be nonlinear in the probability measure. Our study is motivated by the need to estimate coherent measures of risk, which become increasingly popular in finance,…

Statistics Theory · Mathematics 2015-04-13 Darinka Dentcheva , Spiridon Penev , Andrzej Ruszczynski

In this paper we focus on the unconstrained binary quadratic optimization model, maximize x^t Qx, x binary, and consider the problem of identifying optimal solutions that are robust with respect to perturbations in the Q matrix.. We are…

Artificial Intelligence · Computer Science 2017-09-25 Mark Lewis , Gary Kochenberger , John Metcalfe

The problem of Bayes minimax estimation for the mean of a multivariate normal distribution under quadratic loss has attracted significant attention recently. These estimators have the advantageous property of being admissible, similar to…

Statistics Theory · Mathematics 2025-05-13 Dominique Fourdrinier , William E. Strawderman , Martin T. Wells

We develop a new approach for the estimation of a multivariate function based on the economic axioms of quasiconvexity (and monotonicity). On the computational side, we prove the existence of the quasiconvex constrained least squares…

Methodology · Statistics 2023-10-24 Somabha Mukherjee , Rohit K. Patra , Andrew L. Johnson , Hiroshi Morita

Consider a nonlinear regression model : y_{i}=g(x_{i},{\theta})+e_{i}, i=1,...,n, where the x_{i} are random predictors x_{i} and {\theta} is the unknown parameter vector ranging in a set {\Theta}\subsetR^{p}. All known results on the…

Statistics Theory · Mathematics 2012-07-03 Fasano María Victoria , Ricardo A. Maronna

The present article is devoted to the semi-parametric estimation of multivariate expectiles for extreme levels. The considered multivariate risk measures also include the possible conditioning with respect to a functional covariate,…

Statistics Theory · Mathematics 2023-03-30 Elena Di Bernardino , Thomas Laloë , Cambyse Pakzad

A general method to combine several estimators of the same quantity is investigated. In the spirit of model and forecast averaging, the final estimator is computed as a weighted average of the initial ones, where the weights are constrained…

Methodology · Statistics 2015-05-26 Frédéric Lavancier , Paul Rochet

We consider learning methods based on the regularization of a convex empirical risk by a squared Hilbertian norm, a setting that includes linear predictors and non-linear predictors through positive-definite kernels. In order to go beyond…

Machine Learning · Computer Science 2019-06-19 Ulysse Marteau-Ferey , Dmitrii Ostrovskii , Francis Bach , Alessandro Rudi

In this article we propose a general class of risk measures which can be used for data based evaluation of parametric models. The loss function is defined as generalized quadratic distance between the true density and the proposed model.…

Statistics Theory · Mathematics 2007-10-02 Surajit Ray , Bruce G. Lindsay

An optimum solution free from degeneration is found to the system of linear algebraic equations with empirical coefficients and right-hand sides. The quadratic risk of estimators of the unknown solution vector is minimized over a class of…

Probability · Mathematics 2007-05-23 A. V. Serdobolski

In this correspondence, we introduce a minimax regret criteria to the least squares problems with bounded data uncertainties and solve it using semi-definite programming. We investigate a robust minimax least squares approach that minimizes…

Systems and Control · Computer Science 2012-03-20 Nargiz Kalantarova , Mehmet A. Donmez , Suleyman S. Kozat