English
Related papers

Related papers: Nonquadratic estimators of a quadratic functional

200 papers

Quadratic-support functions [Aravkin, Burke, and Pillonetto; J. Mach. Learn. Res. 14(1), 2013] constitute a parametric family of convex functions that includes a range of useful regularization terms found in applications of convex…

Optimization and Control · Mathematics 2018-08-23 Michael P. Friedlander , Gabriel Goh

We study the quadratic prediction error method -- i.e., nonlinear least squares -- for a class of time-varying parametric predictor models satisfying a certain identifiability condition. While this method is known to asymptotically achieve…

Statistics Theory · Mathematics 2024-04-17 Charis Stamouli , Ingvar Ziemann , George J. Pappas

We consider the recursive estimation of a regression functional where the explanatory variables take values in some functional space. We prove the almost sure convergence of such estimates for dependent functional data. Also we derive the…

Statistics Theory · Mathematics 2013-04-19 Aboubacar Amiri , Baba Thiam

In this paper, we study some bounds for nonconvex quadratically constrained quadratic programs. We propose two types of bounds for quadratically constrained quadratic programs, quadratic and cubic bounds. For quadratic bounds, we use affine…

Optimization and Control · Mathematics 2019-06-04 Moslem Zamani

A nonparametric regression setting is considered with a real-valued covariate and responses from a metric space. One may approach this setting via Fr\'echet regression, where the value of the regression function at each point is estimated…

Statistics Theory · Mathematics 2022-05-17 Christof Schötz

We construct several sequences of asymptotically optimal definite quadrature formulae of fourth order and evaluate their error constants. Besides the asymptotical optimality, an advantage of our quadrature formulae is the explicit form of…

Numerical Analysis · Mathematics 2016-05-10 Ana Avdzhieva , Geno Nikolov

In the past couple of decades, the use of ``non-quadratic" convex cost functions has revolutionized signal processing, machine learning, and statistics, allowing one to customize solutions to have desired structures and properties. However,…

Systems and Control · Electrical Eng. & Systems 2025-05-02 Babak Hassibi , Joudi Hajar , Reza Ghane

The paper deals with asymptotic properties of the adaptive procedure proposed in the author paper (2007) for estimation of unknown nonparametric regression. We prove that this procedure is asymptotically efficient for a quadratic risk. It…

Statistics Theory · Mathematics 2008-12-18 Leonid Galtchouk , Serguey Pergamenshchikov

A sequential quadratic optimization algorithm for minimizing an objective function defined by an expectation subject to nonlinear inequality and equality constraints is proposed, analyzed, and tested. The context of interest is when it is…

Optimization and Control · Mathematics 2023-03-01 Frank E. Curtis , Daniel P. Robinson , Baoyu Zhou

We consider potentially non-convex optimization problems, for which optimal rates of approximation depend on the dimension of the parameter space and the smoothness of the function to be optimized. In this paper, we propose an algorithm…

Machine Learning · Computer Science 2022-04-12 Blake Woodworth , Francis Bach , Alessandro Rudi

We consider the problem of estimating the slope parameter in functional linear regression, where scalar responses Y1,...,Yn are modeled in dependence of second order stationary random functions X1,...,Xn. An orthogonal series estimator of…

Statistics Theory · Mathematics 2009-01-28 Jan Johannes

Data can be assumed to be continuous functions defined on an infinite-dimensional space for many phenomena. However, the infinite-dimensional data might be driven by a small number of latent variables. Hence, factor models are relevant for…

Methodology · Statistics 2022-05-18 Israel Martínez-Hernández , Jesús Gonzalo , Graciela González-Farías

When computing bounds, spatial branch-and-bound algorithms often linearly outer approximate convex relaxations for non-convex expressions in order to capitalize on the efficiency and robustness of linear programming solvers. Considering…

Optimization and Control · Mathematics 2025-12-22 William R. Strahl , Arvind U. Raghunathan , Nikolaos V. Sahinidis , Chrysanthos E. Gounaris

In this paper, we derive minimax rates for estimating both parametric and nonparametric components in partially linear additive models with high dimensional sparse vectors and smooth functional components. The minimax lower bound for…

Statistics Theory · Mathematics 2018-01-16 Zhuqing Yu , Michael Levine , Guang Cheng

For nonparametric regression with one-sided errors and a boundary curve model for Poisson point processes we consider the problem of efficient estimation for linear functionals. The minimax optimal rate is obtained by an unbiased estimation…

Statistics Theory · Mathematics 2015-09-25 Markus Reiß , Leonie Selk

Optimization of convex functions subject to eigenvalue constraints is intriguing because of peculiar analytical properties of eigenvalues, and is of practical interest because of wide range of applications in fields such as structural…

Numerical Analysis · Mathematics 2013-10-08 Emre Mengi

We consider a class of pseudodifferential operators with a doubly characteristic point, where the quadratic part of the symbol fails to be elliptic but obeys an averaging assumption. Under suitable additional assumptions, semiclassical…

Analysis of PDEs · Mathematics 2016-07-14 Joe Viola

Modeling parts of an optimization problem as an optimal value function that depends on a top-level decision variable is a regular occurrence in optimization and an essential ingredient for methods such as Benders Decomposition. It often…

Optimization and Control · Mathematics 2024-10-01 Markus Gabl , Immanuel Bomze

Compared to nonparametric estimators in the multivariate setting, kernel estimators for functional data models have a larger order of bias. This is problematic for constructing confidence regions or statistical tests since the bias might…

Statistics Theory · Mathematics 2025-11-21 Melanie Birke , Tim Greger

In functional linear regression, the parameters estimation involves solving a non necessarily well-posed problem and it has points of contact with a range of methodologies, including statistical smoothing, deconvolution and projection on…

Statistics Theory · Mathematics 2018-01-04 Andrea Ghiglietti , Francesca Ieva , Anna Maria Paganoni , Giacomo Aletti