English
Related papers

Related papers: Optimal designs for a class of nonlinear regressio…

200 papers

We consider a linear regression model with complex-valued response and predictors from a compact and connected Lie group. The regression model is formulated in terms of eigenfunctions of the Laplace-Beltrami operator on the Lie group. We…

Statistics Theory · Mathematics 2024-10-02 Somnath Chakraborty , Holger Dette , Martin Kroll

We introduce the concept of shape-regular regression maps as a framework to derive optimal rates of convergence for various non-parametric local regression estimators. Using Vapnik-Chervonenkis theory, we establish upper and lower bounds on…

Statistics Theory · Mathematics 2025-01-31 Jérémy Bettinger , François Portier , Adrien Saumard

We investigate high-dimensional nonconvex penalized regression, where the number of covariates may grow at an exponential rate. Although recent asymptotic theory established that there exists a local minimum possessing the oracle property…

Statistics Theory · Mathematics 2013-11-21 Lan Wang , Yongdai Kim , Runze Li

We give an overview over the usefulness of the concept of equivariance and invariance in the design of experiments for generalized linear models. In contrast to linear models here pairs of transformations have to be considered which act…

Statistics Theory · Mathematics 2020-11-20 Osama Idais , Rainer Schwabe

Fr\'echet regression extends the principles of linear regression to accommodate responses valued in generic metric spaces. While this approach has primarily focused on exploring relationships between Euclidean predictors and non-Euclidean…

Statistics Theory · Mathematics 2026-02-25 Chang Jun Im , Jeong Min Jeon

We study the optimal approximation of the solution of an operator equation Au=f by linear and nonlinear mappings. We identify those cases where optimal nonlinear approximation is better than optimal linear approximation.

Numerical Analysis · Mathematics 2025-10-20 Stephan Dahlke , Erich Novak , Winfried Sickel

In general, the solution to a regression problem is the minimizer of a given loss criterion, and depends on the specified loss function. The nonparametric isotonic regression problem is special, in that optimal solutions can be found by…

Statistics Theory · Mathematics 2020-05-06 Alexander I. Jordan , Anja Mühlemann , Johanna F. Ziegel

In this article we study optimization problems ruled by $\alpha$-fractional diffusion operators with volume constraints. By means of penalization techniques we prove existence of solutions. We also show that every solution is locally of…

Analysis of PDEs · Mathematics 2015-10-19 Eduardo V. Teixeira , Rafayel Teymurazyan

We derive a model problem for quasicontinuum approximations that allows a simple, yet insightful, analysis of the optimal-order convergence rate in the continuum limit for both the energy-based quasicontinuum approximation and the…

Numerical Analysis · Mathematics 2010-07-19 Matthew Dobson , Mitchell Luskin

We propose a computational approach to constructing exact designs on finite design spaces that are optimal for multiresponse regression experiments under a combination of the standard linear and specific 'sparsity' constraints. The linear…

Methodology · Statistics 2026-02-13 Lenka Filová , Pál Somogyi , Radoslav Harman

When model predictions inform downstream decision making, a natural question is under what conditions can the decision-makers simply respond to the predictions as if they were the true outcomes. Calibration suffices to guarantee that simple…

Machine Learning · Computer Science 2025-04-23 Jingwu Tang , Jiayun Wu , Zhiwei Steven Wu , Jiahao Zhang

We present an efficient method for computing A-optimal experimental designs for infinite-dimensional Bayesian linear inverse problems governed by partial differential equations (PDEs). Specifically, we address the problem of optimizing the…

Computation · Statistics 2014-05-29 Alen Alexanderian , Noemi Petra , Georg Stadler , Omar Ghattas

We consider the linear regression model with observation error in the design. In this setting, we allow the number of covariates to be much larger than the sample size. Several new estimation methods have been recently introduced for this…

Statistics Theory · Mathematics 2016-07-05 Alexandre Belloni , Mathieu Rosenbaum , Alexandre Tsybakov

This paper investigates an infinite-horizon problems in the one-dimensional calculus of variations, arising from the Ramsey model of endogeneous economic growth. Following Chichilnisky, we introduce an additional term, which models concern…

Economics · Quantitative Finance 2015-11-03 Ivar Ekeland , Yiming Long , Qinglong Zhou

Many problems of theoretical and practical interest involve finding an optimum over a family of convex functions. For instance, finding the projection on the convex functions in $H^k(\Omega)$, and optimizing functionals arising from some…

Numerical Analysis · Mathematics 2008-04-11 Néstor E. Aguilera , Pedro Morin

In this work, we address the exact D-optimal experimental design problem by proposing an efficient algorithm that rapidly identifies the support of its continuous relaxation. Our method leverages a column generation framework to solve such…

Optimization and Control · Mathematics 2026-05-18 Selin Ahipasaoglu , Stefano Cipolla , Jacek Gondzio

We consider the problem of stochastic convex optimization with exp-concave losses using Empirical Risk Minimization in a convex class. Answering a question raised in several prior works, we provide a $O( d / n + \log( 1 / \delta) / n )$…

Machine Learning · Computer Science 2023-07-06 Nikita Puchkin , Nikita Zhivotovskiy

We introduce a new approach aiming at computing approximate optimal designs for multivariate polynomial regressions on compact (semi-algebraic) design spaces. We use the moment-sum-of-squares hierarchy of semidefinite programming problems…

Statistics Theory · Mathematics 2017-10-27 Yohann De Castro , Fabrice Gamboa , Didier Henrion , Roxana Hess , Jean-Bernard Lasserre

The increasing popularity of regression discontinuity methods for causal inference in observational studies has led to a proliferation of different estimating strategies, most of which involve first fitting non-parametric regression models…

Methodology · Statistics 2018-06-11 Guido Imbens , Stefan Wager

We consider in this paper the problem of optimal experiment design where a decision maker can choose which points to sample to obtain an estimate $\hat{\beta}$ of the hidden parameter $\beta^{\star}$ of an underlying linear model. The key…

Machine Learning · Statistics 2021-01-01 Xavier Fontaine , Pierre Perrault , Michal Valko , Vianney Perchet