English
Related papers

Related papers: Optimal designs for rational function regression

200 papers

In nonlinear regression models the Fisher information depends on the parameters of the model. Consequently, optimal designs maximizing some functional of the information matrix cannot be implemented directly but require some preliminary…

Methodology · Statistics 2013-11-05 Ina Burghaus , Holger Dette

We propose an optimum mechanism for providing monetary incentives to the data sources of a statistical estimator such as linear regression, so that high quality data is provided at low cost, in the sense that the sum of payments and…

Machine Learning · Statistics 2015-04-27 Yang Cai , Constantinos Daskalakis , Christos H. Papadimitriou

We address the problem of learning an unknown smooth function and its derivatives from noisy pointwise evaluations under the supremum norm. While classical nonparametric regression provides a strong theoretical foundation, traditional…

Machine Learning · Computer Science 2026-03-10 Davide Maran , Marcello Restelli

We present a method for computing A-optimal sensor placements for infinite-dimensional Bayesian linear inverse problems governed by PDEs with irreducible model uncertainties. Here, irreducible uncertainties refers to uncertainties in the…

Optimization and Control · Mathematics 2020-08-26 Karina Koval , Alen Alexanderian , Georg Stadler

We obtain robust and computationally efficient estimators for learning several linear models that achieve statistically optimal convergence rate under minimal distributional assumptions. Concretely, we assume our data is drawn from a…

Machine Learning · Statistics 2020-12-07 Ainesh Bakshi , Adarsh Prasad

We focus on two central themes in this dissertation. The first one is on decomposing polytopes and polynomials in ways that allow us to perform nonlinear optimization. We start off by explaining important results on decomposing a polytope…

Combinatorics · Mathematics 2016-05-18 Brandon Dutra

This work proposes a machine-learning framework for constructing statistical models of errors incurred by approximate solutions to parameterized systems of nonlinear equations. These approximate solutions may arise from early termination of…

Numerical Analysis · Computer Science 2019-02-18 Brian A. Freno , Kevin T. Carlberg

The determination of an optimal design for a given regression problem is an intricate optimization problem, especially for models with multivariate predictors. Design admissibility and invariance are main tools to reduce the complexity of…

Statistics Theory · Mathematics 2020-03-24 Holger Dette , Xin Liu , Rong-Xian Yue

Bayesian optimal design is considered for experiments where the response distribution depends on the solution to a system of non-linear ordinary differential equations. The motivation is an experiment to estimate parameters in the equations…

Methodology · Statistics 2019-05-02 Antony Overstall , David Woods , Ben Parker

In this paper, we present a generic framework to extend existing uniformly optimal convex programming algorithms to solve more general nonlinear, possibly nonconvex, optimization problems. The basic idea is to incorporate a local search…

Optimization and Control · Mathematics 2015-10-27 Saeed Ghadimi , Guanghui Lan , Hongchao Zhang

Optimal design theory for nonlinear regression studies local optimality on a given design space. We identify designs for the Bradley--Terry paired comparison model with small undirected graphs and prove that every saturated D-optimal design…

Statistics Theory · Mathematics 2021-06-17 Thomas Kahle , Frank Röttger , Rainer Schwabe

We propose an optimistic estimate to evaluate the best possible fitting performance of nonlinear models. It yields an optimistic sample size that quantifies the smallest possible sample size to fit/recover a target function using a…

Machine Learning · Computer Science 2023-07-19 Yaoyu Zhang , Zhongwang Zhang , Leyang Zhang , Zhiwei Bai , Tao Luo , Zhi-Qin John Xu

A computer model can be used for predicting an output only after specifying the values of some unknown physical constants known as calibration parameters. The unknown calibration parameters can be estimated from real data by conducting…

Methodology · Statistics 2021-06-18 Arvind Krishna , V. Roshan Joseph , Shan Ba , William A. Brenneman , William R. Myers

This paper studies the robust optimal control design for uncertain nonlinear systems from a perspective of robust adaptive dynamic programming (robust-ADP). The objective is to fill up a gap in the past literature of ADP where dynamic…

Dynamical Systems · Mathematics 2013-03-12 Yu Jiang , Zhong-Ping Jiang

Max-affine regression refers to a model where the unknown regression function is modeled as a maximum of $k$ unknown affine functions for a fixed $k \geq 1$. This generalizes linear regression and (real) phase retrieval, and is closely…

Machine Learning · Statistics 2019-06-24 Avishek Ghosh , Ashwin Pananjady , Adityanand Guntuboyina , Kannan Ramchandran

Optimal experimental design is a well studied field in applied science and engineering. Techniques for estimating such a design are commonly used within the framework of parameter estimation. Nonetheless, in recent years parameter…

Machine Learning · Statistics 2025-01-13 Md Shahriar Rahim Siddiqui , Arman Rahmim , Eldad Haber

In general, the solution to a regression problem is the minimizer of a given loss criterion, and depends on the specified loss function. The nonparametric isotonic regression problem is special, in that optimal solutions can be found by…

Statistics Theory · Mathematics 2020-05-06 Alexander I. Jordan , Anja Mühlemann , Johanna F. Ziegel

Symbolic Regression is the study of algorithms that automate the search for analytic expressions that fit data. While recent advances in deep learning have generated renewed interest in such approaches, the development of symbolic…

Instrumentation and Methods for Astrophysics · Physics 2023-12-27 Wassim Tenachi , Rodrigo Ibata , Foivos I. Diakogiannis

We study regression discontinuity designs when covariates are included in the estimation. We examine local polynomial estimators that include discrete or continuous covariates in an additive separable way, but without imposing any…

Econometrics · Economics 2019-07-02 Sebastian Calonico , Matias D. Cattaneo , Max H. Farrell , Rocio Titiunik

Recent years have witnessed the introduction and development of extremely fast rational function algorithms. Many ideas in this realm arose from polynomial-based linear-algebraic algorithms. However, polynomial approximation is occasionally…

Numerical Analysis · Mathematics 2025-10-03 James Chok , Geoffrey M. Vasil