English
Related papers

Related papers: Optimal designs in regression with correlated erro…

200 papers

A simple yet efficient computational algorithm for computing the continuous optimal experimental design for linear models is proposed. An alternative proof the monotonic convergence for $D$-optimal criterion on continuous design spaces are…

Computation · Statistics 2018-04-10 Jiangtao Duan , Wei Gao , Hon Keung Tony Ng

In this paper, we study regression problems over a separable Hilbert space with the square loss, covering non-parametric regression over a reproducing kernel Hilbert space. We investigate a class of spectral/regularized algorithms,…

Machine Learning · Statistics 2022-07-18 Junhong Lin , Alessandro Rudi , Lorenzo Rosasco , Volkan Cevher

Consider the problem of constructing an experimental design, optimal for estimating parameters of a given statistical model with respect to a chosen criterion. To address this problem, the literature usually provides a single solution.…

Computation · Statistics 2024-11-05 Radoslav Harman , Lenka Filová , Samuel Rosa

Improving algorithms via predictions is a very active research topic in recent years. This paper initiates the systematic study of mechanism design in this model. In a number of well-studied mechanism design settings, we make use of…

Computer Science and Game Theory · Computer Science 2023-01-13 Chenyang Xu , Pinyan Lu

A basic principle in the design of observational studies is to approximate the randomized experiment that would have been conducted under controlled circumstances. Now, linear regression models are commonly used to analyze observational…

Methodology · Statistics 2022-07-08 Ambarish Chattopadhyay , Jose R. Zubizarreta

The best subset selection (or "best subsets") estimator is a classic tool for sparse regression, and developments in mathematical optimization over the past decade have made it more computationally tractable than ever. Notwithstanding its…

Methodology · Statistics 2022-01-11 Ryan Thompson

Optimal experimental design provides a way of determining a-priori the best locations at which to place accelerometers in vibrations analysis experiments. However, in practice, sensors often fail during experimentation due high mechanical…

Computational Engineering, Finance, and Science · Computer Science 2026-04-17 Rebekah White , Chandler Smith , Drew Kouri , Jace Ritchie , Wilkins Aquino , Timothy Walsh

We consider planning longitudinal covariate measurements in follow-up studies where covariates are time-varying. We assume that the entire cohort cannot be selected for longitudinal measurements due to financial limitations and study how a…

Methodology · Statistics 2024-07-03 Jaakko Reinikainen , Juha Karvanen

In regression with random design, we study the problem of selecting a model that performs well for out-of-sample prediction. We do not assume that any of the candidate models under consideration are correct. Our analysis is based on…

Methodology · Statistics 2008-10-24 Hannes Leeb

This paper addresses the analysis and design of quadratic neural networks, which have been recently introduced in the literature, and their applications to regression, classification, system identification and control of dynamical systems.…

Machine Learning · Computer Science 2022-07-28 Luis Rodrigues , Sidney Givigi

In this paper, we propose two simple yet efficient computational algorithms to obtain approximate optimal designs for multi-dimensional linear regression on a large variety of design spaces. We focus on the two commonly used optimal…

Statistics Theory · Mathematics 2021-02-26 Jiangtao Duan , Wei Gao , Yanyuan Ma , Hon Keung Tony Ng

Optimal experimental design (OED) is the general formalism of sensor placement and decisions about the data collection strategy for engineered or natural experiments. This approach is prevalent in many critical fields such as battery…

Optimization and Control · Mathematics 2022-06-28 Ahmed Attia , Emil Constantinescu

The goal of subsampling is to select an informative subset of all observations, when using the full data for statistical analysis is not viable. We construct locally $ D $-optimal subsampling designs under a Poisson regression model with a…

Statistics Theory · Mathematics 2024-03-28 Torsten Reuter , Rainer Schwabe

Dynamical systems are frequently used to model biological systems. When these models are fit to data it is necessary to ascertain the uncertainty in the model fit. Here we present prediction deviation, a new metric of uncertainty that…

Applications · Statistics 2017-06-08 Benjamin Letham , Portia A. Letham , Cynthia Rudin , Edward P. Browne

We consider statistical inference for errors-in-variables regression models with dependent observations under the high dimensionality of the error covariance matrix. It is tempting to prewhiten the model and data that had led to efficient…

Applications · Statistics 2026-05-08 Jingkun Qiu , Hanyue Chen , Song Xi Chen

We consider a measurement constrained supervised learning problem, that is, (1) full sample of the predictors are given; (2) the response observations are unavailable and expensive to measure. Thus, it is ideal to select a subsample of…

Methodology · Statistics 2020-10-26 Cheng Meng , Rui Xie , Abhyuday Mandal , Xinlian Zhang , Wenxuan Zhong , Ping Ma

Subset selection for multiple linear regression aims to construct a regression model that minimizes errors by selecting a small number of explanatory variables. Once a model is built, various statistical tests and diagnostics are conducted…

Machine Learning · Statistics 2020-09-04 Seokhyun Chung , Young Woong Park , Taesu Cheong

We consider optimal design of infinite-dimensional Bayesian linear inverse problems governed by partial differential equations that contain secondary reducible model uncertainties, in addition to the uncertainty in the inversion parameters.…

Optimization and Control · Mathematics 2020-06-23 Alen Alexanderian , Noemi Petra , Georg Stadler , Isaac Sunseri

In regression problems where there is no known true underlying model, conformal prediction methods enable prediction intervals to be constructed without any assumptions on the distribution of the underlying data, except that the training…

Methodology · Statistics 2023-01-31 Wenyu Chen , Kelli-Jean Chun , Rina Foygel Barber

In this paper some new properties and computational tools for finding KL-optimum designs are provided. KL-optimality is a general criterion useful to select the best experimental conditions to discriminate between statistical models. A…

Methodology · Statistics 2018-01-04 Giacomo Aletti , Caterina May , Chiara Tommasi