English
Related papers

Related papers: Assessing Prediction Error at Interpolation and Ex…

200 papers

This article focuses on making discrete-time Adaptive Iterative Learning Control (ILC) more effective using multiple estimation models. Existing strategies use the tracking error to adjust the parametric estimates. Our strategy uses the…

Systems and Control · Electrical Eng. & Systems 2024-06-14 Ram Padmanabhan , Rajini Makam , Koshy George

With increased interest in adopting AI methods for clinical diagnosis, a vital step towards safe deployment of such tools is to ensure that the models not only produce accurate predictions but also do not generalize to data regimes where…

Machine Learning · Computer Science 2021-03-08 Vivek Narayanaswamy , Jayaraman J. Thiagarajan , Deepta Rajan , Andreas Spanias

Asymmetry measurements are common in collider experiments and can sensitively probe particle properties. Typically, data can only be measured in a finite region covered by the detector, so an extrapolation from the visible asymmetry to the…

High Energy Physics - Experiment · Physics 2016-06-22 Katrina Colletti , Ziqing Hong , David Toback , Jonathan S. Wilson

We provide in this paper a fully adaptive penalized procedure to select a covariance among a collection of models observing i.i.d replications of the process at fixed observation points. For this we generalize previous results of Bigot and…

Statistics Theory · Mathematics 2012-03-05 Rolando Biscay , Hélène Lescornel , Jean-Michel Loubes

Extrapolation to unseen sequence lengths is a challenge for neural generative models of language. In this work, we characterize the effect on length extrapolation of a modeling decision often overlooked: predicting the end of the generative…

Computation and Language · Computer Science 2020-10-15 Benjamin Newman , John Hewitt , Percy Liang , Christopher D. Manning

The aim of survey statistics is to produce estimates with a minimal bias and a corresponding acceptable variance given a specific budget, preferable with a minor response burden for the participants. In recent years, considerable efforts…

Methodology · Statistics 2026-04-02 Martin Hyllienmark , Gustaf Strandell

Artificial Neural Networks (ANNs) implement a specific form of multi-variate extrapolation and will generate an output for any input pattern, even when there is no similar training pattern. Extrapolations are not necessarily to be trusted,…

Machine Learning · Statistics 2020-02-27 Neil A. Thacker , Carole J. Twining , Paul D. Tar , Scott Notley , Visvanathan Ramesh

The masked projection techniques are popular in the area of non-linear model reduction. Quantifying and minimizing the error in model reduction, particularly from masked projections, is important. The exact error expressions are often…

Numerical Analysis · Mathematics 2025-01-06 Brij Nandan Tripathi , Hanumant Singh Shekhawat

Standard tabular benchmarks mainly focus on the evaluation of a model's capability to interpolate values inside a data manifold, where models good at performing local statistical smoothing are rewarded. However, there exists a very large…

Machine Learning · Computer Science 2026-02-04 Zerui Cheng , Jiashuo Liu , Jianzhu Yao , Pramod Viswanath , Ge Zhang , Wenhao Huang

Foundation models often generate unreliable answers, while heuristic uncertainty estimators fail to fully distinguish correct from incorrect outputs, causing users to accept erroneous answers without any statistical guarantee. We address…

Artificial Intelligence · Computer Science 2026-05-27 Zhiyuan Wang , Aniri , Tianlong Chen , Yue Zhang , Heng Tao Shen , Xiaoshuang Shi , Kaidi Xu

Interpolatory methods offer a powerful framework for generating reduced-order models (ROMs) for non-parametric or parametric systems with time-varying inputs. Choosing the interpolation points adaptively remains an area of active interest.…

Numerical Analysis · Mathematics 2021-10-13 Sridhar Chellappa , Lihong Feng , Valentin de la Rubia , Peter Benner

Unmeasured covariates constitute one of the important problems in causal inference. Even if there are some unmeasured covariates, some instrumental variable methods such as a two-stage residual inclusion (2SRI) estimator, or a…

Methodology · Statistics 2021-12-30 Shunichiro Orihara

Recent advancements in machine learning have showcased its potential to significantly accelerate the discovery of new materials. Central to this progress is the development of rapidly computable property predictors, enabling the…

Materials Science · Physics 2024-04-16 Kohei Noda , Araki Wakiuchi , Yoshihiro Hayashi , Ryo Yoshida

We consider the problem of estimating the conditional distribution of a post-model-selection estimator where the conditioning is on the selected model. The notion of a post-model-selection estimator here refers to the combined procedure…

Statistics Theory · Mathematics 2007-11-06 Hannes Leeb , Benedikt M. Pötscher

Selecting artificial intelligence (AI) models, such as large language models (LLMs), from multiple candidates requires accurate performance estimation. This is ideally achieved through empirical evaluations involving abundant real-world…

Machine Learning · Statistics 2025-12-03 Sangwoo Park , Matteo Zecchin , Osvaldo Simeone

Recent research demonstrates that linear models achieve forecasting performance competitive with complex architectures, yet methodologies for enhancing linear models remain underexplored. Motivated by the hypothesis that distinct time…

Machine Learning · Computer Science 2025-10-13 Zipo Jibao , Yingyi Fu , Xinyang Chen , Guoting Chen

We present a comparison of model-space extrapolation methods for No-Core Shell Model calculations of ground-state energies and root-mean-square radii in Li isotopes. In particular, we benchmark the latest machine learning tools against…

We study the well known difficult problem of prediction in measurement error models. By targeting directly at the prediction interval instead of the point prediction, we construct a prediction interval by providing estimators of both the…

Methodology · Statistics 2024-05-20 Fei Jiang , Yanyuan Ma

We study online aggregation of the predictions of experts, and first show new second-order regret bounds in the standard setting, which are obtained via a version of the Prod algorithm (and also a version of the polynomially weighted…

Machine Learning · Statistics 2014-02-11 Pierre Gaillard , Gilles Stoltz , Tim Van Erven

A statistical approach based on the interval analysis (IA) is proposed for the analysis of the effects, on the radiation patterns radiated by phased arrays, of random errors and tolerances in the amplitudes and phases of the array-elements…

Signal Processing · Electrical Eng. & Systems 2021-02-10 P. Rocca , N. Anselmi , A. Benoni , A. Massa