English
Related papers

Related papers: Assessing Prediction Error at Interpolation and Ex…

200 papers

Effective verification and validation techniques for modern scientific machine learning workflows are challenging to devise. Statistical methods are abundant and easily deployed, but often rely on speculative assumptions about the data and…

Machine Learning · Computer Science 2025-02-11 Tyler Chang , Andrew Gillette , Romit Maulik

Classical approximation and learning methods are typically optimized for interpolation over a sampled domain {\Omega}, with no guarantees on their behavior in an extrapolation region {\Xi}, where small in-domain errors may amplify. We…

Numerical Analysis · Mathematics 2026-03-11 Guy Hay , Nir Sharon

Within the machine learning community, the widely-used uniform convergence framework has been used to answer the question of how complex, over-parameterized models can generalize well to new data. This approach bounds the test error of the…

Machine Learning · Statistics 2021-03-05 Ryan Theisen , Jason M. Klusowski , Michael W. Mahoney

We review the Akaike, deviance, and Watanabe-Akaike information criteria from a Bayesian perspective, where the goal is to estimate expected out-of-sample-prediction error using a biascorrected adjustment of within-sample error. We focus on…

Methodology · Statistics 2013-07-24 Andrew Gelman , Jessica Hwang , Aki Vehtari

We present three different methods to estimate error bars on the predictions made using a neural network. All of them represent lower bounds for the extrapolation errors. For example, we did not include an analysis on robustness against…

Nuclear Theory · Physics 2021-08-11 A. Pastore , M. Carnini

Model based signal processing or signal analysis or signal representation has a rather different point of view from the more traditional filtering and algorithm based approaches. However, in all of these, the names of Prony, Pad\'e, and…

Signal Processing · Electrical Eng. & Systems 2019-09-13 C. Sidney Burrus

This paper considers errors-in-variables models in a high-dimensional setting where the number of covariates can be much larger than the sample size, and there are only a small number of non-zero covariates. The presence of measurement…

Methodology · Statistics 2018-09-03 Linh Nghiem , Cornelis Potgieter

Craig interpolation is a widespread method in verification, with important applications such as Predicate Abstraction, CounterExample Guided Abstraction Refinement and Lazy Abstraction With Interpolants. Most state-of-the-art model checking…

Logic in Computer Science · Computer Science 2014-04-16 Arie Gurfinkel , Simone Fulvio Rollini , Natasha Sharygina

Function approximation from input and output data is one of the most investigated problems in signal processing. This problem has been tackled with various signal processing and machine learning methods. Although tensors have a rich history…

Statistics Theory · Mathematics 2023-02-16 Christina Auer , Thomas Paireder , Oliver Ploder , Oliver Lang , Mario Huemer

Interpolation-based methods are well-established and effective approaches for the efficient generation of accurate reduced-order surrogate models. Common challenges for such methods are the automatic selection of good or even optimal…

Numerical Analysis · Mathematics 2024-07-23 Quirin Aumann , Steffen W. R. Werner

Evaluating predictive models is a crucial task in predictive analytics. This process is especially challenging with time series data where the observations show temporal dependencies. Several studies have analysed how different performance…

Machine Learning · Statistics 2022-02-14 Vitor Cerqueira , Luis Torgo , Carlos Soares

Novel reconstruction methods for electrical impedance tomography (EIT) often require voltage measurements on current-driven electrodes. Such measurements are notoriously difficult to obtain in practice as they tend to be affected by unknown…

Numerical Analysis · Mathematics 2018-10-11 Bastian Harrach

One way to investigate the precision of estimates likely to result from planned experiments and planned epidemiological studies is to simulate a large number of possible outcomes and analyse the sets of possible results. This appears to be…

Computation · Statistics 2013-06-28 G. K. Robinson , L. M. Ryan

A priori error bounds have been derived for different balancing-related model reduction methods. The most classical result is a bound for balanced truncation and singular perturbation approximation that is applicable for asymptotically…

Numerical Analysis · Mathematics 2022-01-19 Björn Liljegren-Sailer

Information theoretic criteria (ITC) have been widely adopted in engineering and statistics for selecting, among an ordered set of candidate models, the one that better fits the observed sample data. The selected model minimizes a penalized…

Machine Learning · Statistics 2019-10-10 Andrea Mariani , Andrea Giorgetti , Marco Chiani

A bias correction to Akaike's information criterion (AIC) is derived for seemingly unrelated regressions models. The correction is of particular use when the sample size is not much larger than the number of fitted parameters. A…

Methodology · Statistics 2009-06-05 J. L. van Velsen

Bayesian parameter estimation provides a systematic approach to compare heavy ion collision models with measurements, leading to constraints on the properties of nuclear matter with proper accounting of experimental and theoretical…

Nuclear Theory · Physics 2023-05-31 Brandon Weiss , Jean-François Paquet , Steffen A. Bass

We report a deep generative model for regression tasks in materials informatics. The model is introduced as a component of a data imputer, and predicts more than 20 diverse experimental properties of organic molecules. The imputer is…

Computational Physics · Physics 2021-03-02 Kan Hatakeyama-Sato , Kenichi Oyaizu

This paper deals with the polynomial linear system solving with errors (PLSwE) problem. Specifically, we focus on the evaluation-interpolation technique for solving polynomial linear systems and we assume that errors can occur in the…

Symbolic Computation · Computer Science 2021-02-09 Guerrini Eleonora , Lebreton Romain , Zappatore Ilaria

Practitioners building classifiers often start with a smaller pilot dataset and plan to grow to larger data in the near future. Such projects need a toolkit for extrapolating how much classifier accuracy may improve from a 2x, 10x, or 50x…

Machine Learning · Computer Science 2023-12-01 Ethan Harvey , Wansu Chen , David M. Kent , Michael C. Hughes