English
Related papers

Related papers: Optimal ANOVA-based emulators of models with(out) …

200 papers

We introduce a method to construct a stochastic surrogate model from the results of dimensionality reduction in forward uncertainty quantification. The hypothesis is that the high-dimensional input augmented by the output of a computational…

Applications · Statistics 2026-02-12 Jungho Kim , Sang-ri Yi , Ziqi Wang

We present a benchmark designed to evaluate the predictive capabilities of universal machine learning interatomic potentials across systems of varying dimensionality. Specifically, our benchmark tests zero- (molecules, atomic clusters,…

Materials Science · Physics 2025-08-22 Giulio Benedini , Antoine Loew , Matti Hellstrom , Silvana Botti , Miguel A. L. Marques

Dimension reduction is an important tool for analyzing high-dimensional data. The predictor envelope is a method of dimension reduction for regression that assumes certain linear combinations of the predictors are immaterial to the…

Methodology · Statistics 2022-01-07 Paul May , Hossein Moradi Rekabdarkolaee

The predictive quality of machine learning models is typically measured in terms of their (approximate) expected prediction error or the so-called Area Under the Curve (AUC) for a particular data distribution. However, when the models are…

Machine Learning · Computer Science 2018-02-08 Hiva Ghanbari , Katya Scheinberg

High-dimensional partial differential equations (PDE) appear in a number of models from the financial industry, such as in derivative pricing models, credit valuation adjustment (CVA) models, or portfolio optimization models. The PDEs in…

Numerical Analysis · Mathematics 2020-07-15 Christian Beck , Weinan E , Arnulf Jentzen

In applied sciences, we often deal with deterministic simulation models that are too slow for simulation-intensive tasks such as calibration or real-time control. In this paper, an emulator for a generic dynamic model, given by a system of…

Methodology · Statistics 2012-07-06 Carlo Albert

Derivative-free - or zeroth-order - optimization (DFO) has gained recent attention for its ability to solve problems in a variety of application areas, including machine learning, particularly involving objectives which are stochastic…

Optimization and Control · Mathematics 2020-08-04 Coralia Cartis , Tyler Ferguson , Lindon Roberts

An exponential interaction is constructed so that one-dimensional atoms and chains of atoms mimic the general behavior of their three-dimensional counterparts. Relative to the more commonly used soft-Coulomb interaction, the exponential…

Strongly Correlated Electrons · Physics 2016-03-07 Thomas E. Baker , E. Miles Stoudenmire , Lucas O. Wagner , Kieron Burke , Steven R. White

This paper considers the efficient minimization of the infinite time average of a stationary ergodic process in the space of a handful of design parameters which affect it. Problems of this class, derived from physical or numerical…

Optimization and Control · Mathematics 2019-10-29 Pooriya Beyhaghi , Ryan Alimo , Thomas Bewley

Complex dynamic systems are typically either modeled using expert knowledge in the form of differential equations or via data-driven universal approximation models such as artificial neural networks (ANN). While the first approach has…

Optimization and Control · Mathematics 2024-09-09 Christoph Plate , Carl Julius Martensen , Sebastian Sager

The global dimensionality of a neural representation manifold provides rich insight into the computational process underlying both artificial and biological neural networks. However, all existing measures of global dimensionality are…

Machine Learning · Statistics 2026-03-03 Chanwoo Chun , Abdulkadir Canatar , SueYeon Chung , Daniel Lee

We will introduce Euler-Maruyama approximations given by an orthogonal system in $L^{2}[0,1]$ for high dimensional SDEs, which could be finite dimensional approximations of SPDEs. In general, the higher the dimension is, the more one needs…

Probability · Mathematics 2021-04-06 Jirô Akahori , Masahiro Kinuya , Takashi Sawai , Tomooki Yuasa

We propose a determinant-free approach for simulation-based Bayesian inference in high-dimensional Gaussian models. We introduce auxiliary variables with covariance equal to the inverse covariance of the model. The joint probability of the…

Computation · Statistics 2017-09-12 Louis Ellam , Heiko Strathmann , Mark Girolami , Iain Murray

A general framework for solving nonlinear least squares problems without the employment of derivatives is proposed in the present paper together with a new general global convergence theory. With the aim to cope with the case in which the…

Numerical Analysis · Mathematics 2023-04-28 E. G. Birgin , J. M. Martínez

A new gradient-based adaptive sampling method is proposed for design of experiments applications which balances space filling, local refinement, and error minimization objectives while reducing reliance on delicate tuning parameters. High…

Methodology · Statistics 2024-05-09 Lucas Caparini , Gwynn J. Elfring , Mauricio Ponga

Within the framework of smoothing spline ANOVA, we propose a plug-in kernel ridge regression estimator to estimate the derivatives of the underlying multivariate regression function. We first establish an $L_\infty$ convergence rate of the…

Methodology · Statistics 2026-03-03 Ruiqi Liu , Kexuan Li , Meng Li

A statistical emulator can be used as a surrogate of complex physics-based calculations to drastically reduce the computational cost. Its successful implementation hinges on an accurate representation of the nonlinear response surface with…

Chemical Physics · Physics 2024-01-31 Xinyi Fang , Mengyang Gu , Jianzhong Wu

Developing interpretable machine learning models has become an increasingly important issue. One way in which data scientists have been able to develop interpretable models has been to use dimension reduction techniques. In this paper, we…

Machine Learning · Computer Science 2023-03-23 Sean H. Merritt , Alexander P. Christensen

In the last decade, parameter-free approaches to shape optimization problems have matured to a state where they provide a versatile tool for complex engineering applications. However, sensitivity distributions obtained from shape…

Computational Engineering, Finance, and Science · Computer Science 2023-10-04 Lars Radtke , Georgios Bletsos , Niklas Kühl , Tim Suchan , Thomas Rung , Alexander Düster , Kathrin Welker

To make sense of the world our brains must analyze high-dimensional datasets streamed by our sensory organs. Because such analysis begins with dimensionality reduction, modelling early sensory processing requires biologically plausible…

Neurons and Cognition · Quantitative Biology 2016-01-27 Cengiz Pehlevan , Dmitri B. Chklovskii