中文
相关论文

相关论文: Cross-Validation Based Adaptive Sampling for Multi…

200 篇论文

Investigating uncertainties in computer simulations can be prohibitive in terms of computational costs, since the simulator needs to be run over a large number of input values. Building an emulator, i.e. a statistical surrogate model of the…

统计方法学 · 统计学 2022-10-18 Ayao Ehara , Serge Guillas

Learning uncertain dynamics models using Gaussian process~(GP) regression has been demonstrated to enable high-performance and safety-aware control strategies for challenging real-world applications. Yet, for computational tractability,…

最优化与控制 · 数学 2024-09-17 Manish Prajapat , Amon Lahr , Johannes Köhler , Andreas Krause , Melanie N. Zeilinger

The process of calibrating computer models of natural phenomena is essential for applications in the physical sciences, where plenty of domain knowledge can be embedded into simulations and then calibrated against real observations. Current…

机器学习 · 计算机科学 2025-01-20 Rafael Oliveira , Dino Sejdinovic , David Howard , Edwin V. Bonilla

We present an adaptive approach to the construction of Gaussian process surrogates for Bayesian inference with expensive-to-evaluate forward models. Our method relies on the fully Bayesian approach to training Gaussian process models and…

机器学习 · 统计学 2018-10-01 Timur Takhtaganov , Juliane Müller

Gaussian process (GP) regression is a Bayesian nonparametric method for regression and interpolation, offering a principled way of quantifying the uncertainties of predicted function values. For the quantified uncertainties to be…

统计理论 · 数学 2025-08-22 Masha Naslidnyk , Motonobu Kanagawa , Toni Karvonen , Maren Mahsereci

A recent novel extension of multi-output Gaussian processes handles heterogeneous outputs assuming that each output has its own likelihood function. It uses a vector-valued Gaussian process prior to jointly model all likelihoods' parameters…

机器学习 · 统计学 2020-07-15 Juan-José Giraldo , Mauricio A. Álvarez

Adaptive sampling algorithms are modern and efficient methods that dynamically adjust the sample size throughout the optimization process. However, they may encounter difficulties in risk-averse settings, particularly due to the challenge…

最优化与控制 · 数学 2025-02-17 Sandra Pieraccini , Tommaso Vanzan

The popularity of Adaptive MCMC has been fueled on the one hand by its success in applications, and on the other hand, by mathematically appealing and computationally straightforward optimisation criteria for the Metropolis algorithm…

统计计算 · 统计学 2018-01-30 Cyril Chimisov , Krzysztof Latuszynski , Gareth Roberts

Driving under varying road conditions is challenging, especially for autonomous vehicles that must adapt in real-time to changes in the environment, e.g., rain, snow, etc. It is difficult to apply offline learning-based methods in these…

机器人学 · 计算机科学 2023-05-30 Tomáš Nagy , Ahmad Amine , Truong X. Nghiem , Ugo Rosolia , Zirui Zang , Rahul Mangharam

Biological systems are often modelled at different levels of abstraction depending on the particular aims/resources of a study. Such different models often provide qualitatively concordant predictions over specific parametrisations, but it…

机器学习 · 统计学 2016-05-10 Giulio Caravagna , Luca Bortolussi , Guido Sanguinetti

Generalized additive partial linear models (GAPLMs) are appealing for model interpretation and prediction. However, for GAPLMs, the covariates and the degree of smoothing in the nonparametric parts are often difficult to determine in…

统计方法学 · 统计学 2022-12-06 Ze Chen , Jun Liao , Wangli Xu , Yuhong Yang

\noindent Hyper-parameter selection is a central practical problem in modern machine learning, governing regularization strength, model capacity, and robustness choices. Cross-validation is often computationally prohibitive at scale, while…

机器学习 · 统计学 2025-12-24 Hedibert Lopes , Nick Polson , Vadim Sokolov

Deep Gaussian Processes (DGPs) are multi-layer, flexible extensions of Gaussian processes but their training remains challenging. Sparse approximations simplify the training but often require optimization over a large number of inducing…

机器学习 · 统计学 2021-07-20 Ayush Jain , P. K. Srijith , Mohammad Emtiyaz Khan

Due to the increasing complexity of technical systems, accurate first principle models can often not be obtained. Supervised machine learning can mitigate this issue by inferring models from measurement data. Gaussian process regression is…

系统与控制 · 电气工程与系统科学 2023-07-11 Armin Lederer , Jonas Umlauft , Sandra Hirche

By distributing the training process, local approximation reduces the cost of the standard Gaussian Process. An ensemble technique combines local predictions from Gaussian experts trained on different partitions of the data. Ensemble…

机器学习 · 计算机科学 2024-01-09 Hamed Jalali , Gjergji Kasneci

Gaussian processes (GP) provide a prior over functions and allow finding complex regularities in data. Gaussian processes are successfully used for classification/regression problems and dimensionality reduction. In this work we consider…

机器学习 · 计算机科学 2016-11-21 Pavel Izmailov , Dmitry Kropotov

This paper proposes a novel parameter selection strategy for kernel-based gradient descent (KGD) algorithms, integrating bias-variance analysis with the splitting method. We introduce the concept of empirical effective dimension to quantify…

机器学习 · 统计学 2026-03-05 Xiaotong Liu , Yunwen Lei , Xiangyu Chang , Shao-Bo Lin

Max-stable processes are increasingly widely used for modelling complex extreme events, but existing fitting methods are computationally demanding, limiting applications to a few dozen variables. $r$-Pareto processes are mathematically…

统计方法学 · 统计学 2017-06-14 Raphaël de Fondeville , Anthony C. Davison

Probabilistic regression models typically use the Maximum Likelihood Estimation or Cross-Validation to fit parameters. These methods can give an advantage to the solutions that fit observations on average, but they do not pay attention to…

应用统计 · 统计学 2022-05-24 Naoufal Acharki , Antoine Bertoncello , Josselin Garnier

Cross-validation is a common method for estimating the predictive performance of machine learning models. In a data-scarce regime, where one typically wishes to maximize the number of instances used for training the model, an approach…

统计方法学 · 统计学 2025-03-25 George I. Austin , Itsik Pe'er , Tal Korem