English
Related papers

Related papers: Gradient-based Active Learning with Gaussian Proce…

200 papers

We consider the problem of active learning for global sensitivity analysis of expensive black-box functions. Our aim is to efficiently learn the importance of different input variables, e.g., in vehicle safety experimentation, we study the…

Machine Learning · Computer Science 2024-10-22 Syrine Belakaria , Benjamin Letham , Janardhan Rao Doppa , Barbara Engelhardt , Stefano Ermon , Eytan Bakshy

This paper explores the application of active learning strategies to adaptively learn Sobol indices for global sensitivity analysis. We demonstrate that active learning for Sobol indices poses unique challenges due to the definition of the…

Machine Learning · Computer Science 2023-08-29 Mohit Chauhan , Mariel Ojeda-Tuz , Ryan Catarelli , Kurtis Gurley , Dimitrios Tsapetis , Michael D. Shields

Active learning of Gaussian process (GP) surrogates has been useful for optimizing experimental designs for physical/computer simulation experiments, and for steering data acquisition schemes in machine learning. In this paper, we develop a…

Machine Learning · Computer Science 2025-09-10 Chiwoo Park , Robert Waelder , Bonggwon Kang , Benji Maruyama , Soondo Hong , Robert Gramacy

Many fields of science and engineering rely on running simulations with complex and computationally expensive models to understand the involved processes in the system of interest. Nevertheless, the high cost involved hamper reliable and…

Machine Learning · Computer Science 2019-12-16 Daniel Heestermans Svendsen , Luca Martino , Gustau Camps-Valls

In recent years, active subspace methods (ASMs) have become a popular means of performing subspace sensitivity analysis on black-box functions. Naively applied, however, ASMs require gradient evaluations of the target function. In the event…

Machine Learning · Statistics 2020-09-22 Nathan Wycoff , Mickael Binois , Stefan M. Wild

Running a reliability analysis on engineering problems involving complex numerical models can be computationally very expensive, requiring advanced simulation methods to reduce the overall numerical cost. Gaussian process based active…

Machine Learning · Statistics 2020-12-01 Morgane Menz , Sylvain Dubreuil , Jérôme Morio , Christian Gogu , Nathalie Bartoli , Marie Chiron

Complex computer codes are widely used in science and engineering to model physical phenomena. Furthermore, it is common that they have a large number of input parameters. Global sensitivity analysis aims to identify those which have the…

Statistics Theory · Mathematics 2013-07-09 Loic Le Gratiet , Claire Cannamela , Bertrand Iooss

Generating simulated training data needed for constructing sufficiently accurate surrogate models to be used for efficient optimization or parameter identification can incur a huge computational effort in the offline phase. We consider a…

Numerical Analysis · Mathematics 2024-04-03 Phillip Semler , Martin Weiser

This paper introduces an active learning framework for manifold Gaussian Process (GP) regression, combining manifold learning with strategic data selection to improve accuracy in high-dimensional spaces. Our method jointly optimizes a…

Machine Learning · Statistics 2026-05-12 Yuanxing Cheng , Lulu Kang , Yiwei Wang , Chun Liu

Deep Gaussian processes (DGPs) are increasingly popular as predictive models in machine learning (ML) for their non-stationary flexibility and ability to cope with abrupt regime changes in training data. Here we explore DGPs as surrogates…

Methodology · Statistics 2021-08-27 Annie Sauer , Robert B. Gramacy , David Higdon

High-fidelity simulations and physical experiments are essential for engineering analysis and design, yet their high cost often makes two critical tasks--global sensitivity analysis (GSA) and optimization--prohibitively expensive. This…

Machine Learning · Computer Science 2026-01-01 Bach Do , Nafeezat A. Ajenifuja , Taiwo A. Adebiyi , Ruda Zhang

This paper develops methodology for local sensitivity analysis based on directional derivatives associated with spatial processes. Formal gradient analysis for spatial processes was elaborated in previous papers, focusing on distribution…

Statistics Theory · Mathematics 2015-03-31 Maria A. Terres , Alan E. Gelfand

In many areas of science and engineering, discovering the governing differential equations from the noisy experimental data is an essential challenge. It is also a critical step in understanding the physical phenomena and prediction of the…

Methodology · Statistics 2026-05-12 Jiuhai Chen , Lulu Kang , Guang Lin

Variance-based global sensitivity analysis (GSA) can provide a wealth of information when applied to complex models. A well-known Achilles' heel of this approach is its computational cost which often renders it unfeasible in practice. An…

Numerical Analysis · Mathematics 2026-01-08 John Darges , Alen Alexanderian , Pierre Gremaud

Gaussian Process (GP) models are a powerful tool in probabilistic machine learning with a solid theoretical foundation. Thanks to current advances, modeling complex data with GPs is becoming increasingly feasible, which makes them an…

Machine Learning · Computer Science 2025-03-04 Sarem Seitz

The variance-based method of Sobol sensitivity indices is very popular among practitioners due to its efficiency and easiness of interpretation. However, for high-dimensional models the direct application of this method can be very time…

Statistics Theory · Mathematics 2016-05-26 S. Kucherenko , S. Song

Active learning of physical systems must commonly respect practical safety constraints, which restricts the exploration of the design space. Gaussian Processes (GPs) and their calibrated uncertainty estimations are widely used for this…

Machine Learning · Computer Science 2024-04-16 Jörn Tebbe , Christoph Zimmer , Ansgar Steland , Markus Lange-Hegermann , Fabian Mies

We consider the estimation of sensitivity indices based on divergence measures such as Hellinger distance. For sensitivity analysis of complex models, these divergence-based indices can be estimated by Monte-Carlo sampling (MCS) in…

Statistics Theory · Mathematics 2019-09-18 A. W. Eggels , D. T. Crommelin

In this paper, we propose a novel sequential data-driven method for dealing with equilibrium based chemical simulations, which can be seen as a specific machine learning approach called active learning. The underlying idea of our approach…

Machine Learning · Statistics 2024-01-26 Mary Savino , Céline Lévy-Leduc , Marc Leconte , Benoit Cochepin

We present an implementation of model-based online reinforcement learning (RL) for continuous domains with deterministic transitions that is specifically designed to achieve low sample complexity. To achieve low sample complexity, since the…

Artificial Intelligence · Computer Science 2012-02-01 Tobias Jung , Peter Stone
‹ Prev 1 2 3 10 Next ›