English
Related papers

Related papers: Gradient-based Active Learning with Gaussian Proce…

200 papers

Active learning methods for emulating complex computer models that rely on stationary Gaussian processes tend to produce design points that uniformly fill the entire experimental region, which can be wasteful for functions which vary only…

Methodology · Statistics 2025-07-16 Shangkun Wang , V. Roshan Joseph

Global sensitivity analysis aims at quantifying the impact of input variability onto the variation of the response of a computational model. It has been widely applied to deterministic simulators, for which a set of input parameters has a…

Computation · Statistics 2021-06-01 X. Zhu , B. Sudret

Gaussian process (GP) regression is a popular surrogate modeling tool for computer simulations in engineering and scientific domains. However, it often struggles with high computational costs and low prediction accuracy when the simulation…

Machine Learning · Computer Science 2025-02-25 Lulu Kang , Minshen Xu

The saddle point (SP) calculation is a grand challenge for computationally intensive energy function in computational chemistry area, where the saddle point may represent the transition state (TS). The traditional methods need to evaluate…

Machine Learning · Statistics 2022-11-08 Shuting Gu , Hongqiao Wang , Xiang Zhou

We present a novel adaptation of active learning to graph-based semi-supervised learning (SSL) under non-Gaussian Bayesian models. We present an approximation of non-Gaussian distributions to adapt previously Gaussian-based acquisition…

Machine Learning · Statistics 2020-07-23 Kevin Miller , Hao Li , Andrea L. Bertozzi

Despite the availability of ever more data enabled through modern sensor and computer technology, it still remains an open problem to learn dynamical systems in a sample-efficient way. We propose active learning strategies that leverage…

Machine Learning · Computer Science 2020-12-08 Mona Buisson-Fenet , Friedrich Solowjow , Sebastian Trimpe

Active learning in computer experiments aims at allocating resources in an intelligent manner based on the already observed data to satisfy certain objectives such as emulating or optimizing a computationally expensive function. There are…

Methodology · Statistics 2025-01-24 Difan Song , V. Roshan Joseph

Re-training a deep learning model each time a single data point receives a new label is impractical due to the inherent complexity of the training process. Consequently, existing active learning (AL) algorithms tend to adopt a batch-based…

Machine Learning · Computer Science 2023-12-19 Yunpyo An , Suyeong Park , Kwang In Kim

We investigate the use of derivative information for Batch Active Learning in Gaussian Process regression models. The proposed approach employs the predictive covariance matrix for selection of data batches to exploit full correlation of…

Machine Learning · Computer Science 2024-08-06 Hon Sum Alec Yu , Christoph Zimmer , Duy Nguyen-Tuong

The method of derivative based global sensitivity measures (DGSM) has recently become popular among practitioners. It has a strong link with the Morris screening method and Sobol' sensitivity indices and has several advantages over them.…

Statistics Theory · Mathematics 2023-12-05 Serge Kucherenko , Bertrand Iooss

Estimation of the response probability distributions of computer simulators in the presence of randomness is a crucial task in many fields. However, achieving this task with guaranteed accuracy remains an open computational challenge,…

Computation · Statistics 2024-09-04 Chao Dang , Marcos A. Valdebenito , Nataly A. Manque , Jun Xu , Matthias G. R. Faes

We introduce a novel adaptive Gaussian Process Regression (GPR) methodology for efficient construction of surrogate models for Bayesian inverse problems with expensive forward model evaluations. An adaptive design strategy focuses on…

Numerical Analysis · Mathematics 2024-05-01 Paolo Villani , Jörg Unger , Martin Weiser

Gaussian process (GP) regression provides a strategy for accelerating saddle point searches on high-dimensional energy surfaces by reducing the number of times the energy and its derivatives with respect to atomic coordinates need to be…

Chemical Physics · Physics 2025-12-03 Rohit Goswami , Hannes Jónsson

Active learning is a subfield of machine learning that focuses on improving the data collection efficiency of expensive-to-evaluate systems. Especially, active learning integrated surrogate modeling has shown remarkable performance in…

Machine Learning · Computer Science 2023-04-19 Cheolhei Lee , Kaiwen Wang , Jianguo Wu , Wenjun Cai , Xiaowei Yue

Machine learning models are widely regarded as a way forward to tackle multi-query challenges that arise once expensive black-box simulations such as computational fluid dynamics are investigated. However, ensuring the desired level of…

Machine Learning · Computer Science 2026-01-30 Jigar Parekh , Philipp Bekemeyer

Multi-output regression problems are commonly encountered in science and engineering. In particular, multi-output Gaussian processes have been emerged as a promising tool for modeling these complex systems since they can exploit the…

Machine Learning · Computer Science 2022-03-29 Cen-You Li , Barbara Rakitsch , Christoph Zimmer

We propose an active learning method for discovering low-dimensional structure in high-dimensional Gaussian process (GP) tasks. Such problems are increasingly frequent and important, but have hitherto presented severe practical…

Machine Learning · Statistics 2013-10-28 Roman Garnett , Michael A. Osborne , Philipp Hennig

Modern day engineering problems are ubiquitously characterized by sophisticated computer codes that map parameters or inputs to an underlying physical process. In other situations, experimental setups are used to model the physical process…

Machine Learning · Statistics 2021-07-02 Raphael Gautier , Piyush Pandita , Sayan Ghosh , Dimitri Mavris

Dimension reduction techniques have long been an important topic in statistics, and active subspaces (AS) have received much attention this past decade in the computer experiments literature. The most common approach towards estimating the…

Methodology · Statistics 2024-07-23 Kellin N. Rumsey , Devin Francom , Scott Vander Wiel

We present prompt distribution learning for effectively adapting a pre-trained vision-language model to address downstream recognition tasks. Our method not only learns low-bias prompts from a few samples but also captures the distribution…

Computer Vision and Pattern Recognition · Computer Science 2022-05-09 Yuning Lu , Jianzhuang Liu , Yonggang Zhang , Yajing Liu , Xinmei Tian