中文
相关论文

相关论文: Multiscale Gaussian Process Level Set Estimation

200 篇论文

Gaussian process (GP) regression provides a strategy for accelerating saddle point searches on high-dimensional energy surfaces by reducing the number of times the energy and its derivatives with respect to atomic coordinates need to be…

化学物理 · 物理学 2025-12-03 Rohit Goswami , Hannes Jónsson

The optimization of expensive-to-evaluate black-box functions over combinatorial structures is an ubiquitous task in machine learning, engineering and the natural sciences. The combinatorial explosion of the search space and costly…

机器学习 · 统计学 2018-10-11 Ricardo Baptista , Matthias Poloczek

We are often interested in identifying the feasible subset of a decision space under multiple constraints to permit effective design exploration. If determining feasibility required computationally expensive simulations, the cost of…

机器学习 · 计算机科学 2020-06-25 Alma Rahat , Michael Wood

Variational inference techniques based on inducing variables provide an elegant framework for scalable posterior estimation in Gaussian process (GP) models. Besides enabling scalability, one of their main advantages over sparse…

机器学习 · 统计学 2021-02-24 Simone Rossi , Markus Heinonen , Edwin V. Bonilla , Zheyang Shen , Maurizio Filippone

Maximizing high-dimensional, non-convex functions through noisy observations is a notoriously hard problem, but one that arises in many applications. In this paper, we tackle this challenge by modeling the unknown function as a sample from…

机器学习 · 计算机科学 2012-07-03 Bo Chen , Rui Castro , Andreas Krause

Many contemporary machine learning models require extensive tuning of hyperparameters to perform well. A variety of methods, such as Bayesian optimization, have been developed to automate and expedite this process. However, tuning remains…

机器学习 · 计算机科学 2020-02-25 Setareh Ariafar , Zelda Mariet , Ehsan Elhamifar , Dana Brooks , Jennifer Dy , Jasper Snoek

Both experimental and computational methods for the exploration of structure, functionality, and properties of materials often necessitate the search across broad parameter spaces to discover optimal experimental conditions and regions of…

计算物理 · 物理学 2021-08-31 Maxim Ziatdinov , Ayana Ghosh , Sergei V. Kalinin

This paper introduces an active learning framework for manifold Gaussian Process (GP) regression, combining manifold learning with strategic data selection to improve accuracy in high-dimensional spaces. Our method jointly optimizes a…

机器学习 · 统计学 2026-05-12 Yuanxing Cheng , Lulu Kang , Yiwei Wang , Chun Liu

The level set estimation problem seeks to identify regions within a set of candidate points where an unknown and costly to evaluate function's value exceeds a specified threshold, providing an efficient alternative to exhaustive evaluations…

机器学习 · 统计学 2025-03-27 Hideaki Ishibashi , Kota Matsui , Kentaro Kutsukake , Hideitsu Hino

Heteroscedastic regression considering the varying noises among observations has many applications in the fields like machine learning and statistics. Here we focus on the heteroscedastic Gaussian process (HGP) regression which integrates…

机器学习 · 统计学 2020-01-22 Haitao Liu , Yew-Soon Ong , Jianfei Cai

We here consider the subset simulation method which approaches a failure event using a decreasing sequence of nested intermediate failure events. The method resembles importance sampling, which actively explores a probability space by…

统计计算 · 统计学 2020-03-16 Kenan Šehić , Mirza Karamehmedović

Gaussian processes (GPs) are a class of Kernel methods that have shown to be very useful in geoscience and remote sensing applications for parameter retrieval, model inversion, and emulation. They are widely used because they are simple,…

机器学习 · 计算机科学 2020-05-21 J. Emmanuel Johnson , Valero Laparra , Gustau Camps-Valls

Optimization of expensive computer models with the help of Gaussian process emulators in now commonplace. However, when several (competing) objectives are considered, choosing an appropriate sampling strategy remains an open question. We…

最优化与控制 · 数学 2013-10-03 Victor Picheny

Gaussian Process (GP) kernels are central to Bayesian optimization (BO), yet designing effective kernels for high-dimensional problems still relies on extensive manual engineering. Existing automated approaches struggle in high dimensions…

机器学习 · 计算机科学 2026-05-21 Taeyoung Yun , Woocheol Shin , Inhyuck Song , Jaewoo Lee , Jinkyoo Park

In this paper, we consider the challenge of maximizing an unknown function f for which evaluations are noisy and are acquired with high cost. An iterative procedure uses the previous measures to actively select the next estimation of f…

机器学习 · 计算机科学 2013-09-03 Emile Contal , David Buffoni , Alexandre Robicquet , Nicolas Vayatis

Gaussian processes (GP) are a widely used model for regression problems in supervised machine learning. Implementation of GP regression typically requires $O(n^3)$ logic gates. We show that the quantum linear systems algorithm [Harrow et…

量子物理 · 物理学 2019-05-29 Zhikuan Zhao , Jack K. Fitzsimons , Joseph F. Fitzsimons

Local Bayesian optimization is a promising practical approach to solve the high dimensional black-box function optimization problem. Among them is the approximated gradient class of methods, which implements a strategy similar to gradient…

机器学习 · 计算机科学 2024-05-27 Zheyi Fan , Wenyu Wang , Szu Hui Ng , Qingpei Hu

Machine learning models play a vital role in time series forecasting. These models, however, often overlook an important element: point uncertainty estimates. Incorporating these estimates is crucial for effective risk management, informed…

机器学习 · 计算机科学 2024-09-11 Leonid Erlygin , Vladimir Zholobov , Valeriia Baklanova , Evgeny Sokolovskiy , Alexey Zaytsev

One way to reduce the time of conducting optimization studies is to evaluate designs in parallel rather than just one-at-a-time. For expensive-to-evaluate black-boxes, batch versions of Bayesian optimization have been proposed. They work by…

最优化与控制 · 数学 2023-04-04 Mickael Binois , Nicholson Collier , Jonathan Ozik

In this letter, we address the problem of estimating Gaussian noise level from the trained dictionaries in update stage. We first provide rigorous statistical analysis on the eigenvalue distributions of a sample covariance matrix. Then we…

信号处理 · 电气工程与系统科学 2017-12-12 Rui Chen , Changshui Yang , Huizhu Jia , Xiaodong Xie