中文
相关论文

相关论文: Two Gaussian Approaches to Black-Box Optomization

200 篇论文

We focus on the challenge of finding a diverse collection of quality solutions on complex continuous domains. While quality diver-sity (QD) algorithms like Novelty Search with Local Competition (NSLC) and MAP-Elites are designed to generate…

机器学习 · 计算机科学 2020-05-08 Matthew C. Fontaine , Julian Togelius , Stefanos Nikolaidis , Amy K. Hoover

Gaussian process regression is widely applied in computational science and engineering for surrogate modeling owning to its kernel-based and probabilistic nature. In this work, we propose a Bayesian approach that integrates the variability…

机器学习 · 计算机科学 2025-01-03 Dongwei Ye , Weihao Yan , Christoph Brune , Mengwu Guo

We consider a modification of the covariance function in Gaussian processes to correctly account for known linear constraints. By modelling the target function as a transformation of an underlying function, the constraints are explicitly…

机器学习 · 统计学 2017-09-20 Carl Jidling , Niklas Wahlström , Adrian Wills , Thomas B. Schön

Bayesian graphical models are a useful tool for understanding dependence relationships among many variables, particularly in situations with external prior information. In high-dimensional settings, the space of possible graphs becomes…

机器学习 · 统计学 2019-02-07 Zehang Richard Li , Tyler H. McCormick

Gaussian process regression is a well-established Bayesian machine learning method. We propose a new approach to Gaussian process regression using quantum kernels based on parameterized quantum circuits. By employing a hardware-efficient…

量子物理 · 物理学 2024-02-06 Frederic Rapp , Marco Roth

While stochastic variational inference is relatively well known for scaling inference in Bayesian probabilistic models, related methods also offer ways to circumnavigate the approximation of analytically intractable expectations. The key…

机器学习 · 统计学 2015-09-08 David A. Knowles

Gaussian processes are popular and flexible models for spatial, temporal, and functional data, but they are computationally infeasible for large datasets. We discuss Gaussian-process approximations that use basis functions at multiple…

统计方法学 · 统计学 2020-12-22 Matthias Katzfuss , Wenlong Gong

Bayesian optimization is a powerful paradigm to optimize black-box functions based on scarce and noisy data. Its data efficiency can be further improved by transfer learning from related tasks. While recent transfer models meta-learn a…

In this paper we present two different variants of method for symmetric matrix inversion, based on modified Gaussian elimination. Both methods avoid computation of square roots and have a reduced machine time's spending. Further, both of…

数学软件 · 计算机科学 2015-04-28 Anton Kochnev , Nicolai Savelov

One of the most promising applications of near-term quantum computing is the simulation of quantum systems, a classically intractable task. Quantum simulation requires computationally expensive matrix exponentiation; Trotter-Suzuki…

神经与进化计算 · 计算机科学 2019-04-24 Benjamin D. M. Jones , George O. O'Brien , David R. White , Earl T. Campbell , John A. Clark

Bayesian optimization is a powerful global optimization technique for expensive black-box functions. One of its shortcomings is that it requires auxiliary optimization of an acquisition function at each iteration. This auxiliary…

机器学习 · 统计学 2014-02-28 Ziyu Wang , Babak Shakibi , Lin Jin , Nando de Freitas

Evolution strategies (ESs) are zeroth-order stochastic black-box optimization heuristics invariant to monotonic transformations of the objective function. They evolve a multivariate normal distribution, from which candidate solutions are…

数值分析 · 数学 2022-02-09 Youhei Akimoto , Anne Auger , Tobias Glasmachers , Daiki Morinaga

Black-box optimization problems, which are common in many real-world applications, require optimization through input-output interactions without access to internal workings. This often leads to significant computational resources being…

神经与进化计算 · 计算机科学 2024-03-25 Hao Hao , Xiaoqun Zhang , Aimin Zhou

Bayesian optimization is a popular method for solving the problem of global optimization of an expensive-to-evaluate black-box function. It relies on a probabilistic surrogate model of the objective function, upon which an acquisition…

机器学习 · 统计学 2022-06-22 Jungtaek Kim , Seungjin Choi , Minsu Cho

Gaussian processes~(Kriging) are interpolating data-driven models that are frequently applied in various disciplines. Often, Gaussian processes are trained on datasets and are subsequently embedded as surrogate models in optimization…

We introduce a novel way to combine boosting with Gaussian process and mixed effects models. This allows for relaxing, first, the zero or linearity assumption for the prior mean function in Gaussian process and grouped random effects models…

机器学习 · 计算机科学 2024-11-06 Fabio Sigrist

We consider computationally expensive blackbox optimization problems and present a method that employs surrogate models and concurrent computing at the search step of the mesh adaptive direct search (MADS) algorithm. Specifically, we solve…

最优化与控制 · 数学 2021-07-28 Bastien Talgorn , Stéphane Alarie , Michael Kokkolaras

Gaussian graphical models are of great interest in statistical learning. Because the conditional independencies between different nodes correspond to zero entries in the inverse covariance matrix of the Gaussian distribution, one can learn…

机器学习 · 计算机科学 2010-11-02 Katya Scheinberg , Shiqian Ma , Donald Goldfarb

The state-of-the-art linked Gaussian process offers a way to build analytical emulators for systems of computer models. We generalize the closed form expressions for the linked Gaussian process under the squared exponential kernel to a…

统计方法学 · 统计学 2021-02-09 Deyu Ming , Serge Guillas

Gaussian Processes are widely used for regression tasks. A known limitation in the application of Gaussian Processes to regression tasks is that the computation of the solution requires performing a matrix inversion. The solution also…

机器学习 · 计算机科学 2017-08-22 Sourish Das , Sasanka Roy , Rajiv Sambasivan