English
Related papers

Related papers: Green Machine Learning via Augmented Gaussian Proc…

200 papers

With the advent of artificial intelligence and machine learning, various domains of science and engineering communities have leveraged data-driven surrogates to model complex systems through fusing numerous sources of information (data)…

We propose a practical Bayesian optimization method using Gaussian process regression, of which the marginal likelihood is maximized where the number of model selection steps is guided by a pre-defined threshold. Since Bayesian optimization…

Machine Learning · Statistics 2020-10-19 Jungtaek Kim , Seungjin Choi

Gaussian process regression is a popular Bayesian framework for surrogate modeling of expensive data sources. As part of a broader effort in scientific machine learning, many recent works have incorporated physical constraints or other a…

Machine Learning · Computer Science 2021-01-07 Laura Swiler , Mamikon Gulian , Ari Frankel , Cosmin Safta , John Jakeman

Gaussian Process (GP) emulators are widely used to approximate complex computer model behaviour across the input space. Motivated by the problem of coupling computer models, recently progress has been made in the theory of the analysis of…

Applications · Statistics 2022-04-20 Victoria Volodina , Nikki Sonenberg , Peter Challenor , Jim Q. Smith

Bayesian optimization is an effective methodology for the global optimization of functions with expensive evaluations. It relies on querying a distribution over functions defined by a relatively cheap surrogate model. An accurate model for…

Operating large-scale scientific facilities often requires fast tuning and robust control in a high dimensional space. In this paper we introduce a new physics-informed optimization algorithm based on Gaussian process regression. Our method…

Accelerator Physics · Physics 2020-09-09 A. Hanuka , J. Duris , J. Shtalenkova , D. Kennedy , A. Edelen , D. Ratner , X. Huang

Bilevel optimization, a hierarchical mathematical framework where one optimization problem is nested within another, has emerged as a powerful tool for modeling complex decision-making processes in various fields such as economics,…

Machine Learning · Computer Science 2024-12-25 Omer Ekmekcioglu , Nursen Aydin , Juergen Branke

In the post-Dennard era, optimizing embedded systems requires navigating complex trade-offs between energy efficiency and latency. Traditional heuristic tuning is often inefficient in such high-dimensional, non-smooth landscapes. In this…

Hardware Architecture · Computer Science 2026-02-02 Zheyuan Hu , Yifei Shi

The accelerating pace and expanding scope of materials discovery demand optimization frameworks that efficiently navigate vast, nonlinear design spaces while judiciously allocating limited evaluation resources. We present a cost-aware,…

Bayesian optimization (BO) is an effective technique for black-box optimization. However, its applicability is typically limited to moderate-budget problems due to the cubic complexity of fitting the Gaussian process (GP) surrogate model.…

Machine Learning · Statistics 2025-10-13 Qiyu Wei , Haowei Wang , Zirui Cao , Songhao Wang , Richard Allmendinger , Mauricio A Álvarez

Acquiring a substantial number of data points for training accurate machine learning (ML) models is a big challenge in scientific fields where data collection is resource-intensive. Here, we propose a novel approach for constructing a…

Machine Learning · Computer Science 2025-05-07 M. R. Mahani , Igor A. Nechepurenko , Yasmin Rahimof , Andreas Wicht

Flexible and scalable decentralized learning solutions are fundamentally important in the application of multi-agent systems. While several recent approaches introduce (ensembles of) kernel machines in the distributed setting, Bayesian…

Machine Learning · Computer Science 2025-02-11 Fernando Llorente , Daniel Waxman , Petar M. Djurić

A popular strategy for active learning is to specifically target a reduction in epistemic uncertainty, since aleatoric uncertainty is often considered as being intrinsic to the system of interest and therefore not reducible. Yet,…

Methodology · Statistics 2024-12-12 Jake Thomas , Jeremie Houssineau

With the significant advancement in quantum computation in the past couple of decades, the exploration of machine-learning subroutines using quantum strategies has become increasingly popular. Gaussian process regression is a widely used…

Quantum Physics · Physics 2018-03-07 Siddhartha Das , George Siopsis , Christian Weedbrook

Modern day engineering problems are ubiquitously characterized by sophisticated computer codes that map parameters or inputs to an underlying physical process. In other situations, experimental setups are used to model the physical process…

Machine Learning · Statistics 2021-07-02 Raphael Gautier , Piyush Pandita , Sayan Ghosh , Dimitri Mavris

Learning dynamical models from data is not only fundamental but also holds great promise for advancing principle discovery, time-series prediction, and controller design. Among various approaches, Gaussian Process State-Space Models…

Machine Learning · Computer Science 2025-10-20 Tengjie Zheng , Haipeng Chen , Lin Cheng , Shengping Gong , Xu Huang

We propose a dynamical scaling analysis improved by a deep learning approach. While Gaussian process regression has been widely employed for estimating scaling parameters, its computational cost for parameter optimization becomes a…

Statistical Mechanics · Physics 2026-05-18 Yusuke Terasawa , Yukiyasu Ozeki

This work studies how an AI-controlled dog-fighting agent with tunable decision-making parameters can learn to optimize performance against an intelligent adversary, as measured by a stochastic objective function evaluated on simulated…

Machine Learning · Computer Science 2017-08-01 Brett W. Israelsen , Nisar Ahmed , Kenneth Center , Roderick Green , Winston Bennett

Multi-fidelity optimization employs surrogate models that integrate information from varying levels of fidelity to guide efficient exploration of complex design spaces while minimizing the reliance on (expensive) high-fidelity objective…

We consider a Gaussian process formulation of the multiple kernel learning problem. The goal is to select the convex combination of kernel matrices that best explains the data and by doing so improve the generalisation on unseen data.…

Machine Learning · Statistics 2011-10-25 Cedric Archambeau , Francis Bach