English
Related papers

Related papers: Green Machine Learning via Augmented Gaussian Proc…

200 papers

Gaussian processes (GPs) are powerful but computationally expensive machine learning models, requiring an estimate of the kernel covariance matrix for every prediction. In large and complex domains, such as graphs, sets, or images, the…

Machine Learning · Computer Science 2022-04-22 Alessandro Tibo , Thomas Dyhre Nielsen

We consider chance constrained optimization where it is sought to optimize a function while complying with constraints, both of which are affected by uncertainties. The high computational cost of realistic simulations strongly limits the…

Optimization and Control · Mathematics 2022-04-18 Julien Pelamatti , Rodolphe Le Riche , Céline Helbert , Christophette Blanchet-Scalliet

Deploying multiple robots for target search and tracking has many practical applications, yet the challenge of planning over unknown or partially known targets remains difficult to address. With recent advances in deep learning, intelligent…

Robotics · Computer Science 2023-08-30 Jigang Kim , Dohyun Jang , H. Jin Kim

Gaussian processes (GPs) are Bayesian nonparametric models for function approximation with principled predictive uncertainty estimates. Deep Gaussian processes (DGPs) are multilayer generalizations of GPs that can represent complex marginal…

Machine Learning · Statistics 2024-09-20 Qiuxian Meng , Yongyou Zhang

Gaussian processes are one of the dominant approaches in Bayesian learning. Although the approach has been applied to numerous problems with great success, it has a few fundamental limitations. Multiple methods in literature have addressed…

Machine Learning · Computer Science 2021-06-24 Kalvik Jakkala

Gaussian processes regression models are an appealing machine learning method as they learn expressive non-linear models from exemplar data with minimal parameter tuning and estimate both the mean and covariance of unseen points. However,…

Machine Learning · Computer Science 2020-08-25 Vladimir Joukov , Dana Kulić

In order to scale standard Gaussian process (GP) regression to large-scale datasets, aggregation models employ factorized training process and then combine predictions from distributed experts. The state-of-the-art aggregation models,…

Machine Learning · Statistics 2018-06-05 Haitao Liu , Jianfei Cai , Yi Wang , Yew-Soon Ong

We propose an efficient transfer Bayesian optimization method, which finds the maximum of an expensive-to-evaluate black-box function by using data on related optimization tasks. Our method uses auxiliary information that represents the…

Machine Learning · Statistics 2019-09-18 Tomoharu Iwata , Takuma Otsuka

In biomanufacturing, developing an accurate model to simulate the complex dynamics of bioprocesses is an important yet challenging task. This is partially due to the uncertainty associated with bioprocesses, high data acquisition cost, and…

Machine Learning · Computer Science 2022-11-29 Yuan Sun , Winton Nathan-Roberts , Tien Dung Pham , Ellen Otte , Uwe Aickelin

Bayesian optimization is a powerful tool to optimize a black-box function, the evaluation of which is time-consuming or costly. In this paper, we propose a new approach to Bayesian optimization called GP-MGC, which maximizes multiscale…

Machine Learning · Computer Science 2021-03-18 Takuya Kanazawa

The graphics processing unit (GPU) has emerged as a powerful and cost effective processor for general performance computing. GPUs are capable of an order of magnitude more floating-point operations per second as compared to modern central…

Computation · Statistics 2012-07-24 Mark Franey , Pritam Ranjan , Hugh Chipman

Multiscale modeling is a systematic approach to describe the behavior of complex systems by coupling models from different scales. The approach has been demonstrated to be very effective in areas of science as diverse as materials science,…

Computational Physics · Physics 2020-01-08 Ting Wang , Kenneth W. Leiter , Petr Plechac , Jaroslaw Knap

Data sets are growing in complexity thanks to the increasing facilities we have nowadays to both generate and store data. This poses many challenges to machine learning that are leading to the proposal of new methods and paradigms, in order…

Machine Learning · Computer Science 2018-12-04 Irene Córdoba , Concha Bielza , Pedro Larrañaga

Adaptive learning is necessary for non-stationary environments where the learning machine needs to forget past data distribution. Efficient algorithms require a compact model update to not grow in computational burden with the incoming data…

Machine Learning · Computer Science 2023-07-11 Vanessa Gómez-Verdejo , Emilio Parrado-Hernández , Manel Martínez-Ramón

In this paper, we propose an active learning algorithm and models which can gradually learn individual's preference through pairwise comparisons. The active learning scheme aims at finding individual's most preferred choice with minimized…

Machine Learning · Statistics 2018-05-07 Jie Yang , Diego Klabjan

The Gaussian process (GP) regression can be severely biased when the data are contaminated by outliers. This paper presents a new robust GP regression algorithm that iteratively trims the most extreme data points. While the new algorithm…

Machine Learning · Computer Science 2021-06-15 Zhao-Zhou Li , Lu Li , Zhengyi Shao

Multi-fidelity modeling and calibration are data fusion tasks that ubiquitously arise in engineering design. In this paper, we introduce a novel approach based on latent-map Gaussian processes (LMGPs) that enables efficient and accurate…

Machine Learning · Statistics 2022-01-17 Nicholas Oune , Jonathan Tammer Eweis-Labolle , Ramin Bostanabad

Gaussian processes~(Kriging) are interpolating data-driven models that are frequently applied in various disciplines. Often, Gaussian processes are trained on datasets and are subsequently embedded as surrogate models in optimization…

Optimization and Control · Mathematics 2024-01-17 Artur M. Schweidtmann , Dominik Bongartz , Daniel Grothe , Tim Kerkenhoff , Xiaopeng Lin , Jaromil Najman , Alexander Mitsos

High-fidelity complex engineering simulations are highly predictive, but also computationally expensive and often require substantial computational efforts. The mitigation of computational burden is usually enabled through parallelism in…

Machine Learning · Statistics 2021-02-08 Anh Tran , Mike Eldred , Tim Wildey , Scott McCann , Jing Sun , Robert J. Visintainer

Meta-learning is a powerful approach that exploits historical data to quickly solve new tasks from the same distribution. In the low-data regime, methods based on the closed-form posterior of Gaussian processes (GP) together with Bayesian…