中文
相关论文

相关论文: Practical Transfer Learning for Bayesian Optimizat…

200 篇论文

Bayesian Optimization is the state of the art technique for the optimization of black boxes, i.e., functions where we do not have access to their analytical expression nor its gradients, they are expensive to evaluate and its evaluation is…

人工智能 · 计算机科学 2021-01-13 Eduardo C. Garrido Merchán , Luis C. Jariego Pérez

Machine learning algorithms have been used widely in various applications and areas. To fit a machine learning model into different problems, its hyper-parameters must be tuned. Selecting the best hyper-parameter configuration for machine…

机器学习 · 计算机科学 2022-10-06 Li Yang , Abdallah Shami

Inferring viscoelasticity parameters is a key challenge that often leads to non-unique solutions when fitting rheological data. In this context, we propose a machine learning approach that utilizes Bayesian optimization for parameter…

软凝聚态物质 · 物理学 2025-02-27 Isaac Y. Miranda-Valdez , Tero Mäkinen , Juha Koivisto , Mikko J. Alava

Gaussian process regression is a well-established Bayesian machine learning method. We propose a new approach to Gaussian process regression using quantum kernels based on parameterized quantum circuits. By employing a hardware-efficient…

量子物理 · 物理学 2024-02-06 Frederic Rapp , Marco Roth

Bayesian optimization is normally performed within fixed variable bounds. In cases like hyperparameter tuning for machine learning algorithms, setting the variable bounds is not trivial. It is hard to guarantee that any fixed bounds will…

最优化与控制 · 数学 2020-01-15 Wei Chen , Mark Fuge

We use the PAC-Bayesian theory for the setting of learning-to-optimize. To the best of our knowledge, we present the first framework to learn optimization algorithms with provable generalization guarantees (PAC-Bayesian bounds) and explicit…

机器学习 · 计算机科学 2025-02-26 Michael Sucker , Jalal Fadili , Peter Ochs

We provide a method to solve optimization problem when objective function is a complex stochastic simulator of an urban transportation system. To reach this goal, a Bayesian optimization framework is introduced. We show how the choice of…

统计计算 · 统计学 2019-01-15 Laura Schultz , Vadim Sokolov

This paper considers a distributed adaptive optimization problem, where all agents only have access to their local cost functions with a common unknown parameter, whereas they mean to collaboratively estimate the true parameter and find the…

最优化与控制 · 数学 2025-09-03 Yaqun Yang , Jinlong Lei , Guanghui Wen , Yiguang Hong

Bayesian estimation is a powerful theoretical paradigm for the operation of quantum sensors. However, the Bayesian method for statistical inference generally suffers from demanding calibration requirements that have so far restricted its…

量子物理 · 物理学 2021-09-22 Samuel P. Nolan , Augusto Smerzi , Luca Pezzè

\noindent Hyper-parameter selection is a central practical problem in modern machine learning, governing regularization strength, model capacity, and robustness choices. Cross-validation is often computationally prohibitive at scale, while…

机器学习 · 统计学 2025-12-24 Hedibert Lopes , Nick Polson , Vadim Sokolov

Transfer learning has received a lot of attention in the machine learning community over the last years, and several effective algorithms have been developed. However, relatively little is known about their theoretical properties,…

机器学习 · 统计学 2014-05-13 Anastasia Pentina , Christoph H. Lampert

Bayesian optimization has become widely popular across various experimental sciences due to its favorable attributes: it can handle noisy data, perform well with relatively small datasets, and provide adaptive suggestions for sequential…

其他定量生物学 · 定量生物学 2025-08-15 Maximilian Siska , Emma Pajak , Katrin Rosenthal , Antonio del Rio Chanona , Eric von Lieres , Laura Marie Helleckes

We introduce Bayesian optimization, a technique developed for optimizing time-consuming engineering simulations and for fitting machine learning models on large datasets. Bayesian optimization guides the choice of experiments during…

机器学习 · 统计学 2017-11-22 Peter I. Frazier , Jialei Wang

Bayesian optimization has emerged as a highly effective tool for the safe online optimization of systems, due to its high sample efficiency and noise robustness. To further enhance its efficiency, reduced physical models of the system can…

机器学习 · 计算机科学 2024-06-18 Jannis O. Lübsen , Christian Hespe , Annika Eichler

Training neural networks for neuromorphic deployment is non-trivial. There have been a variety of approaches proposed to adapt back-propagation or back-propagation-like algorithms appropriate for training. Considering that these networks…

Machine learning strategies like multi-task learning, meta-learning, and transfer learning enable efficient adaptation of machine learning models to specific applications in healthcare, such as prediction of various diseases, by leveraging…

机器学习 · 计算机科学 2024-12-31 Sophie Wharrie , Lisa Eick , Lotta Mäkinen , Andrea Ganna , Samuel Kaski , FinnGen

We describe a method for searching the optimal hyper-parameters in reservoir computing, which consists of a Gaussian process with Bayesian optimization. It provides an alternative to other frequently used optimization methods such as grid,…

机器学习 · 计算机科学 2017-06-15 Jan Yperman , Thijs Becker

Learning Bayesian networks is often cast as an optimization problem, where the computational task is to find a structure that maximizes a statistically motivated score. By and large, existing learning tools address this optimization problem…

机器学习 · 计算机科学 2013-01-30 Nir Friedman , Iftach Nachman , Dana Pe'er

Bayesian network structure learning algorithms with limited data are being used in domains such as systems biology and neuroscience to gain insight into the underlying processes that produce observed data. Learning reliable networks from…

机器学习 · 统计学 2013-07-10 Diane Oyen , Terran Lane

The use of transfer learning within Bayesian optimization addresses the disadvantages of the so-called \textit{cold start} problem by using source data to aid in the optimization of a target problem. We present a method that leverages an…

最优化与控制 · 数学 2026-04-01 Ali Tfaily , Youssef Diouane , Nathalie Bartoli , Michael Kokkolaras