中文
相关论文

相关论文: Reinforced Few-Shot Acquisition Function Learning …

200 篇论文

The Adam optimizer remains one of the most widely used optimizers in deep learning, and effectively tuning its hyperparameters is key to optimizing performance. However, tuning can be tedious and costly. Freeze-thaw Bayesian Optimization…

机器学习 · 计算机科学 2025-08-29 Theodoros Athanasiadis , Steven Adriaensen , Samuel Müller , Frank Hutter

Federated learning faces huge challenges from model overfitting due to the lack of data and statistical diversity among clients. To address these challenges, this paper proposes a novel personalized federated learning method via Bayesian…

机器学习 · 计算机科学 2022-06-17 Xu Zhang , Yinchuan Li , Wenpeng Li , Kaiyang Guo , Yunfeng Shao

Optimization of high-dimensional black-box functions is an extremely challenging problem. While Bayesian optimization has emerged as a popular approach for optimizing black-box functions, its applicability has been limited to…

机器学习 · 统计学 2018-08-06 Zi Wang , Chengtao Li , Stefanie Jegelka , Pushmeet Kohli

We propose a novel, theoretically-grounded, acquisition function for Batch Bayesian optimization informed by insights from distributionally ambiguous optimization. Our acquisition function is a lower bound on the well-known Expected…

机器学习 · 统计学 2018-04-17 Nikitas Rontsis , Michael A. Osborne , Paul J. Goulart

Bayesian optimization (BO) is a popular method to optimize expensive black-box functions. It efficiently tunes machine learning algorithms under the implicit assumption that hyperparameter evaluations cost approximately the same. In…

机器学习 · 计算机科学 2020-11-25 Gauthier Guinet , Valerio Perrone , Cédric Archambeau

Performance degradation owing to data heterogeneity and low output interpretability are the most significant challenges faced by federated learning in practical applications. Personalized federated learning diverges from traditional…

机器学习 · 计算机科学 2024-02-28 Mengen Luo , Chi Xu , Ercan Engin Kuruoglu

Autofocus (AF) methods are extensively used in biomicroscopy, for example to acquire timelapses, where the imaged objects tend to drift out of focus. AD algorithms determine an optimal distance by which to move the sample back into the…

图像与视频处理 · 电气工程与系统科学 2021-01-14 Adrian Shajkofci , Michael Liebling

Irrelevant features can significantly degrade few-shot learn ing performance. This problem is used to match queries and support images based on meaningful similarities despite the limited data. However, in this process, non-relevant fea…

计算机视觉与模式识别 · 计算机科学 2025-08-14 Javier Rodenas , Eduardo Aguilar , Petia Radeva

Multi-fidelity Bayesian optimization (MFBO) accelerates the search for the global optimum of black-box functions by integrating inexpensive, low-fidelity approximations. The central task of an MFBO policy is to balance the cost-efficiency…

机器学习 · 计算机科学 2026-02-03 Md Abir Hossen , Mohammad Ali Javidian , Vignesh Narayanan , Jason M. O'Kane , Pooyan Jamshidi

Bayesian optimization (BO) with preference-based feedback has recently garnered significant attention due to its emerging applications. We refer to this problem as Bayesian Optimization from Human Feedback (BOHF), which differs from…

机器学习 · 计算机科学 2025-05-30 Aya Kayal , Sattar Vakili , Laura Toni , Da-shan Shiu , Alberto Bernacchia

Bayesian Optimization (BO) is a method for globally optimizing black-box functions. While BO has been successfully applied to many scenarios, developing effective BO algorithms that scale to functions with high-dimensional domains is still…

机器学习 · 计算机科学 2024-02-13 Yihang Shen , Carl Kingsford

Few-shot learning (FSL) enables machine learning models to generalize effectively with minimal labeled data, making it crucial for data-scarce domains such as healthcare, robotics, and natural language processing. Despite its potential, FSL…

机器学习 · 计算机科学 2025-01-24 Rishabh Agrawal

With the rise of different language model architecture, fine-tuning is becoming even more important for down stream tasks Model gets messy, finding proper hyperparameters for fine-tuning. Although BO has been tried for hyperparameter…

计算与语言 · 计算机科学 2025-05-26 Zishuo Bao , Yibo Liu , Changyutao Qiu

This paper studies the problem of distributed multi-agent Bayesian optimization with both coupled black-box constraints and known affine constraints. A primal-dual distributed algorithm is proposed that achieves similar regret/violation…

机器学习 · 计算机科学 2023-10-03 Wenjie Xu , Yuning Jiang , Bratislav Svetozarevic , Colin N. Jones

Approximate Bayesian computation (ABC) is a method for Bayesian inference when the likelihood is unavailable but simulating from the model is possible. However, many ABC algorithms require a large number of simulations, which can be costly.…

机器学习 · 统计学 2018-10-15 Marko Järvenpää , Michael U. Gutmann , Arijus Pleska , Aki Vehtari , Pekka Marttinen

A key requirement for the current generation of artificial decision-makers is that they should adapt well to changes in unexpected situations. This paper addresses the situation in which an AI for aerial dog fighting, with tunable…

机器学习 · 统计学 2016-12-14 Brett W. Israelsen , Nisar Ahmed , Kenneth Center , Roderick Green , Winston Bennett

Bayesian Optimization is the state of the art technique for the optimization of black boxes, i.e., functions where we do not have access to their analytical expression nor its gradients, they are expensive to evaluate and its evaluation is…

人工智能 · 计算机科学 2021-01-13 Eduardo C. Garrido Merchán , Luis C. Jariego Pérez

Bayesian Optimization (BO) for the minimization of expensive functions of continuous variables uses all the knowledge acquired from previous samples (${\boldsymbol x}_i$ and $f({\boldsymbol x}_i)$ values) to build a surrogate model based on…

数值分析 · 数学 2025-05-15 Roberto Battiti , Mauro Brunato

Scaling Bayesian optimisation (BO) to high-dimensional search spaces is a active and open research problems particularly when no assumptions are made on function structure. The main reason is that at each iteration, BO requires to find…

机器学习 · 统计学 2026-04-28 Hung Tran-The , Sunil Gupta , Santu Rana , Svetha Venkatesh

Bayesian optimization (BO) is a successful methodology to optimize black-box functions that are expensive to evaluate. While traditional methods optimize each black-box function in isolation, there has been recent interest in speeding up BO…

机器学习 · 统计学 2019-09-30 Valerio Perrone , Huibin Shen , Matthias Seeger , Cedric Archambeau , Rodolphe Jenatton