中文
相关论文

相关论文: PyBADS: Fast and robust black-box optimization in …

200 篇论文

We introduce implicit Deep Adaptive Design (iDAD), a new method for performing adaptive experiments in real-time with implicit models. iDAD amortizes the cost of Bayesian optimal experimental design (BOED) by learning a design policy…

机器学习 · 统计学 2021-11-04 Desi R. Ivanova , Adam Foster , Steven Kleinegesse , Michael U. Gutmann , Tom Rainforth

We introduce Dynamic Information Sub-Selection (DISS), a novel framework of AI assistance designed to enhance the performance of black-box decision-makers by tailoring their information processing on a per-instance basis. Blackbox…

机器学习 · 计算机科学 2024-11-01 Hung-Tien Huang , Maxwell Lennon , Shreyas Bhat Brahmavar , Sean Sylvia , Junier B. Oliva

Bayesian optimization is highly effective for optimizing expensive-to-evaluate black-box functions, but it faces significant computational challenges due to the cubic per-iteration cost of Gaussian processes, which results in a total time…

最优化与控制 · 数学 2026-05-21 Tansheng Zhu , Hongyu Zhou , Ke Jin , Xusheng Xu , Qiufan Yuan , Lijie Ji

The optimization of expensive-to-evaluate black-box functions over combinatorial structures is an ubiquitous task in machine learning, engineering and the natural sciences. The combinatorial explosion of the search space and costly…

机器学习 · 统计学 2018-10-11 Ricardo Baptista , Matthias Poloczek

Scaling Bayesian optimisation (BO) to high-dimensional search spaces is a active and open research problems particularly when no assumptions are made on function structure. The main reason is that at each iteration, BO requires to find…

机器学习 · 统计学 2026-04-28 Hung Tran-The , Sunil Gupta , Santu Rana , Svetha Venkatesh

Bayesian Optimization (BO) is an effective approach for global optimization of black-box functions when function evaluations are expensive. Most prior works use Gaussian processes to model the black-box function, however, the use of kernels…

机器学习 · 计算机科学 2023-09-25 Dat Phan-Trong , Hung Tran-The , Sunil Gupta

Bayesian optimization (BO) is a framework for global optimization of expensive-to-evaluate objective functions. Classical BO methods assume that the objective function is a black box. However, internal information about objective function…

机器学习 · 计算机科学 2022-01-04 Raul Astudillo , Peter I. Frazier

We focus on the problem of adversarial attacks against models on discrete sequential data in the black-box setting where the attacker aims to craft adversarial examples with limited query access to the victim model. Existing black-box…

机器学习 · 计算机科学 2022-06-20 Deokjae Lee , Seungyong Moon , Junhyeok Lee , Hyun Oh Song

Bat algorithm (BA) is a recent optimization algorithm based on swarm intelligence and inspiration from the echolocation behavior of bats. One of the issues in the standard bat algorithm is the premature convergence that can occur due to the…

神经与进化计算 · 计算机科学 2018-05-16 Asma Chakri , Rabia Khelif , Mohamed Benouaret , Xin-She Yang

Distributional shifts pose a significant challenge to achieving robustness in contemporary machine learning. To overcome this challenge, robust satisficing (RS) seeks a robust solution to an unspecified distributional shift while achieving…

机器学习 · 计算机科学 2023-08-17 Artun Saday , Yaşar Cahit Yıldırım , Cem Tekin

Dynamic neural networks (DyNNs) have become viable techniques to enable intelligence on resource-constrained edge devices while maintaining computational efficiency. In many cases, the implementation of DyNNs can be sub-optimal due to its…

机器学习 · 计算机科学 2022-12-08 Halima Bouzidi , Mohanad Odema , Hamza Ouarnoughi , Mohammad Abdullah Al Faruque , Smail Niar

Many engineering problems involve the optimization of computationally expensive models for which derivative information is not readily available. The Bayesian optimization (BO) framework is a particularly promising approach for solving…

最优化与控制 · 数学 2022-02-10 Joel A. Paulson , Congwen Lu

The performance of deep neural networks is highly sensitive to the choice of the hyperparameters that define the structure of the network and the learning process. When facing a new application, tuning a deep neural network is a tedious and…

机器学习 · 计算机科学 2019-07-04 Dounia Lakhmiri , Sébastien Le Digabel , Christophe Tribes

Among existing Neural Architecture Search methods, DARTS is known for its efficiency and simplicity. This approach applies continuous relaxation of network representation to construct a weight-sharing supernet and enables the identification…

机器学习 · 计算机科学 2023-12-21 Hongyi He , Longjun Liu , Haonan Zhang , Nanning Zheng

Imbalanced datasets are commonplace in modern machine learning problems. The presence of under-represented classes or groups with sensitive attributes results in concerns about generalization and fairness. Such concerns are further…

机器学习 · 计算机科学 2022-01-05 Mingchen Li , Xuechen Zhang , Christos Thrampoulidis , Jiasi Chen , Samet Oymak

High-dimensional black-box optimisation remains an important yet notoriously challenging problem. Despite the success of Bayesian optimisation methods on continuous domains, domains that are categorical, or that mix continuous and…

机器学习 · 统计学 2021-06-11 Xingchen Wan , Vu Nguyen , Huong Ha , Binxin Ru , Cong Lu , Michael A. Osborne

Bayesian optimization (BO) is a popular technique for sequential black-box function optimization, with applications including parameter tuning, robotics, environmental monitoring, and more. One of the most important challenges in BO is the…

机器学习 · 计算机科学 2018-03-29 Paul Rolland , Jonathan Scarlett , Ilija Bogunovic , Volkan Cevher

Bayesian optimization (BO) is a leading method for optimizing expensive black-box optimization and has been successfully applied across various scenarios. However, BO suffers from the curse of dimensionality, making it challenging to scale…

机器学习 · 计算机科学 2025-04-03 Vu Viet Hoang , Hung The Tran , Sunil Gupta , Vu Nguyen

Difficulty replicating baselines, high computational costs, and required domain expertise create persistent barriers to clinical AI research. To address these challenges, we introduce PyHealth 2.0, an enhanced clinical deep learning toolkit…

Bayesian optimization (BO) aims to minimize a given blackbox function using a model that is updated whenever new evidence about the function becomes available. Here, we address the problem of BO under partially right-censored response data,…

人工智能 · 计算机科学 2013-10-09 Frank Hutter , Holger Hoos , Kevin Leyton-Brown