中文
相关论文

相关论文: MFES-HB: Efficient Hyperband with Multi-Fidelity Q…

200 篇论文

Many real world scientific and industrial applications require optimizing multiple competing black-box objectives. When the objectives are expensive-to-evaluate, multi-objective Bayesian optimization (BO) is a popular approach because of…

机器学习 · 计算机科学 2022-06-17 Samuel Daulton , David Eriksson , Maximilian Balandat , Eytan Bakshy

The tuning of hyperparameters becomes increasingly important as machine learning (ML) models have been extensively applied in data mining applications. Among various approaches, Bayesian optimization (BO) is a successful methodology to tune…

机器学习 · 计算机科学 2022-06-07 Yang Li , Yu Shen , Huaijun Jiang , Tianyi Bai , Wentao Zhang , Ce Zhang , Bin Cui

Algorithm selection and hyperparameter tuning remain two of the most challenging tasks in machine learning. Automated machine learning (AutoML) seeks to automate these tasks to enable widespread use of machine learning by non-experts. This…

机器学习 · 计算机科学 2019-05-22 Chengrun Yang , Yuji Akimoto , Dae Won Kim , Madeleine Udell

Hyperparameter optimization (HPO) is a billion-dollar problem in machine learning, which significantly impacts the training efficiency and model performance. However, achieving efficient and robust HPO in deep reinforcement learning (RL) is…

机器学习 · 计算机科学 2025-08-04 Mingqi Yuan , Bo Li , Xin Jin , Wenjun Zeng

Hybrid beamforming (HBF) design is a crucial stage in millimeter wave (mmWave) multi-user multi-input multi-output (MU-MIMO) systems. However, conventional HBF methods are still with high complexity and strongly rely on the quality of…

信号处理 · 电气工程与系统科学 2020-04-28 Shaocheng Huang , Yu Ye , Ming Xiao

Bayesian Optimization (BO) is a well-established method for addressing black-box optimization problems. In many real-world scenarios, optimization often involves multiple functions, emphasizing the importance of leveraging data and learned…

机器学习 · 计算机科学 2025-03-11 Khoa Nguyen , Viet Huynh , Binh Tran , Tri Pham , Tin Huynh , Thin Nguyen

Hybrid beamforming (HB) has been widely studied for reducing the number of costly radio frequency (RF) chains in massive multiple-input multiple-output (MIMO) systems. However, previous works on HB are limited to a single user equipment…

信息论 · 计算机科学 2016-11-03 Dengkui Zhu , Boyu Li , Ping Liang

Hyperparameter optimization (HPO) plays a central role in the performance of deep learning models, yet remains computationally expensive and difficult to interpret, particularly for time-series forecasting. While Bayesian Optimization (BO)…

机器学习 · 计算机科学 2026-02-17 Ons Saadallah , Mátyás andó , Tamás Gábor Orosz

This work introduces a new method for selecting the number of components in finite mixture models (FMMs) using variational Bayes, inspired by the large-sample properties of the Evidence Lower Bound (ELBO) derived from mean-field (MF)…

统计方法学 · 统计学 2026-04-23 Chenyang Wang , Yun Yang

Machine learning has achieved remarkable success over the past couple of decades, often attributed to a combination of algorithmic innovations and the availability of high-quality data available at scale. However, a third critical component…

Bayesian Optimization (BO) is a foundational strategy in the field of engineering design optimization for efficiently handling black-box functions with many constraints and expensive evaluations. This paper introduces a fast and accurate BO…

计算工程、金融与科学 · 计算机科学 2024-04-09 Rosen , Yu , Cyril Picard , Faez Ahmed

Automatically searching for optimal hyperparameter configurations is of crucial importance for applying deep learning algorithms in practice. Recently, Bayesian optimization has been proposed for optimizing hyperparameters of various…

人工智能 · 计算机科学 2017-01-24 Ilija Ilievski , Taimoor Akhtar , Jiashi Feng , Christine Annette Shoemaker

Automl is the key technology for machine learning problem. Current state of art hyperparameter optimization methods are based on traditional black-box optimization methods like SMBO (SMAC, TPE). The objective function of black-box…

机器学习 · 计算机科学 2019-07-19 Cheng Daning , Zhang Hanping , Xia Fen , Li Shigang , Zhang Yunquan

The sample efficiency of Bayesian optimization(BO) is often boosted by Gaussian Process(GP) surrogate models. However, on mixed variable spaces, surrogate models other than GPs are prevalent, mainly due to the lack of kernels which can…

机器学习 · 统计学 2022-07-19 Changyong Oh , Efstratios Gavves , Max Welling

Bayesian optimization (BO) is an efficient framework for optimizing expensive black-box functions. However, it is typically formulated as learning an end-to-end mapping from inputs to scalar objectives, thereby discarding the potentially…

机器学习 · 计算机科学 2026-05-12 Wenbin Wang , Colin N. Jones

We present HIghly Parallelisable Pareto Optimisation (HIPPO) -- a batch acquisition function that enables multi-objective Bayesian optimisation methods to efficiently exploit parallel processing resources. Multi-Objective Bayesian…

机器学习 · 计算机科学 2022-06-28 Andrei Paleyes , Henry B. Moss , Victor Picheny , Piotr Zulawski , Felix Newman

Hyperparameter optimization (HPO) is a necessary step to ensure the best possible performance of Machine Learning (ML) algorithms. Several methods have been developed to perform HPO; most of these are focused on optimizing one performance…

机器学习 · 计算机科学 2022-11-16 Alejandro Morales-Hernández , Inneke Van Nieuwenhuyse , Sebastian Rojas Gonzalez

Bayesian optimization (BO) is a prominent approach to optimizing expensive-to-evaluate black-box functions. The massive computational capability of edge devices such as mobile phones, coupled with privacy concerns, has led to a surging…

机器学习 · 计算机科学 2020-10-23 Zhongxiang Dai , Kian Hsiang Low , Patrick Jaillet

The dynamic behavior of jointed assemblies exhibiting friction nonlinearities features amplitude-dependent dissipation and stiffness. To develop numerical simulations for predictive and design purposes, macro-scale High Fidelity Models…

计算工程、金融与科学 · 计算机科学 2022-04-27 Ahmed Amr Morsy , Mariella Kast , Paolo Tiso

Bayesian Optimization (BO) is a sample-efficient black-box optimizer commonly used in search spaces where hyperparameters are independent. However, in many practical AutoML scenarios, there will be dependencies among hyperparameters,…

机器学习 · 计算机科学 2025-01-28 Jiaxing Li , Wei Liu , Chao Xue , Yibing Zhan , Xiaoxing Wang , Weifeng Liu , Dacheng Tao