中文
相关论文

相关论文: MFES-HB: Efficient Hyperband with Multi-Fidelity Q…

200 篇论文

It is typical for a machine learning system to have numerous hyperparameters that affect its learning rate and prediction quality. Finding a good combination of the hyperparameters is, however, a challenging job. This is mainly because…

机器学习 · 计算机科学 2019-08-08 Dobromir Marinov , Daniel Karapetyan

Applying quantum annealing or current quantum-/physics-inspired algorithms for MIMO detection always abandon the direct gray-coded bit-to-symbol mapping in order to obtain Ising form, leading to inconsistency errors. This often results in…

计算物理 · 物理学 2025-02-25 Qing-Guo Zeng , Xiao-Peng Cui , Xian-Zhe Tao , Jia-Qi Hu , Shi-Jie Pan , Wei E. I. Sha , Man-Hong Yung

Bayesian optimization (BO) is a popular black-box function optimization method, which makes sequential decisions based on a Bayesian model, typically a Gaussian process (GP), of the function. To ensure the quality of the model, transfer…

机器学习 · 计算机科学 2024-02-15 Zhou Fan , Xinran Han , Zi Wang

The performance of deep neural networks crucially depends on good hyperparameter configurations. Bayesian optimization is a powerful framework for optimizing the hyperparameters of DNNs. These methods need sufficient evaluation data to…

机器学习 · 计算机科学 2021-07-22 Yang Li , Jiawei Jiang , Yingxia Shao , Bin Cui

The computation of Bayesian estimates of system parameters and functions of them on the basis of observed system performance data is a common problem within system identification. This is a previously studied issue where stochastic…

统计计算 · 统计学 2018-05-09 Johan Dahlin , Adrian Wills , Brett Ninness

We introduce a method combining variational autoencoders (VAEs) and deep metric learning to perform Bayesian optimisation (BO) over high-dimensional and structured input spaces. By adapting ideas from deep metric learning, we use label…

Bayesian optimization (BO) is a leading method for optimizing expensive black-box optimization and has been successfully applied across various scenarios. However, BO suffers from the curse of dimensionality, making it challenging to scale…

机器学习 · 计算机科学 2025-04-03 Vu Viet Hoang , Hung The Tran , Sunil Gupta , Vu Nguyen

Bayesian optimization (BO) is a powerful approach for seeking the global optimum of expensive black-box functions and has proven successful for fine tuning hyper-parameters of machine learning models. However, BO is practically limited to…

机器学习 · 统计学 2020-09-28 Riccardo Moriconi , Marc P. Deisenroth , K. S. Sesh Kumar

This paper presents a novel and lightweight hyperparameter optimization (HPO) method, MOdular FActorial Design (MOFA). MOFA pursues several rounds of HPO, where each round alternates between exploration of hyperparameter space by factorial…

机器学习 · 计算机科学 2021-06-04 Bo Xiong , Yimin Huang , Hanrong Ye , Steffen Staab , Zhenguo Li

Design optimization of engineering systems with multiple competing objectives is a painstakingly tedious process especially when the objective functions are expensive-to-evaluate computer codes with parametric uncertainties. The…

最优化与控制 · 数学 2019-06-20 Piyush Pandita , Ilias Bilionis , Jitesh Panchal , B. P. Gautham , Amol Joshi , Pramod Zagade

Bayesian optimization (BO) has become a popular strategy for global optimization of expensive real-world functions. Contrary to a common expectation that BO is suited to optimizing black-box functions, it actually requires domain knowledge…

机器学习 · 计算机科学 2024-08-06 Zi Wang , George E. Dahl , Kevin Swersky , Chansoo Lee , Zachary Nado , Justin Gilmer , Jasper Snoek , Zoubin Ghahramani

Realizing high-throughput aberration-corrected Scanning Transmission Electron Microscopy (STEM) exploration of atomic structures requires rapid tuning of multipole probe correctors while compensating for the inevitable drift of the optical…

机器学习 · 计算机科学 2026-01-28 Utkarsh Pratiush , Austin Houston , Richard Liu , Gerd Duscher , Sergei Kalinin

Most research in Bayesian optimization (BO) has focused on \emph{direct feedback} scenarios, where one has access to exact values of some expensive-to-evaluate objective. This direction has been mainly driven by the use of BO in machine…

Hybrid beamforming (HB) has emerged as a promising technology to support ultra high transmission capacity and with low complexity for Millimeter Wave (mmWave) multiple-input and multiple-output (MIMO) system. However, the design of digital…

信号处理 · 电气工程与系统科学 2020-01-10 Jiyun Tao , Jing Xing , Jienan Chen , Chuan Zhang , Shengli Fu

High-Performance Computing (HPC) schedulers must balance user performance with facility-wide resource constraints. The task boils down to selecting the optimal number of nodes for a given job. We present a surrogate-assisted multi-objective…

机器学习 · 计算机科学 2026-01-23 Ashna Nawar Ahmed , Banooqa Banday , Terry Jones , Tanzima Z. Islam

High-dimensional Bayesian Optimization (BO) has attracted significant attention in recent research. However, existing methods have mainly focused on optimizing in continuous domains, while combinatorial (ordinal and categorical) and mixed…

机器学习 · 统计学 2025-08-26 Lam Ngo , Huong Ha , Jeffrey Chan , Hongyu Zhang

A multi-fidelity (MF) active learning method is presented for design optimization problems characterized by noisy evaluations of the performance metrics. Namely, a generalized MF surrogate model is used for design-space exploration,…

Some real problems require the evaluation of expensive and noisy objective functions. Moreover, the analytical expression of these objective functions may be unknown. These functions are known as black-boxes, for example, estimating the…

机器学习 · 统计学 2021-07-12 Lucia Asencio Martín , Eduardo C. Garrido-Merchán

SecureBoost is a tree-boosting algorithm that leverages homomorphic encryption (HE) to protect data privacy in vertical federated learning. SecureBoost and its variants have been widely adopted in fields such as finance and healthcare.…

机器学习 · 计算机科学 2024-04-09 Yan Kang , Ziyao Ren , Lixin Fan , Linghua Yang , Yongxin Tong , Qiang Yang

Optimizing multiple competing objectives is a common problem across science and industry. The inherent inextricable trade-off between those objectives leads one to the task of exploring their Pareto front. A meaningful quantity for the…

机器学习 · 计算机科学 2023-10-24 Jim Boelrijk , Bernd Ensing , Patrick Forré