English
Related papers

Related papers: PABO: Pseudo Agent-Based Multi-Objective Bayesian …

200 papers

Miniaturized autonomous unmanned aerial vehicles (UAVs) are gaining popularity due to their small size, enabling new tasks such as indoor navigation or people monitoring. Nonetheless, their size and simple electronics pose severe challenges…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Matteo Risso , Francesco Daghero , Beatrice Alessandra Motetti , Daniele Jahier Pagliari , Enrico Macii , Massimo Poncino , Alessio Burrello

Automated hyperparameter optimization (HPO) has gained great popularity and is an important ingredient of most automated machine learning frameworks. The process of designing HPO algorithms, however, is still an unsystematic and manual…

Bayesian Optimization (BO) is a foundational strategy in the field of engineering design optimization for efficiently handling black-box functions with many constraints and expensive evaluations. This paper introduces a fast and accurate BO…

Computational Engineering, Finance, and Science · Computer Science 2024-04-09 Rosen , Yu , Cyril Picard , Faez Ahmed

In parallel with the continuously increasing parameter space dimensionality, search and optimization algorithms should support distributed parameter evaluations to reduce cumulative runtime. Intel's neuromorphic optimization library,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-10 Shay Snyder , Derek Gobin , Victoria Clerico , Sumedh R. Risbud , Maryam Parsa

The ever-increasing demands of computationally expensive and high-dimensional problems require novel optimization methods to find near-optimal solutions in a reasonable amount of time. Bayesian Optimization (BO) stands as one of the best…

Neural and Evolutionary Computing · Computer Science 2023-05-19 Shay Snyder , Sumedh R. Risbud , Maryam Parsa

Deep neural networks have seen great success in recent years; however, training a deep model is often challenging as its performance heavily depends on the hyper-parameters used. In addition, finding the optimal hyper-parameter…

Hyperparameter optimization (HPO) is an important step in machine learning (ML) model development, but common practices are archaic -- primarily relying on manual or grid searches. This is partly because adopting advanced HPO algorithms…

Machine Learning · Computer Science 2024-02-08 Sungduk Yu , Mike Pritchard , Po-Lun Ma , Balwinder Singh , Sam Silva

Machine learning algorithms have made remarkable achievements in the field of artificial intelligence. However, most machine learning algorithms are sensitive to the hyper-parameters. Manually optimizing the hyper-parameters is a common…

Machine Learning · Computer Science 2020-03-05 Bozhou Chen , Kaixin Zhang , Longshen Ou , Chenmin Ba , Hongzhi Wang , Chunnan Wang

Experimental (design) optimization is a key driver in designing and discovering new products and processes. Bayesian Optimization (BO) is an effective tool for optimizing expensive and black-box experimental design processes. While Bayesian…

Machine Learning · Computer Science 2024-02-28 Arun Kumar A , Alistair Shilton , Sunil Gupta , Santu Rana , Stewart Greenhill , Svetha Venkatesh

In this paper, we propose PATO-a producibility-aware topology optimization (TO) framework to help efficiently explore the design space of components fabricated using metal additive manufacturing (AM), while ensuring manufacturability with…

Computational Engineering, Finance, and Science · Computer Science 2021-12-10 Naresh S. Iyer , Amir M. Mirzendehdel , Sathyanarayanan Raghavan , Yang Jiao , Erva Ulu , Morad Behandish , Saigopal Nelaturi , Dean M. Robinson

The Unrelated Parallel Machine Scheduling Problem (UPMSP) with release dates, setups, and eligibility constraints presents a significant multi-objective challenge. Traditional methods struggle to balance minimizing Total Weighted Tardiness…

Artificial Intelligence · Computer Science 2026-02-10 Bulent Soykan , Sean Mondesire , Ghaith Rabadi , Grace Bochenek

The demand for executing Deep Neural Networks (DNNs) with low latency and minimal power consumption at the edge has led to the development of advanced heterogeneous Systems-on-Chips (SoCs) that incorporate multiple specialized computing…

Machine Learning · Computer Science 2025-02-24 Matteo Risso , Alessio Burrello , Daniele Jahier Pagliari

In spite of maturity to the modern electronic design automation (EDA) tools, optimized designs at architectural stage may become sub-optimal after going through physical design flow. Adder design has been such a long studied fundamental…

Hardware Architecture · Computer Science 2018-10-17 Yuzhe Ma , Subhendu Roy , Jin Miao , Jiamin Chen , Bei Yu

Hyperparameter optimization (HPO) is of paramount importance in the development of high-performance, specialized artificial intelligence (AI) models, ranging from well-established machine learning (ML) solutions to the deep learning (DL)…

Neural and Evolutionary Computing · Computer Science 2025-10-21 Vittorio Fra

Hyperparameter optimization (HPO) is important to leverage the full potential of machine learning (ML). In practice, users are often interested in multi-objective (MO) problems, i.e., optimizing potentially conflicting objectives, like…

Machine Learning · Computer Science 2024-01-12 Joseph Giovanelli , Alexander Tornede , Tanja Tornede , Marius Lindauer

Deep neural networks (DNNs) have been widely used in many artificial intelligence (AI) tasks. However, deploying them brings significant challenges due to the huge cost of memory, energy, and computation. To address these challenges,…

Machine Learning · Computer Science 2024-05-13 Xue Geng , Zhe Wang , Chunyun Chen , Qing Xu , Kaixin Xu , Chao Jin , Manas Gupta , Xulei Yang , Zhenghua Chen , Mohamed M. Sabry Aly , Jie Lin , Min Wu , Xiaoli Li

Hyperparameter optimization (HPO) is a powerful technique for automating the tuning of machine learning (ML) models. However, in many real-world applications, accuracy is only one of multiple performance criteria that must be considered.…

Machine Learning · Computer Science 2023-05-12 Noor Awad , Ayushi Sharma , Philipp Muller , Janek Thomas , Frank Hutter

Since the deep learning model is highly dependent on hyperparameters, hyperparameter optimization is essential in developing deep learning model-based applications, even if it takes a long time. As service development using deep learning…

Computer Vision and Pattern Recognition · Computer Science 2022-05-19 Kangil Lee , Junho Yim

With the extensive applications of machine learning models, automatic hyperparameter optimization (HPO) has become increasingly important. Motivated by the tuning behaviors of human experts, it is intuitive to leverage auxiliary knowledge…

Machine Learning · Computer Science 2022-06-07 Yang Li , Yu Shen , Huaijun Jiang , Wentao Zhang , Zhi Yang , Ce Zhang , Bin Cui

Bayesian Optimization (BO) is a surrogate-based global optimization strategy that relies on a Gaussian Process regression (GPR) model to approximate the objective function and an acquisition function to suggest candidate points. It is…

Machine Learning · Computer Science 2022-06-28 Kirill Antonov , Elena Raponi , Hao Wang , Carola Doerr