English
Related papers

Related papers: Optuna: A Next-generation Hyperparameter Optimizat…

200 papers

Many hyperparameter optimization (HyperOpt) methods assume restricted computing resources and mainly focus on enhancing performance. Here we propose a novel cloud-based HyperOpt (CHOPT) framework which can efficiently utilize shared…

Machine Learning · Computer Science 2018-10-17 Jinwoong Kim , Minkyu Kim , Heungseok Park , Ernar Kusdavletov , Dongjun Lee , Adrian Kim , Ji-Hoon Kim , Jung-Woo Ha , Nako Sung

Architecture optimization is the process of automatically generating design options, typically to enhance software's quantifiable quality attributes, such as performance and reliability. Multi-objective optimization approaches have been…

Software Engineering · Computer Science 2024-01-31 Daniele Di Pompeo , Michele Tucci

The ever-growing demand and complexity of machine learning are putting pressure on hyper-parameter tuning systems: while the evaluation cost of models continues to increase, the scalability of state-of-the-arts starts to become a crucial…

Machine Learning · Computer Science 2022-01-19 Yang Li , Yu Shen , Huaijun Jiang , Wentao Zhang , Jixiang Li , Ji Liu , Ce Zhang , Bin Cui

Designing and optimizing ion optical systems is often a complex and difficult task, which requires the use of computational tools to iterate and converge towards the desired characteristics and performances of the system. Very often these…

Nuclear Experiment · Physics 2015-05-30 Daniel Bazin

Research in ultrasound imaging is limited in reproducibility by two factors: First, many existing ultrasound pipelines are protected by intellectual property, rendering exchange of code difficult. Second, most pipelines are implemented in…

Computer Vision and Pattern Recognition · Computer Science 2018-05-11 Rüdiger Göbl , Nassir Navab , Christoph Hennersperger

Hyper-parameters optimization (HPO) is vital for machine learning models. Besides model accuracy, other tuning intentions such as model training time and energy consumption are also worthy of attention from data analytic service providers.…

Machine Learning · Computer Science 2023-04-21 Hui Dou , Shanshan Zhu , Yiwen Zhang , Pengfei Chen , Zibin Zheng

Sherpa is a hyperparameter optimization library for machine learning models. It is specifically designed for problems with computationally expensive, iterative function evaluations, such as the hyperparameter tuning of deep neural networks.…

Machine Learning · Computer Science 2020-05-11 Lars Hertel , Julian Collado , Peter Sadowski , Jordan Ott , Pierre Baldi

Tuning machine learning models at scale, especially finding the right hyperparameter values, can be difficult and time-consuming. In addition to the computational effort required, this process also requires some ancillary efforts including…

Machine Learning · Computer Science 2019-11-07 Jiayi Liu , Samarth Tripathi , Unmesh Kurup , Mohak Shah

Optimization methods are playing an increasingly important role in all facets of photonics engineering, from integrated photonics to free space diffractive optics. However, efforts in the photonics community to develop optimization…

Due to the high computational demands executing a rigorous comparison between hyperparameter optimization (HPO) methods is often cumbersome. The goal of this paper is to facilitate a better empirical evaluation of HPO methods by providing…

Machine Learning · Computer Science 2019-05-14 Aaron Klein , Frank Hutter

We present the latest release of PANNA 2.0 (Properties from Artificial Neural Network Architectures), a code for the generation of neural network interatomic potentials based on local atomic descriptors and multilayer perceptrons. Built on…

Computational Physics · Physics 2023-05-22 Franco Pellegrini , Ruggero Lot , Yusuf Shaidu , Emine Küçükbenli

The paper combines research approaches that traditionally have been disjoint: 1) model checking as used in formal verification of programs, and 2) auto-tuning as often used in high-performance computing. Auto-tuning frameworks optimize…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-17 Natalia Garanina , Sergey Staroletov , Sergei Gorlatch

Controller tuning is a vital step to ensure the controller delivers its designed performance. DiffTune has been proposed as an automatic tuning method that unrolls the dynamical system and controller into a computational graph and uses…

Robotics · Computer Science 2023-05-16 Sheng Cheng , Lin Song , Minkyung Kim , Shenlong Wang , Naira Hovakimyan

Deep optics has emerged as a promising approach by co-designing optical elements with deep learning algorithms. However, current research typically overlooks the analysis and optimization of manufacturing and assembly tolerances. This…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Jun Dai , Liqun Chen , Xinge Yang , Yuyao Hu , Jinwei Gu , Tianfan Xue

Artificial neural networks have gone through a recent rise in popularity, achieving state-of-the-art results in various fields, including image classification, speech recognition, and automated control. Both the performance and…

Neural and Evolutionary Computing · Computer Science 2016-11-08 Sean C. Smithson , Guang Yang , Warren J. Gross , Brett H. Meyer

As computing system become more complex, it is becoming harder for programmers to keep their codes optimized as the hardware gets updated. Autotuners try to alleviate this by hiding as many architecture-based optimization details as…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-17 Jacob O. Tørring , Ben van Werkhoven , Filip Petrovic , Floris-Jan Willemsen , Jirí Filipovic , Anne C. Elster

We introduce an end-to-end computational framework that allows for hyperparameter optimization using the DeepHyper library, accelerated model training, and interpretable AI inference. The framework is based on state-of-the-art AI models…

Materials Science · Physics 2023-08-16 Hyun Park , Ruijie Zhu , E. A. Huerta , Santanu Chaudhuri , Emad Tajkhorshid , Donny Cooper

Hyperparameter optimization (HPO) plays a central role in the automated machine learning (AutoML). It is a challenging task as the response surfaces of hyperparameters are generally unknown, hence essentially a global optimization problem.…

Machine Learning · Computer Science 2021-06-18 Zebin Yang , Aijun Zhang

Metaheuristics are prominent gradient-free optimizers for solving hard problems that do not meet the rigorous mathematical assumptions of analytical solvers. The canonical manual optimizer design could be laborious, untraceable and…

Neural and Evolutionary Computing · Computer Science 2023-11-15 Qi Zhao , Bai Yan , Taiwei Hu , Xianglong Chen , Qiqi Duan , Jian Yang , Yuhui Shi

The compliance of IoT platforms to quality is paramount to achieve users satisfaction. Currently, we do not have a comprehensive set of guidelines to appraise and select the most suitable IoT platform architectures that meet relevant…

Software Engineering · Computer Science 2021-05-06 Mahdi Fahmideh , Jun Yan , Jun Shen , Davoud Mougouei , Yanlong Zhai , Aakash Ahmad