English
Related papers

Related papers: HyP-ABC: A Novel Automated Hyper-Parameter Tuning …

200 papers

1. Challenging calibration of complex models can be approached by using prior knowledge on the parameters. However, the natural choice of Bayesian inference can be computationally heavy when relying on Markov Chain Monte Carlo (MCMC)…

Applications · Statistics 2023-04-27 Charlotte Baey , Henrik G. Smith , Maj Rundlöf , Ola Olsson , Yann Clough , Ullrika Sahlin

This paper introduces an enhanced meta-heuristic (ML-ACO) that combines machine learning (ML) and ant colony optimization (ACO) to solve combinatorial optimization problems. To illustrate the underlying mechanism of our ML-ACO algorithm, we…

Neural and Evolutionary Computing · Computer Science 2021-11-09 Yuan Sun , Sheng Wang , Yunzhuang Shen , Xiaodong Li , Andreas T. Ernst , Michael Kirley

This paper proposes the first-ever algorithmic framework for tuning hyper-parameters of stochastic optimization algorithm based on reinforcement learning. Hyper-parameters impose significant influences on the performance of stochastic…

Machine Learning · Computer Science 2020-03-11 Haotian Zhang , Jianyong Sun , Zongben Xu

A novel wavelength modulation spectroscopy (WMS) laser tuning parameters and concentration retrieval technique based on the variable-radius-search artificial bee colony(VRS-ABC) algorithm is proposed. The technique imitates the foraging…

Instrumentation and Detectors · Physics 2023-06-29 Tingting Zhang , Yongjie Sun , Pengpeng Wang , Cunguang Zhu

Hyper-parameter optimization is one of the most tedious yet crucial steps in training machine learning models. There are numerous methods for this vital model-building stage, ranging from domain-specific manual tuning guidelines suggested…

Machine Learning · Computer Science 2023-03-08 Ahmad Esmaeili , Zahra Ghorrati , Eric T. Matson

In this paper we propose a network aware approach for routing in graded network using Artificial Bee Colony (ABC) algorithm. ABC has been used as a good search process for optimality exploitation and exploration. The paper shows how ABC…

Networking and Internet Architecture · Computer Science 2014-08-06 Kavitha Sooda , T. R. Gopalakrishnan Nair

Many different machine learning algorithms exist; taking into account each algorithm's hyperparameters, there is a staggeringly large number of possible alternatives overall. We consider the problem of simultaneously selecting a learning…

Machine Learning · Computer Science 2013-03-08 Chris Thornton , Frank Hutter , Holger H. Hoos , Kevin Leyton-Brown

Hyperparameter optimization (HPO) is a powerful technique for automating the tuning of machine learning (ML) models. However, in many real-world applications, accuracy is only one of multiple performance criteria that must be considered.…

Machine Learning · Computer Science 2023-05-12 Noor Awad , Ayushi Sharma , Philipp Muller , Janek Thomas , Frank Hutter

Back-propagation algorithm is one of the most widely used and popular techniques to optimize the feed forward neural network training. Nature inspired meta-heuristic algorithms also provide derivative-free solution to optimize complex…

Neural and Evolutionary Computing · Computer Science 2012-09-13 Sudarshan Nandy , Partha Pratim Sarkar , Achintya Das

Now the Meta-Heuristic algorithms have been used vastly in solving the problem of continuous optimization. In this paper the Artificial Bee Colony (ABC) algorithm and the Firefly Algorithm (FA) are valuated. And for presenting the…

Neural and Evolutionary Computing · Computer Science 2013-10-31 Seyyed Reza Khaze , Isa maleki , Sohrab Hojjatkhah , Ali Bagherinia

Evolutionary artificial neural networks (EANNs) refer to a special class of artificial neural networks (ANNs) in which evolution is another fundamental form of adaptation in addition to learning. Evolutionary algorithms are used to adapt…

Artificial Intelligence · Computer Science 2016-11-17 Ajith Abraham

Pruning is a promising approach to compress deep learning models in order to deploy them on resource-constrained edge devices. However, many existing pruning solutions are based on unstructured pruning, which yields models that cannot…

Machine Learning · Computer Science 2023-03-16 Kaiqi Zhao , Animesh Jain , Ming Zhao

Robust iterative methods for solving large sparse systems of linear algebraic equations often suffer from the problem of optimizing the corresponding tuning parameters. To improve the performance of the problem of interest, specific…

Numerical Analysis · Mathematics 2023-10-18 Andrey Petrushov , Boris Krasnopolsky

Automatic performance tuning (auto-tuning) is essential for optimizing high-performance applications, where vast and irregular search spaces make manual exploration infeasible. While auto-tuners traditionally rely on classical approaches…

Machine Learning · Computer Science 2026-04-01 Floris-Jan Willemsen , Niki van Stein , Ben van Werkhoven

Currently, an increasing number of model pruning methods are proposed to resolve the contradictions between the computer powers required by the deep learning models and the resource-constrained devices. However, most of the traditional…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Jiaqi Li , Haoran Li , Yaran Chen , Zixiang Ding , Nannan Li , Mingjun Ma , Zicheng Duan , Dongbing Zhao

Machine learning (ML) algorithms are predictively competitive algorithms with many human-impact applications. However, the issue of long execution time remains unsolved in the literature for high-dimensional spaces. This study proposes…

Machine Learning · Computer Science 2024-03-04 Sofia Ramos-Pulido , Neil Hernandez-Gress , Hector G. Ceballos-Cancino

Hybrid optimization algorithms have gained popularity as it has become apparent there cannot be a universal optimization strategy which is globally more beneficial than any other. Despite their popularity, hybridization frameworks require…

Neural and Evolutionary Computing · Computer Science 2013-03-15 Hassan A. Bashir , Richard S. Neville

Many computer vision algorithms depend on a variety of parameter choices and settings that are typically hand-tuned in the course of evaluating the algorithm. While such parameter tuning is often presented as being incidental to the…

Computer Vision and Pattern Recognition · Computer Science 2012-09-25 J. Bergstra , D. Yamins , D. D. Cox

To infer the parameters of mechanistic models with intractable likelihoods, techniques such as approximate Bayesian computation (ABC) are increasingly being adopted. One of the main disadvantages of ABC in practical situations, however, is…

Computation · Statistics 2018-08-03 Jonathan U Harrison , Ruth E Baker

Tree-boosting is a widely used machine learning technique for tabular data. However, its out-of-sample accuracy is critically dependent on multiple hyperparameters. In this article, we empirically compare several popular methods for…

Machine Learning · Computer Science 2026-05-29 Floris Jan Koster , Fabio Sigrist