中文
相关论文

相关论文: HyP-ABC: A Novel Automated Hyper-Parameter Tuning …

200 篇论文

1. Challenging calibration of complex models can be approached by using prior knowledge on the parameters. However, the natural choice of Bayesian inference can be computationally heavy when relying on Markov Chain Monte Carlo (MCMC)…

应用统计 · 统计学 2023-04-27 Charlotte Baey , Henrik G. Smith , Maj Rundlöf , Ola Olsson , Yann Clough , Ullrika Sahlin

This paper introduces an enhanced meta-heuristic (ML-ACO) that combines machine learning (ML) and ant colony optimization (ACO) to solve combinatorial optimization problems. To illustrate the underlying mechanism of our ML-ACO algorithm, we…

神经与进化计算 · 计算机科学 2021-11-09 Yuan Sun , Sheng Wang , Yunzhuang Shen , Xiaodong Li , Andreas T. Ernst , Michael Kirley

This paper proposes the first-ever algorithmic framework for tuning hyper-parameters of stochastic optimization algorithm based on reinforcement learning. Hyper-parameters impose significant influences on the performance of stochastic…

机器学习 · 计算机科学 2020-03-11 Haotian Zhang , Jianyong Sun , Zongben Xu

A novel wavelength modulation spectroscopy (WMS) laser tuning parameters and concentration retrieval technique based on the variable-radius-search artificial bee colony(VRS-ABC) algorithm is proposed. The technique imitates the foraging…

仪器与探测器 · 物理学 2023-06-29 Tingting Zhang , Yongjie Sun , Pengpeng Wang , Cunguang Zhu

Hyper-parameter optimization is one of the most tedious yet crucial steps in training machine learning models. There are numerous methods for this vital model-building stage, ranging from domain-specific manual tuning guidelines suggested…

机器学习 · 计算机科学 2023-03-08 Ahmad Esmaeili , Zahra Ghorrati , Eric T. Matson

In this paper we propose a network aware approach for routing in graded network using Artificial Bee Colony (ABC) algorithm. ABC has been used as a good search process for optimality exploitation and exploration. The paper shows how ABC…

网络与互联网体系结构 · 计算机科学 2014-08-06 Kavitha Sooda , T. R. Gopalakrishnan Nair

Many different machine learning algorithms exist; taking into account each algorithm's hyperparameters, there is a staggeringly large number of possible alternatives overall. We consider the problem of simultaneously selecting a learning…

机器学习 · 计算机科学 2013-03-08 Chris Thornton , Frank Hutter , Holger H. Hoos , Kevin Leyton-Brown

Hyperparameter optimization (HPO) is a powerful technique for automating the tuning of machine learning (ML) models. However, in many real-world applications, accuracy is only one of multiple performance criteria that must be considered.…

机器学习 · 计算机科学 2023-05-12 Noor Awad , Ayushi Sharma , Philipp Muller , Janek Thomas , Frank Hutter

Back-propagation algorithm is one of the most widely used and popular techniques to optimize the feed forward neural network training. Nature inspired meta-heuristic algorithms also provide derivative-free solution to optimize complex…

神经与进化计算 · 计算机科学 2012-09-13 Sudarshan Nandy , Partha Pratim Sarkar , Achintya Das

Now the Meta-Heuristic algorithms have been used vastly in solving the problem of continuous optimization. In this paper the Artificial Bee Colony (ABC) algorithm and the Firefly Algorithm (FA) are valuated. And for presenting the…

神经与进化计算 · 计算机科学 2013-10-31 Seyyed Reza Khaze , Isa maleki , Sohrab Hojjatkhah , Ali Bagherinia

Evolutionary artificial neural networks (EANNs) refer to a special class of artificial neural networks (ANNs) in which evolution is another fundamental form of adaptation in addition to learning. Evolutionary algorithms are used to adapt…

人工智能 · 计算机科学 2016-11-17 Ajith Abraham

Pruning is a promising approach to compress deep learning models in order to deploy them on resource-constrained edge devices. However, many existing pruning solutions are based on unstructured pruning, which yields models that cannot…

机器学习 · 计算机科学 2023-03-16 Kaiqi Zhao , Animesh Jain , Ming Zhao

Robust iterative methods for solving large sparse systems of linear algebraic equations often suffer from the problem of optimizing the corresponding tuning parameters. To improve the performance of the problem of interest, specific…

数值分析 · 数学 2023-10-18 Andrey Petrushov , Boris Krasnopolsky

Automatic performance tuning (auto-tuning) is essential for optimizing high-performance applications, where vast and irregular search spaces make manual exploration infeasible. While auto-tuners traditionally rely on classical approaches…

机器学习 · 计算机科学 2026-04-01 Floris-Jan Willemsen , Niki van Stein , Ben van Werkhoven

Currently, an increasing number of model pruning methods are proposed to resolve the contradictions between the computer powers required by the deep learning models and the resource-constrained devices. However, most of the traditional…

计算机视觉与模式识别 · 计算机科学 2021-10-11 Jiaqi Li , Haoran Li , Yaran Chen , Zixiang Ding , Nannan Li , Mingjun Ma , Zicheng Duan , Dongbing Zhao

Machine learning (ML) algorithms are predictively competitive algorithms with many human-impact applications. However, the issue of long execution time remains unsolved in the literature for high-dimensional spaces. This study proposes…

机器学习 · 计算机科学 2024-03-04 Sofia Ramos-Pulido , Neil Hernandez-Gress , Hector G. Ceballos-Cancino

Hybrid optimization algorithms have gained popularity as it has become apparent there cannot be a universal optimization strategy which is globally more beneficial than any other. Despite their popularity, hybridization frameworks require…

神经与进化计算 · 计算机科学 2013-03-15 Hassan A. Bashir , Richard S. Neville

Many computer vision algorithms depend on a variety of parameter choices and settings that are typically hand-tuned in the course of evaluating the algorithm. While such parameter tuning is often presented as being incidental to the…

计算机视觉与模式识别 · 计算机科学 2012-09-25 J. Bergstra , D. Yamins , D. D. Cox

To infer the parameters of mechanistic models with intractable likelihoods, techniques such as approximate Bayesian computation (ABC) are increasingly being adopted. One of the main disadvantages of ABC in practical situations, however, is…

统计计算 · 统计学 2018-08-03 Jonathan U Harrison , Ruth E Baker

Tree-boosting is a widely used machine learning technique for tabular data. However, its out-of-sample accuracy is critically dependent on multiple hyperparameters. In this article, we empirically compare several popular methods for…

机器学习 · 计算机科学 2026-05-29 Floris Jan Koster , Fabio Sigrist