English
Related papers

Related papers: Hyper-parameter estimation method with particle sw…

200 papers

A new approach for tuning the parameters of MultiScale Retinex (MSR) based color image enhancement algorithm using a popular optimization method, namely, Particle Swarm Optimization (PSO) is presented in this paper. The image enhancement…

Computer Vision and Pattern Recognition · Computer Science 2014-09-16 M. C Hanumantharaju , M. Ravishankar , D. R Rameshbabu , V. N Manjunath Aradhya

Parameter updating is an important stage in parallelism-based distributed deep learning. Synchronous methods are widely used in distributed training the Deep Neural Networks (DNNs). To reduce the communication and synchronization overhead…

Machine Learning · Computer Science 2020-09-09 Qing Ye , Yuxuan Han , Yanan sun , JIancheng Lv

Particle Swarm Optimization (PSO) is a stochastic technique for solving the optimization problem. Attempts have been made to shorten the computation times of PSO based algorithms with massive threads on GPUs (graphic processing units),…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-05 Chuan-Chi Wang , Chun-Yen Ho , Chia-Heng Tu , Shih-Hao Hung

Particle Swarm Optimisation (PSO) makes use of a dynamical system for solving a search task. Instead of adding search biases in order to improve performance in certain problems, we aim to remove algorithm-induced scales by controlling the…

Neural and Evolutionary Computing · Computer Science 2014-02-28 Adam Erskine , J Michael Herrmann

Bayesian optimization (BO) is a popular methodology to tune the hyperparameters of expensive black-box functions. Traditionally, BO focuses on a single task at a time and is not designed to leverage information from related functions, such…

Machine Learning · Statistics 2021-04-20 David Salinas , Huibin Shen , Valerio Perrone

Population-based methods can cope with a variety of different problems, including problems of remarkably higher complexity than those traditional methods can handle. The main procedure consists of successively updating a population of…

Neural and Evolutionary Computing · Computer Science 2021-01-27 Mauro S. Innocente , Johann Sienz

Identifying optimal designs for generalized linear models with a binary response can be a challenging task, especially when there are both continuous and discrete independent factors in the model. Theoretical results rarely exist for such…

Applications · Statistics 2016-02-09 Joshua Lukemire , Abhyuday Mandal , Weng Kee Wong

This paper develops a spectral fitting technology based on the particle swarm optimization (PSO) algorithm, which is applied to a calibration-free wavelength modulation spectroscopy system to achieve concentration retrieval. As compared…

Instrumentation and Detectors · Physics 2022-12-13 Tingting Zhang , Yongjie Sun , Pengpeng Wang , Cunguang Zhu

Bayesian optimization (BO) is a popular algorithm for solving challenging optimization tasks. It is designed for problems where the objective function is expensive to evaluate, perhaps not available in exact form, without gradient…

Machine Learning · Statistics 2018-08-22 Umberto Noè , Dirk Husmeier

The Particle Swarm Optimisation (PSO) algorithm has undergone countless modifications and adaptations since its original formulation in 1995. Some of these have become mainstream whereas many others have not been adopted and faded away.…

Neural and Evolutionary Computing · Computer Science 2021-04-27 Mauro Sebastián Innocente

The particle swarm approach provides a low complexity solution to the optimization problem among various existing heuristic algorithms. Recent advances in the algorithm resulted in improved performance at the cost of increased computational…

Neural and Evolutionary Computing · Computer Science 2013-04-16 Muhammad Omer Bin Saeed , Muhammad Saqib Sohail , Syed Zeeshan Rizvi , Mobien Shoaib , Asrar Ul Haq Sheikh

Feature selection is the process of identifying statistically most relevant features to improve the predictive capabilities of the classifiers. To find the best features subsets, the population based approaches like Particle Swarm…

Neural and Evolutionary Computing · Computer Science 2018-06-28 Naresh Mallenahalli , T. Hitendra Sarma

For unstructured experimental units, the minimum aberration due to Fries and Hunter (1980) is a popular criterion for choosing regular fractional factorial designs. Following which, many related studies have focused on multi-stratum…

Methodology · Statistics 2022-11-14 Xie-Yu Li , Wei-Yang Yu , Ming-Chung Chang

Bayesian Optimization (BO) is an effective framework for globally optimizing functions whose evaluations are expensive. It is particularly effective for optimizing functions defined over continuous domains and explicitly handles stochastic…

Computational Engineering, Finance, and Science · Computer Science 2026-05-21 Buqing Ou , Frederike Dümbgen

In this paper we describe improvements to the particle swarm optimizer (PSO) made by inclusion of an unscented Kalman filter to guide particle motion. We demonstrate the effectiveness of the unscented Kalman filter PSO by comparing it with…

Neural and Evolutionary Computing · Computer Science 2018-03-21 Chengjia Wang , Keith A. Goatman , James Boardman , Erin Beveridge , David Newby , Scott Semple

The dynamic of real-world optimization problems raises new challenges to the traditional particle swarm optimization (PSO). Responding to these challenges, the dynamic optimization has received considerable attention over the past decade.…

Neural and Evolutionary Computing · Computer Science 2019-03-27 Ahlem Aboud , Raja Fdhila , Adel M. Alimi

This paper proposes a novel global optimization algorithm, Particle Filter-Based Optimization (PFO), designed for a class of stochastic optimization problems in which the objective function lacks an analytical form and is subject to noisy…

Optimization and Control · Mathematics 2025-06-23 Mostafa Eslami , Maryam Babazadeh

The analysis of vast amounts of data constitutes a major challenge in modern high energy physics experiments. Machine learning (ML) methods, typically trained on simulated data, are often employed to facilitate this task. Several choices…

High Energy Physics - Experiment · Physics 2021-02-25 Laurits Tani , Diana Rand , Christian Veelken , Mario Kadastik

The article presents a study of the Particle Swarm optimization method for scheduling problem. To improve the method's performance a restriction of particles' velocity and an evolutionary meta-optimization were realized. The approach…

Neural and Evolutionary Computing · Computer Science 2020-06-22 Pavel Matrenin , Viktor Sekaev

Compared with random sampling, low-discrepancy sampling is more effective in covering the search space. However, the existing research cannot definitely state whether the impact of a low-discrepancy sample on particle swarm optimization…

Neural and Evolutionary Computing · Computer Science 2023-07-04 Feng Wu , Yuelin Zhao , Jianhua Pang , Jun Yan , Wanxie Zhong