English
Related papers

Related papers: Hamiltonian Monte Carlo Particle Swarm Optimizer

200 papers

Hamiltonian Monte Carlo (HMC) is a state-of-the-art Markov chain Monte Carlo sampling algorithm for drawing samples from smooth probability densities over continuous spaces. We study the variant most widely used in practice, Metropolized…

Machine Learning · Statistics 2021-01-12 Yuansi Chen , Raaz Dwivedi , Martin J. Wainwright , Bin Yu

This paper introduces application of the Exponentially Averaged Momentum Particle Swarm Optimization (EM-PSO) as a derivative-free optimizer for Neural Networks. It adopts PSO's major advantages such as search space exploration and higher…

Machine Learning · Computer Science 2021-04-21 Urvil Nileshbhai Jivani , Omatharv Bharat Vaidya , Anwesh Bhattacharya , Snehanshu Saha

Business optimization is becoming increasingly important because all business activities aim to maximize the profit and performance of products and services, under limited resources and appropriate constraints. Recent developments in…

Optimization and Control · Mathematics 2012-03-30 Xin-She Yang , Suash Deb , Simon Fong

We develop qubit Hamiltonian single parameter estimation techniques using a Bayesian approach. The algorithms considered are restricted to projective measurements in a fixed basis, and are derived under the assumption that the qubit…

Quantum Physics · Physics 2012-10-17 Alexandr Sergeevich , Stephen D. Bartlett

The combining of a General-Purpose Particle Swarm Optimizer (GP-PSO) with Sequential Quadratic Programming (SQP) algorithm for constrained optimization problems has been shown to be highly beneficial to the refinement, and in some cases,…

Neural and Evolutionary Computing · Computer Science 2021-01-27 Carwyn Pelley , Mauro S. Innocente , Johann Sienz

Particle Swarm Optimization (PSO) has emerged as a powerful metaheuristic global optimization approach over the past three decades. Its appeal lies in its ability to tackle complex multidimensional problems that defy conventional…

Neural and Evolutionary Computing · Computer Science 2023-12-18 Arun K Pujari , Sowmini Devi Veeramachaneni

Transport processes are universal in real-world complex networks, such as communication and transportation networks. As the increase of the traffic in these complex networks, problems like traffic congestion and transport delay are becoming…

Networking and Internet Architecture · Computer Science 2024-10-30 Jiexin Wu , Cunlai Pu , Shuxin Ding , Guo Cao , Panos M. Pardalos

Hamiltonian Monte Carlo is a prominent Markov Chain Monte Carlo algorithm, which employs symplectic integrators to sample from high dimensional target distributions in many applications, such as statistical mechanics, Bayesian statistics…

Numerical Analysis · Mathematics 2025-02-13 Geoffrey McGregor , Andy T. S. Wan

Identifying optimal designs for generalized linear models with a binary response can be a challenging task, especially when there are both continuous and discrete independent factors in the model. Theoretical results rarely exist for such…

Applications · Statistics 2016-02-09 Joshua Lukemire , Abhyuday Mandal , Weng Kee Wong

In this work, the Particle Swarm Optimization (PSO) algorithm has been used to train various Variational Quantum Circuits (VQCs). This approach is motivated by the fact that commonly used gradient-based optimization methods can suffer from…

Quantum Physics · Physics 2025-09-22 Marco Mordacci , Michele Amoretti

Particle Swarm Optimization (PSO) is susceptible to premature convergence when the swarm collapses around the global best, particularly on multimodal landscapes in higher dimensions. We propose Divergence-guided PSO (DPSO), which augments…

Computational Engineering, Finance, and Science · Computer Science 2026-04-15 Kleyton da Costa , Bernardo Modenesi , Ivan F. M. Menezes , Hélio Lopes

The problem of sampling constrained continuous distributions has frequently appeared in many machine/statistical learning models. Many Monte Carlo Markov Chain (MCMC) sampling methods have been adapted to handle different types of…

Computation · Statistics 2023-02-21 Shiwei Lan , Lulu Kang

Evolutionary computation (EC) algorithms, such as discrete and multi-objective versions of particle swarm optimization (PSO), have been applied to solve the Feature selection (FS) problem, tackling the combinatorial explosion of search…

Neural and Evolutionary Computing · Computer Science 2019-01-28 Hassen Dhrif , Luis G. Sanchez Giraldo , Miroslav Kubat , Stefan Wuchty

Novel applications of artificial intelligence for tuning the parameters of industrial machines for optimal performance are emerging at a fast pace. Tuning the combine harvesters and improving the machine performance can dramatically…

Signal Processing · Electrical Eng. & Systems 2020-02-26 Laszlo Nadai , Felde Imre , Sina Ardabili , Tarahom Mesri Gundoshmian , Pinter Gergo , Amir Mosavi

For big data analysis, high computational cost for Bayesian methods often limits their applications in practice. In recent years, there have been many attempts to improve computational efficiency of Bayesian inference. Here we propose an…

Computation · Statistics 2017-04-19 Cheng Zhang , Babak Shahbaba , Hongkai Zhao

Land use and land cover (LULC) classification using remote sensing imagery plays a vital role in many environment modeling and land use inventories. In this study, a hybrid feature optimization algorithm along with a deep learning…

Image and Video Processing · Electrical Eng. & Systems 2020-11-10 R. Ganesh Babu , K. Uma Maheswari , C. Zarro , B. D. Parameshachari , S. L. Ullo

In Bayesian inference, Hamiltonian Monte Carlo (HMC) is a popular Markov Chain Monte Carlo (MCMC) algorithm known for its efficiency in sampling from complex probability distributions. However, its application to models with latent…

Computation · Statistics 2025-04-15 Alaa Amri , Víctor Elvira , Amy L. Wilson

When using machine learning (ML) techniques, users typically need to choose a plethora of algorithm-specific parameters, referred to as hyperparameters. In this paper, we compare the performance of two algorithms, particle swarm…

Data Analysis, Statistics and Probability · Physics 2023-10-16 Laurits Tani , Christian Veelken

Bio-inspired optimization algorithms have been gaining more popularity recently. One of the most important of these algorithms is particle swarm optimization (PSO). PSO is based on the collective intelligence of a swam of particles. Each…

Neural and Evolutionary Computing · Computer Science 2013-12-09 Muhammad Marwan Muhammad Fuad

The dynamic of real-world optimization problems raises new challenges to the traditional particle swarm optimization (PSO). Responding to these challenges, the dynamic optimization has received considerable attention over the past decade.…

Neural and Evolutionary Computing · Computer Science 2019-03-27 Ahlem Aboud , Raja Fdhila , Adel M. Alimi