English
Related papers

Related papers: Particle Swarm Based Hyper-Parameter Optimization …

200 papers

Optimization of hyper-parameters in reinforcement learning (RL) algorithms is a key task, because they determine how the agent will learn its policy by interacting with its environment, and thus what data is gathered. In this work, an…

Machine Learning · Computer Science 2019-09-19 Juan Cruz Barsce , Jorge A. Palombarini , Ernesto Martínez

The hyperparameter optimization of neural network can be expressed as a bilevel optimization problem. The bilevel optimization is used to automatically update the hyperparameter, and the gradient of the hyperparameter is the approximate…

Machine Learning · Computer Science 2022-12-14 Shuo Yang , Yang Jiao , Shaoyu Dou , Mana Zheng , Chen Zhu

In recent years, model-agnostic meta-learning (MAML) has become a popular research area. However, the stochastic optimization of MAML is still underdeveloped. Existing MAML algorithms rely on the ``episode'' idea by sampling a few tasks and…

Machine Learning · Computer Science 2023-04-26 Bokun Wang , Zhuoning Yuan , Yiming Ying , Tianbao Yang

Medical image segmentation, particularly for brain tumor analysis, demands precise and computationally efficient models due to the complexity of multimodal MRI datasets and diverse tumor morphologies. This study introduces PSO-UNet, which…

Image and Video Processing · Electrical Eng. & Systems 2025-11-25 Shoffan Saifullah , Rafał Dreżewski

This study investigates the potential of hybrid metaheuristic algorithms to enhance the training of Probabilistic Neural Networks (PNNs) by leveraging the complementary strengths of multiple optimisation strategies. Traditional learning…

Neural and Evolutionary Computing · Computer Science 2025-04-16 Piotr A. Kowalski , Szymon Kucharczyk , Jacek Mańdziuk

Parameter identification for electrochemical battery models has always been challenging due to the multitude of parameters involved, most of which cannot be directly measured. This paper evaluates the efficiency and optimality of three…

Systems and Control · Electrical Eng. & Systems 2025-11-04 Feng Guo , Luis D. Couto , Guillaume Thenaisie

Hyperspherical Prototypical Learning (HPL) is a supervised approach to representation learning that designs class prototypes on the unit hypersphere. The prototypes bias the representations to class separation in a scale invariant and known…

Machine Learning · Computer Science 2025-04-18 Martin Lindström , Borja Rodríguez-Gálvez , Ragnar Thobaben , Mikael Skoglund

We present the particle stochastic approximation EM (PSAEM) algorithm for learning of dynamical systems. The method builds on the EM algorithm, an iterative procedure for maximum likelihood inference in latent variable models. By combining…

Computation · Statistics 2019-12-11 Andreas Lindholm , Fredrik Lindsten

Land use and land cover (LULC) classification using remote sensing imagery plays a vital role in many environment modeling and land use inventories. In this study, a hybrid feature optimization algorithm along with a deep learning…

Image and Video Processing · Electrical Eng. & Systems 2020-11-10 R. Ganesh Babu , K. Uma Maheswari , C. Zarro , B. D. Parameshachari , S. L. Ullo

We provide brief notes on a particle swarm-optimisation approach to constraining the properties of a stochastic gravitational-wave background in the first International Pulsar Timing Array data-challenge. The technique employs many…

Instrumentation and Methods for Astrophysics · Physics 2012-10-15 Stephen R. Taylor , Jonathan R. Gair , L. Lentati

Simulations of colloidal suspensions consisting of mesoscopic particles and smaller species such as ions or depletants are computationally challenging as different length and time scales are involved. Here, we introduce a machine learning…

Soft Condensed Matter · Physics 2021-12-01 Gerardo Campos-Villalobos , Emanuele Boattini , Laura Filion , Marjolein Dijkstra

Machine learning interatomic potentials (MLIPs) enable efficient molecular dynamics (MD) simulations with ab initio accuracy and have been applied across various domains in physical science. However, their performance often relies on…

Computational Physics · Physics 2025-07-29 Taoyong Cui , Zhongyao Wang , Dongzhan Zhou , Yuqiang Li , Lei Bai , Wanli Ouyang , Mao Su , Shufei Zhang

The increasing capabilities of Machine Learning (ML) models go hand in hand with an immense amount of data and computational power required for training. Therefore, training is usually outsourced into HPC facilities, where we have started…

Machine Learning · Computer Science 2025-01-28 Sabrina Herbst , Vincenzo De Maio , Ivona Brandic

Determining the optimal number and identity of structural clusters from an ensemble of molecular configurations continues to be a challenge. Recent structural clustering methods have focused on the use of internal coordinates due to the…

Chemical Physics · Physics 2023-01-11 Heidi Klem , Glen M. Hocky , Martin McCullagh

Machine learning interatomic potentials (MLIPs) enables molecular dynamics (MD) simulations with ab initio accuracy and has been applied to various fields of physical science. However, the performance and transferability of MLIPs are…

Chemical Physics · Physics 2024-04-16 Taoyong Cui , Chenyu Tang , Mao Su , Shufei Zhang , Yuqiang Li , Lei Bai , Yuhan Dong , Xingao Gong , Wanli Ouyang

Evolutionary computation (EC) algorithms, such as discrete and multi-objective versions of particle swarm optimization (PSO), have been applied to solve the Feature selection (FS) problem, tackling the combinatorial explosion of search…

Neural and Evolutionary Computing · Computer Science 2019-01-28 Hassen Dhrif , Luis G. Sanchez Giraldo , Miroslav Kubat , Stefan Wuchty

Human activity discovery aims to cluster the activities performed by humans without any prior information on what defines each activity. Most methods presented in human activity recognition are supervised, where there are labeled inputs to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Parham Hadikhani , Daphne Teck Ching Lai , Wee-Hong Ong

The Particle Swarm Optimization (PSO) algorithm is developed for solving the Schaffer F6 function in fewer than 4000 function evaluations on a total of 30 runs. Four variations of the Full Model of Particle Swarm Optimization (PSO)…

Neural and Evolutionary Computing · Computer Science 2019-11-19 Alison Jenkins , Vinika Gupta , Alexis Myrick , Mary Lenoir

The schooling behavior of fish can be studied through simulations involving a large number of interacting particles. In such systems, each individual particle is guided by behavior rules, which include aggregation towards a centroid,…

Populations and Evolution · Quantitative Biology 2023-10-25 S. Arabeei , S. Subbey

We develop a neuroevolution-potential (NEP) framework for generating neural network based machine-learning potentials. They are trained using an evolutionary strategy for performing large-scale molecular dynamics (MD) simulations. A…

Computational Physics · Physics 2022-01-25 Zheyong Fan , Zezhu Zeng , Cunzhi Zhang , Yanzhou Wang , Haikuan Dong , Yue Chen , Tapio Ala-Nissila