English
Related papers

Related papers: An Adam-enhanced Particle Swarm Optimizer for Late…

200 papers

This paper introduces AdaSwarm, a novel gradient-free optimizer which has similar or even better performance than the Adam optimizer adopted in neural networks. In order to support our proposed AdaSwarm, a novel Exponentially weighted…

Neural and Evolutionary Computing · Computer Science 2024-05-28 Rohan Mohapatra , Snehanshu Saha , Carlos A. Coello Coello , Anwesh Bhattacharya , Soma S. Dhavala , Sriparna Saha

This paper proposes an evolutionary Particle Filter with a memory guided proposal step size update and an improved, fully-connected Quantum-behaved Particle Swarm Optimization (QPSO) resampling scheme for visual tracking applications. The…

Neural and Evolutionary Computing · Computer Science 2018-06-06 Saptarshi Sengupta , Richard Alan Peters

Particle swarm optimization (PSO) is a search algorithm based on stochastic and population-based adaptive optimization. In this paper, a pathfinding strategy is proposed to improve the efficiency of path planning for a broad range of…

Neural and Evolutionary Computing · Computer Science 2022-06-24 David , Budi Adiperdana

The analysis of vast amounts of data constitutes a major challenge in modern high energy physics experiments. Machine learning (ML) methods, typically trained on simulated data, are often employed to facilitate this task. Several choices…

High Energy Physics - Experiment · Physics 2021-02-25 Laurits Tani , Diana Rand , Christian Veelken , Mario Kadastik

Large Language Models (LLMs) have shown impressive performance as general purpose agents, but their abilities remain highly dependent on prompts which are hand written with onerous trial-and-error effort. We propose a simple and…

Computation and Language · Computer Science 2023-10-20 Reid Pryzant , Dan Iter , Jerry Li , Yin Tat Lee , Chenguang Zhu , Michael Zeng

Particle swarm optimization (PSO) method cannot be directly used in the problem of hyper-parameter estimation since the mathematical formulation of the mapping from hyper-parameters to loss function or generalization accuracy is unclear.…

Machine Learning · Computer Science 2020-12-15 Yaru Li , Yulai Zhang

We investigate the role of the optimizer in determining the quality of the model fit for neural networks with a small to medium number of parameters. We study the performance of Adam, an algorithm for first-order gradient-based optimization…

Machine Learning · Computer Science 2022-05-17 John Taylor , Wenyi Wang , Biswajit Bala , Tomasz Bednarz

The combination of Federated Learning (FL), Multimodal Large Language Models (MLLMs), and edge-cloud computing enables distributed and real-time data processing while preserving privacy across edge devices and cloud infrastructure. However,…

Neural and Evolutionary Computing · Computer Science 2025-02-19 Gaith Rjouba , Hanae Elmekki , Saidul Islam , Jamal Bentahar , Rachida Dssouli

We develop Probabilistic Targeted Factor Analysis (PTFA), a likelihood-based framework for constructing latent factors that are explicitly targeted to variables of economic interest. PTFA provides a probabilistic foundation for Partial…

Econometrics · Economics 2026-01-12 Miguel C. Herculano , Santiago Montoya-Blandón

Failure Analysis (FA) is a highly intricate and knowledge-intensive process. The integration of AI components within the computational infrastructure of FA labs has the potential to automate a variety of tasks, including the detection of…

Artificial Intelligence · Computer Science 2025-09-03 Aline Dobrovsky , Konstantin Schekotihin , Christian Burmer

Particle swarm optimization (PSO) is an iterative search method that moves a set of candidate solution around a search-space towards the best known global and local solutions with randomized step lengths. PSO frequently accelerates…

Neural and Evolutionary Computing · Computer Science 2021-02-25 Johannes Jakubik , Adrian Binding , Stefan Feuerriegel

Particle Swarm Optimization (PSO) is a metaheuristic global optimization paradigm that has gained prominence in the last two decades due to its ease of application in unsupervised, complex multidimensional problems which cannot be solved…

Neural and Evolutionary Computing · Computer Science 2019-01-07 Saptarshi Sengupta , Sanchita Basak , Richard Alan Peters

This paper introduces a reinforcement learning framework that employs Proximal Policy Optimization (PPO) to dynamically optimize the weights of multiple large language model (LLM)-generated formulaic alphas for stock trading strategies.…

Computational Engineering, Finance, and Science · Computer Science 2026-03-05 Qizhao Chen , Hiroaki Kawashima

PSO is a widely recognized optimization algorithm inspired by social swarm. In this brief we present a heterogeneous strategy particle swarm optimization (HSPSO), in which a proportion of particles adopt a fully informed strategy to enhance…

Neural and Evolutionary Computing · Computer Science 2016-08-02 Wen-Bo Du , Wen Ying , Gang Yan , Yan-Bo Zhu , Xian-Bin Cao

We propose Data Swarms, an algorithm to optimize the generation of synthetic evaluation data and advance quantitative desiderata of LLM evaluation. We first train a swarm of initial data generators using existing data, and define various…

Computation and Language · Computer Science 2025-06-09 Shangbin Feng , Yike Wang , Weijia Shi , Yulia Tsvetkov

Identifying optimal designs for generalized linear models with a binary response can be a challenging task, especially when there are both continuous and discrete independent factors in the model. Theoretical results rarely exist for such…

Applications · Statistics 2016-02-09 Joshua Lukemire , Abhyuday Mandal , Weng Kee Wong

This paper presents a novel approach to optimizing pricing and replenishment strategies in fresh food supermarkets by combining Long Short-Term Memory (LSTM) networks with Particle Swarm Optimization (PSO). The LSTM model, enhanced with an…

Machine Learning · Computer Science 2025-09-17 Xianchen Liu , Tianhui Zhang , Xinyu Zhang , Lingmin Hou , Zhen Guo , Yuanhao Tian , Yang Liu

Human preference alignment is essential to improve the interaction quality of large language models (LLMs). Existing alignment methods depend on manually annotated preference data to guide the LLM optimization directions. However,…

Computation and Language · Computer Science 2024-06-04 Pengyu Cheng , Yifan Yang , Jian Li , Yong Dai , Tianhao Hu , Peixin Cao , Nan Du , Xiaolong Li

Ant Colony System (ACS) is a distributed (agent- based) algorithm which has been widely studied on the Symmetric Travelling Salesman Problem (TSP). The optimum parameters for this algorithm have to be found by trial and error. We use a…

Optimization and Control · Mathematics 2018-03-23 D Gómez-Cabrero , D. N. Ranasinghe

Traditional methods present a very restrictive range of applications, mainly limited by the features of the function to be optimized and of the constraint functions. In contrast, evolutionary algorithms present almost no restriction to the…

Neural and Evolutionary Computing · Computer Science 2021-01-26 Mauro S. Innocente , Johann Sienz