English
Related papers

Related papers: CMA-ES for Discrete and Mixed-Variable Optimizatio…

200 papers

In expensive multi-objective optimization, where the evaluation budget is strictly limited, selecting promising candidate solutions for expensive fitness evaluations is critical for accelerating convergence and improving algorithmic…

Neural and Evolutionary Computing · Computer Science 2025-06-16 Huixiang Zhen , Xiaotong Li , Wenyin Gong , Xiangyun Hu

Sparsity constrained minimization captures a wide spectrum of applications in both machine learning and signal processing. This class of problems is difficult to solve since it is NP-hard and existing solutions are primarily based on…

Optimization and Control · Mathematics 2018-12-31 Ganzhao Yuan , Bernard Ghanem

We propose a novel information-theoretic approach for Bayesian optimization called Predictive Entropy Search (PES). At each iteration, PES selects the next evaluation point that maximizes the expected information gained with respect to the…

Machine Learning · Statistics 2014-06-11 José Miguel Hernández-Lobato , Matthew W. Hoffman , Zoubin Ghahramani

Urban land-use allocation represents a complex multi-objective optimization problem critical for sustainable urban development policy. This paper presents novel computational intelligence approaches for optimizing land-use allocation in…

Artificial Intelligence · Computer Science 2025-08-26 Sabab Aosaf , Muhammad Ali Nayeem , Afsana Haque , M Sohel Rahman

In this paper, we consider the nonsmooth convex optimization problems over the fixed point constraint sets of firmly nonexpansive operators. To find an optimal solution of the problem, we present an iterative method based on the hybrid…

Optimization and Control · Mathematics 2026-03-23 Ontima Pankoon , Nimit Nimana , Yeol Je Cho

The Performance Estimation Problem (PEP) approach consists in computing worst-case performance bounds on optimization algorithms by solving an optimization problem: one maximizes an error criterion over all initial conditions allowed and…

Optimization and Control · Mathematics 2024-02-13 Anne Rubbens , Nizar Bousselmi , Sebastien Colla , Julien M. Hendrickx

Model merging has emerged as a cost-effective alternative to training large language models (LLMs) from scratch, enabling researchers to combine pre-trained models into more capable systems without full retraining. Evolutionary approaches…

Neural and Evolutionary Computing · Computer Science 2026-05-13 Md. Robiul Islam Niloy

Constrained multi-objective optimization problems (CMOPs) pervade real-world applications in science, engineering, and design. Constraint violation has been a building block in designing evolutionary multi-objective optimization algorithms…

Neural and Evolutionary Computing · Computer Science 2024-01-03 Shuang Li , Ke Li , Wei Li , Ming Yang

Dynamic Optimization Problems (DOPs) are challenging to address due to their complex nature, i.e., dynamic environment variation. Evolutionary Computation methods are generally advantaged in solving DOPs since they resemble dynamic…

Neural and Evolutionary Computing · Computer Science 2026-02-02 Zijian Gao , Yuanting Zhong , Zeyuan Ma , Yue-Jiao Gong , Hongshu Guo

This paper presents a stochastic approximation proximal subgradient (SAPS) method for stochastic convex-concave minimax optimization. By accessing unbiased and variance bounded approximate subgradients, we show that this algorithm exhibits…

Optimization and Control · Mathematics 2024-04-01 Yu-Hong Dai , Jiani Wang , Liwei Zhang

This study investigates a downlink rate-splitting multiple access (RSMA) scenario in which multiple base stations (BSs), employing a coordinated multi-point (CoMP) transmission scheme, serve users equipped with movable antenna (MA)…

Signal Processing · Electrical Eng. & Systems 2025-02-25 Ali Amhaz , Shreya Khisa , Mohamed Elhattab , Chadi Assi , Sanaa Sharafeddine

Learning dynamics is essential for model-based control and Reinforcement Learning in engineering systems, such as robotics and power systems. However, limited system measurements, such as those from low-resolution sensors, demand…

Machine Learning · Computer Science 2025-10-07 Haoran Li , Chenhan Xiao , Muhao Guo , Yang Weng

Majorization-minimization algorithms consist of successively minimizing a sequence of upper bounds of the objective function. These upper bounds are tight at the current estimate, and each iteration monotonically drives the objective…

Optimization and Control · Mathematics 2015-02-03 Julien Mairal

We consider a discrete optimization formulation for learning sparse classifiers, where the outcome depends upon a linear combination of a small subset of features. Recent work has shown that mixed integer programming (MIP) can be used to…

Machine Learning · Statistics 2021-06-08 Antoine Dedieu , Hussein Hazimeh , Rahul Mazumder

Now-a-days, it is important to find out solutions of Multi-Objective Optimization Problems (MOPs). Evolutionary Strategy helps to solve such real world problems efficiently and quickly. But sequential Evolutionary Algorithms (EAs) require…

Neural and Evolutionary Computing · Computer Science 2016-11-15 Md. Asadul Islam , G. M. Mashrur-E-Elahi , M. M. A. Hashem

Constrained multi-objective optimization problems (CMOPs) are of great significance in the context of practical applications, ranging from scientific to engineering domains. Most existing constrained multi-objective evolutionary algorithms…

Neural and Evolutionary Computing · Computer Science 2026-03-18 Shuai Shao , Ye Tian , Shangshang Yang , Xingyi Zhang

Scalability of evolutionary algorithms refers to assessing how their performance changes as problem size increases. In the area of multi-objective optimisation, research on the scalability of multi-objective evolutionary algorithms (MOEAs)…

Neural and Evolutionary Computing · Computer Science 2026-04-21 Menghao Tang , Zimin Liang , Miqing Li

This research concerns a type of configuration optimization problems frequently encountered in engineering design and manufacturing, where the envelope volume in space occupied by a number of components needs to be minimized along with…

Computational Engineering, Finance, and Science · Computer Science 2017-06-13 Pei Cao , Zhaoyan Fan , Robert X. Gao , Jiong Tang

Quality-Diversity (QD) optimization is an emerging field that focuses on finding a set of behaviorally diverse and high-quality solutions. While the quality is typically defined w.r.t. a single objective function, recent work on…

Neural and Evolutionary Computing · Computer Science 2025-05-28 Shihan Zhao , Stefanos Nikolaidis

We develop the theory of Energy Conserving Descent (ECD) and introduce ECDSep, a gradient-based optimization algorithm able to tackle convex and non-convex optimization problems. The method is based on the novel ECD framework of…

Machine Learning · Computer Science 2023-06-02 G. Bruno De Luca , Alice Gatti , Eva Silverstein