English
Related papers

Related papers: Advancements in Optimization: Adaptive Differentia…

200 papers

In this paper, we develop a symmetric accelerated stochastic Alternating Direction Method of Multipliers (SAS-ADMM) for solving separable convex optimization problems with linear constraints. The objective function is the sum of a possibly…

Optimization and Control · Mathematics 2021-12-21 Jianchao Bai , Deren Han , Hao Sun , Hongchao Zhang

This paper presents a method to solve non-linear integer multiobjective optimization problems. First the problem is formulated using the Technique for Order Preference by Similarity to Ideal Solution (TOPSIS). Next, the Differential…

Neural and Evolutionary Computing · Computer Science 2022-04-07 Renato A. Krohling , Erick R. F. A. Schneider

We develop a new consensus-based distributed algorithm for solving learning problems with feature partitioning and non-smooth convex objective functions. Such learning problems are not separable, i.e., the associated objective functions…

Signal Processing · Electrical Eng. & Systems 2022-08-25 Cristiano Gratton , Naveen K. D. Venkategowda , Reza Arablouei , Stefan Werner

We introduce a novel approach for discriminative classification using evolutionary algorithms. We first propose an algorithm to optimize the total loss value using a modified 0-1 loss function in a one-dimensional space for classification.…

Neural and Evolutionary Computing · Computer Science 2018-04-27 Mohammad Reza Bonyadi , David C. Reutens

Neural architecture search (NAS) automates neural network design by using optimization algorithms to navigate architecture spaces, reducing the burden of manual architecture design. While NAS has achieved success, applying it to emerging…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Yisheng Yang , Guodong Du , Chean Khim Toa , Ho-Kin Tang , Sim Kuan Goh

Data-driven evolutionary optimization has witnessed great success in solving complex real-world optimization problems. However, existing data-driven optimization algorithms require that all data are centrally stored, which is not always…

Neural and Evolutionary Computing · Computer Science 2021-02-17 Jinjin Xu , Yaochu Jin , Wenli Du , Sai Gu

Evolutionary algorithms serve as a powerful paradigm for tackling optimization challenges, yet their reliance on manually engineered heuristics inherently limits their adaptability across diverse landscapes. However, the transition from the…

Neural and Evolutionary Computing · Computer Science 2026-03-04 Jiaxin Gao , Yaohua Liu , Ran Cheng , Kay Chen Tan

Bayesian optimization (BO) has shown impressive results in a variety of applications within low-to-moderate dimensional Euclidean spaces. However, extending BO to high-dimensional settings remains a significant challenge. We address this…

Machine Learning · Statistics 2024-03-11 Shouri Hu , Jiawei Li , Zhibo Cai

An automated sizing approach for analog circuits using evolutionary algorithms is presented in this paper. A targeted search of the search space has been implemented using a particle generation function and a repair-bounds function that has…

Neural and Evolutionary Computing · Computer Science 2023-10-20 Ria Rashid , Gopavaram Raghunath , Vasant Badugu , Nandakumar Nambath

Solving constrained multi-objective optimization problems with evolutionary algorithms has attracted considerable attention. Various constrained multi-objective optimization evolutionary algorithms (CMOEAs) have been developed with the use…

Artificial Intelligence · Computer Science 2024-02-21 Fei Ming , Wenyin Gong , Ling Wang , Yaochu Jin

Evolutionary Strategies (ES) are a popular family of black-box zeroth-order optimization algorithms which rely on search distributions to efficiently optimize a large variety of objective functions. This paper investigates the potential…

Neural and Evolutionary Computing · Computer Science 2019-02-01 Louis Faury , Clement Calauzenes , Olivier Fercoq , Syrine Krichen

Automated hyperparameter tuning aspires to facilitate the application of machine learning for non-experts. In the literature, different optimization approaches are applied for that purpose. This paper investigates the performance of…

Machine Learning · Computer Science 2019-04-16 Mischa Schmidt , Shahd Safarani , Julia Gastinger , Tobias Jacobs , Sebastien Nicolas , Anett Schülke

In this paper, an evolutionary strategy (ES) method is introduced as an optimization approach to solve problems in the manufacturing area. The ES method is applied to a case study for milling operations. The results show that it can…

Optimization and Control · Mathematics 2015-01-08 Zhixin Yang

Residual-based adaptive strategies are widely used in scientific machine learning but remain largely heuristic. We introduce a unifying variational framework that formalizes these methods by integrating convex transformations of the…

Machine Learning · Computer Science 2025-09-29 Juan Diego Toscano , Daniel T. Chen , Vivek Oommen , Jérôme Darbon , George Em Karniadakis

In addition to their undisputed success in solving classical optimization problems, neuroevolutionary and population-based algorithms have become an alternative to standard reinforcement learning methods. However, evolutionary methods often…

Neural and Evolutionary Computing · Computer Science 2021-05-18 Jörg Stork , Martin Zaefferer , Nils Eisler , Patrick Tichelmann , Thomas Bartz-Beielstein , A. E. Eiben

As a typical model-based evolutionary algorithm (EA), estimation of distribution algorithm (EDA) possesses unique characteristics and has been widely applied to global optimization. However, the common-used Gaussian EDA (GEDA) usually…

Neural and Evolutionary Computing · Computer Science 2018-08-01 Yongsheng Liang , Zhigang Ren , Xianghua Yao , Zuren Feng , An Chen

Portfolio optimization is a financial task which requires the allocation of capital on a set of financial assets to achieve a better trade-off between return and risk. To solve this problem, recent studies applied multi-objective…

Neural and Evolutionary Computing · Computer Science 2020-03-17 Yifan He , Claus Aranha

Optimal well placement and well injection-production are crucial for the reservoir development to maximize the financial profits during the project lifetime. Meta-heuristic algorithms have showed good performance in solving complex,…

Neural and Evolutionary Computing · Computer Science 2022-12-16 Guodong Chen , Xin Luo , Jimmy Jiu Jiao , Xiaoming Xue

Evolution strategy (ES) has been shown great promise in many challenging reinforcement learning (RL) tasks, rivaling other state-of-the-art deep RL methods. Yet, there are two limitations in the current ES practice that may hinder its…

Machine Learning · Computer Science 2020-02-24 Jiaxing Zhang , Hoang Tran , Guannan Zhang

Constrained multi-objective optimization problems (CMOPs) are of great significance in the context of practical applications, ranging from scientific to engineering domains. Most existing constrained multi-objective evolutionary algorithms…

Neural and Evolutionary Computing · Computer Science 2026-03-18 Shuai Shao , Ye Tian , Shangshang Yang , Xingyi Zhang