English
Related papers

Related papers: MOEA/D with Random Partial Update Strategy

200 papers

We introduce a memory- and compute-efficient method for low-communication distributed training. Existing methods reduce communication by performing multiple local updates between infrequent global synchronizations. We demonstrate that their…

Machine Learning · Computer Science 2025-09-29 Anastasiia Filippova , Angelos Katharopoulos , David Grangier , Ronan Collobert

Solving constrained multi-objective optimization problems with evolutionary algorithms has attracted considerable attention. Various constrained multi-objective optimization evolutionary algorithms (CMOEAs) have been developed with the use…

Artificial Intelligence · Computer Science 2024-02-21 Fei Ming , Wenyin Gong , Ling Wang , Yaochu Jin

When working with decomposition-based algorithms, an appropriate set of weights might improve quality of the final solution. A set of uniformly distributed weights usually leads to well-distributed solutions on a Pareto front. However,…

Neural and Evolutionary Computing · Computer Science 2020-03-26 Lucas R. C. de Farias , Pedro H. M. Braga , Hansenclever F. Bassani , Aluizio F. R. Araújo

Existing studies have shown that the conventional multi-objective evolutionary algorithms (MOEAs) based on decomposition may lose the population diversity when solving some many-objective optimization problems. In this paper, a simple…

Neural and Evolutionary Computing · Computer Science 2018-06-29 Yingyu Zhang , Bing Zeng

In several social choice problems, agents collectively make decisions over the allocation of multiple divisible and heterogeneous resources with capacity constraints to maximize utilitarian social welfare. The agents are constrained through…

Optimization and Control · Mathematics 2023-11-02 Syed Eqbal Alam , Fabian Wirth , Jia Yuan Yu , Robert Shorten

Resource allocation and task prioritisation are key problem domains in the fields of autonomous vehicles, networking, and cloud computing. The challenge in developing efficient and robust algorithms comes from the dynamic nature of these…

Artificial Intelligence · Computer Science 2021-02-17 Niall Creech , Natalia Criado Pacheco , Simon Miles

Elitism, which constructs the new population by preserving best solutions out of the old population and newly-generated solutions, has been a default way for population update since its introduction into multi-objective evolutionary…

Neural and Evolutionary Computing · Computer Science 2023-05-29 Zimin Liang , Miqing Li , Per Kristian Lehre

We study a general model on reusable resource allocation under model uncertainty. A heterogeneous population of customers arrive at the decision maker's (DM's) platform sequentially. Upon observing a customer's type, the DM selects an…

Optimization and Control · Mathematics 2022-12-07 Xilin Zhang , Wang Chi Cheung

Distributed optimization methods for large-scale machine learning suffer from a communication bottleneck. It is difficult to reduce this bottleneck while still efficiently and accurately aggregating partial work from different machines. In…

Machine Learning · Computer Science 2015-07-06 Chenxin Ma , Virginia Smith , Martin Jaggi , Michael I. Jordan , Peter Richtárik , Martin Takáč

Conventional wisdom in deep learning optimization dictates updating all layers at every step-a principle followed by all recent state-of-the-art optimizers such as Muon. In this work, we challenge this assumption, showing that full-network…

Machine Learning · Computer Science 2025-10-03 Kaja Gruntkowska , Yassine Maziane , Zheng Qu , Peter Richtárik

Now-a-days, it is important to find out solutions of Multi-Objective Optimization Problems (MOPs). Evolutionary Strategy helps to solve such real world problems efficiently and quickly. But sequential Evolutionary Algorithms (EAs) require…

Neural and Evolutionary Computing · Computer Science 2016-11-15 Md. Asadul Islam , G. M. Mashrur-E-Elahi , M. M. A. Hashem

Decentralized learning (DL) has recently employed local updates to reduce the communication cost for general non-convex optimization problems. Specifically, local updates require each node to perform multiple update steps on the parameters…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-18 Kangyang Luo , Kunkun Zhang , Shengbo Zhang , Xiang Li , Ming Gao

Efficient resource allocation is challenging when privacy of users is important. Distributed approaches have recently been used extensively to find a solution for such problems. In this work, the efficiency of distributed AIMD algorithm for…

Computer Science and Game Theory · Computer Science 2018-04-23 Hamid Nabati , Jia Yuan Yu

This paper presents a novel partially distributed outer approximation algorithm, named PaDOA, for solving a class of structured mixed integer convex programming (MICP) problems to global optimality. The proposed scheme uses an iterative…

Optimization and Control · Mathematics 2019-11-20 Alexander Murray , Timm Faulwasser , Veit Hagenmeyer , Mario E. Villanueva , Boris Houska

Evolutionary algorithms (EAs) have been widely applied to multi-objective optimization due to their population-based nature. Population update, a key component in multi-objective EAs (MOEAs), is usually performed in a greedy, deterministic…

Neural and Evolutionary Computing · Computer Science 2025-09-26 Shengjie Ren , Zimin Liang , Miqing Li , Chao Qian

Distributed optimization for resource allocation problems is investigated and a sub-optimal continuous-time algorithm is proposed. Our algorithm has lower order dynamics than others to reduce burdens of computation and communication, and is…

Optimization and Control · Mathematics 2020-02-13 Shu Liang , Xianlin Zeng , Guanpu Chen , Yiguang Hong

Ranking and selection (R&S) aims to identify the alternative with the best mean performance among $k$ simulated alternatives. The practical value of R&S depends on accurate simulation input modeling, which often suffers from the curse of…

Machine Learning · Statistics 2025-09-09 Zaile Li , Yuchen Wan , L. Jeff Hong

Motivated by broad applications in various fields of engineering, we study a network resource allocation problem where the goal is to optimally allocate a fixed quantity of resources over a network of nodes. We consider large scale networks…

Optimization and Control · Mathematics 2018-08-06 Thinh T. Doan , Carolyn L. Beck

Delayed rewards problem in contextual bandits has been of interest in various practical settings. We study randomized allocation strategies and provide an understanding on how the exploration-exploitation tradeoff is affected by delays in…

Machine Learning · Statistics 2020-05-28 Sakshi Arya , Yuhong Yang

In several smart city applications, multiple resources must be allocated among competing agents that are coupled through such shared resources and are constrained --- either through limitations of communication infrastructure or privacy…

Systems and Control · Computer Science 2023-10-19 Syed Eqbal Alam , Robert Shorten , Fabian Wirth , Jia Yuan Yu