English
Related papers

Related papers: Distributed Global Optimization (DGO)

200 papers

This paper presents an evolutionary algorithm with a new goal-sequence domination scheme for better decision support in multi-objective optimization. The approach allows the inclusion of advanced hard/soft priority and constraint…

Artificial Intelligence · Computer Science 2011-06-02 E. F. Khor , T. H. Lee , R. Sathikannan , K. C. Tan

We consider a class of popular distributed non-convex optimization problems, in which agents connected by a network $\mathcal{G}$ collectively optimize a sum of smooth (possibly non-convex) local objective functions. We address the…

Optimization and Control · Mathematics 2020-01-08 Haoran Sun , Mingyi Hong

Distributed optimization aims to leverage the local computation and communication capabilities of each agent to achieve a desired global objective. This paper addresses the distributed pose graph optimization (PGO) problem under non-convex…

Systems and Control · Electrical Eng. & Systems 2025-03-11 Zeinab Ebrahimi , Mohammad Deghat

Decentralized learning has emerged as a powerful approach for handling large datasets across multiple machines in a communication-efficient manner. However, such methods often face scalability limitations, as increasing the number of…

Machine Learning · Computer Science 2025-06-03 Ofri Eisen , Ron Dorfman , Kfir Y. Levy

Moment-based distributionally robust optimization (DRO) provides an optimization framework to integrate statistical information with traditional optimization approaches. Under this framework, one assumes that the underlying joint…

Optimization and Control · Mathematics 2023-11-01 Shiyi Jiang , Jianqiang Cheng , Kai Pan , Zuo-Jun Max Shen

Distributed optimization enables networked agents to cooperatively solve a global optimization problem even with each participating agent only having access to a local partial view of the objective function. Despite making significant…

Optimization and Control · Mathematics 2022-10-04 Yongqiang Wang , Tamer Başar

Stochastic Optimization (SO) is a classical approach for optimization under uncertainty that typically requires knowledge about the probability distribution of uncertain parameters. As the latter is often unknown, Distributionally Robust…

This thesis explores a particular class of distributed optimization methods for various separable resource allocation problems, which are of high interest in a wide array of multi-agent settings. A distinctly motivating application for this…

Systems and Control · Electrical Eng. & Systems 2021-03-26 Tor Anderson

We study optimization algorithms for the finite sum problems frequently arising in machine learning applications. First, we propose novel variants of stochastic gradient descent with a variance reduction property that enables linear…

Machine Learning · Computer Science 2017-07-06 Jakub Konečný

Diffusion models have achieved remarkable progress in the field of image generation due to their outstanding capabilities. However, these models require substantial computing resources because of the multi-step denoising process during…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Haowei Zhu , Dehua Tang , Ji Liu , Mingjie Lu , Jintu Zheng , Jinzhang Peng , Dong Li , Yu Wang , Fan Jiang , Lu Tian , Spandan Tiwari , Ashish Sirasao , Jun-Hai Yong , Bin Wang , Emad Barsoum

Although the field of distributed optimization is well-developed, relevant literature focused on the application of distributed optimization to multi-robot problems is limited. This survey constitutes the second part of a two-part series on…

Robotics · Computer Science 2024-12-02 Ola Shorinwa , Trevor Halsted , Javier Yu , Mac Schwager

Nowadays, optimization problem have more application in all major but they have problem in computation. Computation global point in continuous functions have high calculation and this became clearer in large space .In this paper, we…

Neural and Evolutionary Computing · Computer Science 2013-07-23 Masoumeh Vali

In this paper, we study distributed stochastic optimization to minimize a sum of smooth and strongly-convex local cost functions over a network of agents, communicating over a strongly-connected graph. Assuming that each agent has access to…

Machine Learning · Computer Science 2019-04-11 Ran Xin , Anit Kumar Sahu , Usman A. Khan , Soummya Kar

The paper considers distributed stochastic optimization over randomly switching networks, where agents collaboratively minimize the average of all agents' local expectation-valued convex cost functions. Due to the stochasticity in gradient…

Optimization and Control · Mathematics 2022-04-07 Jinlong Lei , Peng Yi , Jie Chen , Yiguang Hong

Multi-objective optimization (MOO) has received growing attention in applications that require learning under multiple criteria. However, the existing MOO formulations do not explicitly account for distributional shifts in the data. We…

Machine Learning · Computer Science 2026-05-08 Yufeng Yang , Fangning Zhuo , Ziyi Chen , Heng Huang , Yi Zhou

This paper delves into the investigation of a distributed aggregative optimization problem within a network. In this scenario, each agent possesses its own local cost function, which relies not only on the local state variable but also on…

Optimization and Control · Mathematics 2025-04-01 Jiaxu Liu , Song Chen , Shengze Cai , Chao Xu , Jian Chu

In this paper, we propose a framework under which the decentralized optimization algorithms suggested in \cite{JKJJ,MA, NO,NO2} can be treated in a unified manner. More precisely, we show that the distributed subgradient descent algorithms…

Optimization and Control · Mathematics 2021-08-05 Woocheol Choi , Doheon Kim , Seok-Bae Yun

In this paper, we consider distributed optimization problems where $n$ agents, each possessing a local cost function, collaboratively minimize the average of the local cost functions over a connected network. To solve the problem, we…

Optimization and Control · Mathematics 2023-03-24 Kun Huang , Xiao Li , Andre Milzarek , Shi Pu , Junwen Qiu

Compared with the fixed-run designs, the sequential adaptive designs (SAD) are thought to be more efficient and effective. Efficient global optimization (EGO) is one of the most popular SAD methods for expensive black-box optimization…

Machine Learning · Computer Science 2020-10-22 Jianhui Ning , Yao Xiao , Zikang Xiong

Optimization problems aim to find the optimal solution, which is becoming increasingly complex and difficult to solve. Traditional evolutionary optimization methods always overlook the granular characteristics of solution space. In the real…

Machine Learning · Computer Science 2025-02-19 Shuyin Xia , Xinyu Lin , Guan Wang , De-Gang Chen , Sen Zhao , Guoyin Wang , Jing Liang