English
Related papers

Related papers: A Survey of ADMM Variants for Distributed Optimiza…

200 papers

This paper investigates the cooperative planning and control problem for multiple connected autonomous vehicles (CAVs) in different scenarios. In the existing literature, most of the methods suffer from significant problems in computational…

Multiagent Systems · Computer Science 2021-01-05 Xiaoxue Zhang , Zilong Cheng , Jun Ma , Sunan Huang , Frank L. Lewis , Tong Heng Lee

We propose a distributed nonparametric algorithm for solving measure-valued optimization problems with additive objectives. Such problems arise in several contexts in stochastic learning and control including Langevin sampling from an…

Optimization and Control · Mathematics 2022-02-21 Iman Nodozi , Abhishek Halder

In this paper, we aim to provide a comprehensive analysis on the linear rate convergence of the alternating direction method of multipliers (ADMM) for solving linearly constrained convex composite optimization problems. Under a certain…

Optimization and Control · Mathematics 2015-08-11 Deren Han , Defeng Sun , Liwei Zhang

This paper develops efficient algorithms for distributed average consensus with quantized communication using the alternating direction method of multipliers (ADMM). We first study the effects of probabilistic and deterministic…

Systems and Control · Computer Science 2016-12-05 Shengyu Zhu , Biao Chen

Alternating Direction Method of Multipliers (ADMM) has recently been proposed as a potential alternative optimizer to the Stochastic Gradient Descent(SGD) for deep learning problems. This is because ADMM can solve gradient vanishing and…

Optimization and Control · Mathematics 2021-06-24 Junxiang Wang , Zheng Chai , Yue Cheng , Liang Zhao

This work proposes a novel adaptive linearized alternating direction multiplier method (LADMM) to convex optimization, which improves the convergence rate of the LADMM-based algorithm by adjusting step-size iteratively.The innovation of…

Optimization and Control · Mathematics 2024-07-04 Boran Wang

By enabling the nodes or agents to solve small-sized subproblems to achieve coordination, distributed algorithms are favored by many networked systems for efficient and scalable computation. While for convex problems, substantial…

Optimization and Control · Mathematics 2022-08-24 Yu Yang , Qing-Shan Jia , Zhanbo Xu , Xiaohong Guan , Costas J. Spanos

This paper presents a novel distributed robust optimization scheme for steering distributions of multi-agent systems under stochastic and deterministic uncertainty. Robust optimization is a subfield of optimization which aims to discover an…

Robotics · Computer Science 2025-01-31 Arshiya Taj Abdul , Augustinos D. Saravanos , Evangelos A. Theodorou

The parallel alternating direction method of multipliers (ADMM) algorithm is widely recognized for its effectiveness in handling large-scale datasets stored in a distributed manner, making it a popular choice for solving statistical…

Machine Learning · Statistics 2023-11-22 Xiaofei Wu , Zhimin Zhang , Zhenyu Cui

We study the AutoML problem of automatically configuring machine learning pipelines by jointly selecting algorithms and their appropriate hyper-parameters for all steps in supervised learning pipelines. This black-box (gradient-free)…

The Alternating Direction Method of Multipliers (ADMM) and its distributed version have been widely used in machine learning. In the iterations of ADMM, model updates using local private data and model exchanges among agents impose critical…

Machine Learning · Computer Science 2020-08-12 Jiahao Ding , Jingyi Wang , Guannan Liang , Jinbo Bi , Miao Pan

This paper investigates non-myopic path planning of mobile sensors for multi-target tracking. Such problem has posed a high computational complexity issue and/or the necessity of high-level decision making. Existing works tackle these…

Robotics · Computer Science 2019-11-15 Soon-Seo Park , Youngjae Min , Jung-Su Ha , Doo-Hyun Cho , Han-Lim Choi

Distributed optimization is a fundamental framework for collaborative inference and decision making in decentralized multi-agent systems. The operation is modeled as the joint minimization of a shared objective which typically depends on…

Optimization and Control · Mathematics 2024-08-21 Yoav Noah , Nir Shlezinger

Alternating direction method of multiplier (ADMM) is a powerful method to solve decentralized convex optimization problems. In distributed settings, each node performs computation with its local data and the local results are exchanged…

Machine Learning · Computer Science 2019-10-11 Xueru Zhang , Mohammad Mahdi Khalili , Mingyan Liu

Alternating direction method of multiplier (ADMM) is a powerful method to solve decentralized convex optimization problems. In distributed settings, each node performs computation with its local data and the local results are exchanged…

Cryptography and Security · Computer Science 2018-10-09 Xueru Zhang , Mohammad Mahdi Khalili , Mingyan Liu

This paper proposes a provably convergent multiblock ADMM for nonconvex optimization with nonlinear dynamics constraints, overcoming the divergence issue in classical extensions. We consider a class of optimization problems that arise from…

Optimization and Control · Mathematics 2025-06-24 Bowen Li , Ya-xiang Yuan

Many practical applications of optimal control are subject to real-time computational constraints. When applying model predictive control (MPC) in these settings, respecting timing constraints is achieved by limiting the number of…

Optimization and Control · Mathematics 2024-12-16 Anusha Srikanthan , Aren Karapetyan , Vijay Kumar , Nikolai Matni

Recent advances in neural-network architecture allow for seamless integration of convex optimization problems as differentiable layers in an end-to-end trainable neural network. Integrating medium and large scale quadratic programs into a…

Optimization and Control · Mathematics 2021-12-15 Andrew Butler , Roy Kwon

This paper proposes a novel numerical method for solving the problem of decision making under cumulative prospect theory (CPT), where the goal is to maximize utility subject to practical constraints, assuming only finite realizations of the…

Optimization and Control · Mathematics 2024-04-29 Xiangyu Cui , Rujun Jiang , Yun Shi , Rufeng Xiao , Yifan Yan

In decentralized consensus optimization, a connected network of agents collaboratively minimize the sum of their local objective functions over a common decision variable, where their information exchange is restricted between the…

Optimization and Control · Mathematics 2015-06-16 Wei Shi , Qing Ling , Kun Yuan , Gang Wu , Wotao Yin