English
Related papers

Related papers: Towards Parameter-free Distributed Optimization: a…

200 papers

In this paper, we develop a novel dynamic distributed optimal safe consensus protocol to simultaneously achieve safety requirements and output optimal consensus. Specifically, we construct a distributed projection optimization algorithm…

Optimization and Control · Mathematics 2024-01-15 Ji Ma , Shu Liang , Yiguang Hong

In the past few years, the problem of distributed consensus has received a lot of attention, particularly in the framework of ad hoc sensor networks. Most methods proposed in the literature address the consensus averaging problem by…

Information Theory · Computer Science 2009-11-13 Effrosyni Kokiopoulou , Pascal Frossard

Distributed algorithms for solving additive or consensus optimization problems commonly rely on first-order or proximal splitting methods. These algorithms generally come with restrictive assumptions and at best enjoy a linear convergence…

Optimization and Control · Mathematics 2017-05-11 Sina Khoshfetrat Pakazad , Christian A. Naesseth , Fredrik Lindsten , Anders Hansson

In this paper we introduce a class of novel distributed algorithms for solving stochastic big-data convex optimization problems over directed graphs. In the addressed set-up, the dimension of the decision variable can be extremely high and…

Optimization and Control · Mathematics 2020-10-06 Francesco Farina , Giuseppe Notarstefano

The distributed optimization problem is set up in a collection of nodes interconnected via a communication network. The goal is to find the minimizer of a global objective function formed by the addition of partial functions locally known…

Optimization and Control · Mathematics 2022-06-07 Damián Marelli , Yong Xu , Minyue Fu , Zenghong Huang

This paper studies performative risk minimization, a formulation of stochastic optimization under decision-dependent distributions. We consider the general case where the performative risk can be non-convex, for which we develop efficient…

Machine Learning · Computer Science 2024-02-26 Sungwoo Park , Junyeop Kwon , Byeongnoh Kim , Suhyun Chae , Jeeyong Lee , Dabeen Lee

In this paper, a novel distributed optimization framework has been proposed. The key idea is to convert optimization problems into optimal control problems where the objective of each agent is to design the current control input minimizing…

Optimization and Control · Mathematics 2025-04-01 Ziyuan Guo , Yue Sun , Yeming Xu , Liping Zhang , Huanshui Zhang

This paper contributes with a new formal method of spatial discretization of a class of nonlinear distributed parameter systems that allow a port-Hamiltonian representation over a one dimensional manifold. A specific finite dimensional…

Numerical Analysis · Mathematics 2021-04-23 B. C. van Huijgevoort , S. Weiland , H. J. Zwart

This paper investigates the problem of data-driven modeling of port-Hamiltonian systems while preserving their intrinsic Hamiltonian structure and stability properties. We propose a novel neural-network-based port-Hamiltonian modeling…

Systems and Control · Electrical Eng. & Systems 2026-04-16 Binh Nguyen , Nam T. Nguyen , Truong X. Nghiem

Distributed optimization often consists of two updating phases: local optimization and inter-node communication. Conventional approaches require working nodes to communicate with the server every one or few iterations to guarantee…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-17 Chi Zhang , Qianxiao Li

Distributed abstract programs are a novel class of distributed optimization problems where (i) the number of variables is much smaller than the number of constraints and (ii) each constraint is associated to a network node. Abstract…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-11-02 Giuseppe Notarstefano , Francesco Bullo

Within the realm of industrial technology, optimization methods play a pivotal role and are extensively applied across various sectors, including transportation engineering, robotics, and machine learning. With the surge in data volumes,…

Optimization and Control · Mathematics 2024-04-25 Han Long

Decentralized optimization is well studied for smooth unconstrained problems. However, constrained problems or problems with composite terms are an open direction for research. We study structured (or composite) optimization problems, where…

Optimization and Control · Mathematics 2023-04-10 Alexander Rogozin , Anton Novitskii , Alexander Gasnikov

We analyze the convergence rate of various momentum-based optimization algorithms from a dynamical systems point of view. Our analysis exploits fundamental topological properties, such as the continuous dependence of iterates on their…

Optimization and Control · Mathematics 2021-04-13 Michael Muehlebach , Michael I. Jordan

In this paper, we consider a network of processors aiming at cooperatively solving mixed-integer convex programs subject to uncertainty. Each node only knows a common cost function and its local uncertain constraint set. We propose a…

Optimization and Control · Mathematics 2022-07-19 Mohammadreza Chamanbaz , Giuseppe Notarstefano , Francesco Sasso , Roland Bouffanais

Estimating statistical models within sensor networks requires distributed algorithms, in which both data and computation are distributed across the nodes of the network. We propose a general approach for distributed learning based on…

Machine Learning · Computer Science 2012-07-03 Qiang Liu , Alexander Ihler

We propose new methods to speed up convergence of the Alternating Direction Method of Multipliers (ADMM), a common optimization tool in the context of large scale and distributed learning. The proposed method accelerates the speed of…

Machine Learning · Computer Science 2016-04-05 Changkyu Song , Sejong Yoon , Vladimir Pavlovic

We consider distributed convex optimization problems originated from sample average approximation of stochastic optimization, or empirical risk minimization in machine learning. We assume that each machine in the distributed computing…

Optimization and Control · Mathematics 2015-01-05 Yuchen Zhang , Lin Xiao

Meta learning aims at learning how to solve tasks, and thus it allows to estimate models that can be quickly adapted to new scenarios. This work explores distributionally robust minimization in meta learning for system identification.…

Machine Learning · Computer Science 2025-06-24 Matteo Rufolo , Dario Piga , Marco Forgione

Distributed model fitting refers to the process of fitting a mathematical or statistical model to the data using distributed computing resources, such that computing tasks are divided among multiple interconnected computers or nodes, often…

Computation · Statistics 2024-06-04 Xiaofei Wu , Rongmei Liang , Fabio Roli , Marcello Pelillo , Jing Yuan