English
Related papers

Related papers: Bilevel Distributed Optimization in Directed Netwo…

200 papers

This paper presents a comprehensive review of techniques proposed in the literature for solving bilevel optimization problems encountered in various real-life applications. Bilevel optimization is an appropriate choice for hierarchical…

Optimization and Control · Mathematics 2025-11-06 Dhaval Pujara , Ankur Sinha

In recent years, decentralized bilevel optimization problems have received increasing attention in the networking and machine learning communities thanks to their versatility in modeling decentralized learning problems over peer-to-peer…

Machine Learning · Computer Science 2022-10-07 Zhuqing Liu , Xin Zhang , Prashant Khanduri , Songtao Lu , Jia Liu

This paper deals with an optimization problem over a network of agents, where the cost function is the sum of the individual objectives of the agents and the constraint set is the intersection of local constraints. Most existing methods…

Optimization and Control · Mathematics 2018-06-20 Van Sy Mai , Eyad H. Abed

This paper considers a distributed stochastic strongly convex optimization, where agents connected over a network aim to cooperatively minimize the average of all agents' local cost functions. Due to the stochasticity of gradient estimation…

Optimization and Control · Mathematics 2020-02-17 Jinlong Lei , Peng Yi , Jie Chen , Yiguang Hong

In this paper, a gradient-free distributed algorithm is introduced to solve a set constrained optimization problem under a directed communication network. Specifically, at each time-step, the agents locally compute a so-called…

Optimization and Control · Mathematics 2021-09-06 Yipeng Pang , Guoqiang Hu

In distributed learning, the goal is to perform a learning task over data distributed across multiple nodes with minimal (expensive) communication. Prior work (Daume III et al., 2012) proposes a general model that bounds the communication…

Machine Learning · Computer Science 2012-04-17 Hal Daume , Jeff M. Phillips , Avishek Saha , Suresh Venkatasubramanian

We investigate relaxations for a class of discrete bilevel programs where the interaction constraints linking the leader and the follower are linear. Our approach reformulates the upper-level optimality constraints by projecting the…

Optimization and Control · Mathematics 2024-07-26 Leonardo Lozano , David Bergman , Andre Augusto Cire

In this paper, we propose a distributed algorithm, called Directed-Distributed Gradient Descent (D-DGD), to solve multi-agent optimization problems over directed graphs. Existing algorithms mostly deal with similar problems under the…

Optimization and Control · Mathematics 2016-02-02 Chenguang Xi , Qiong Wu , Usman A. Khan

We formulate an optimization problem for maximizing the data rate of a common message transmitted from nodes within an airborne network broadcast to a central station receiver while maintaining a set of intra-network rate demands. Assuming…

Optimization and Control · Mathematics 2017-06-08 Theodoros Tsiligkaridis

We provide a unifying framework for distributed convex optimization over time-varying networks, in the presence of constraints and uncertainty, features that are typically treated separately in the literature. We adopt a proximal…

Optimization and Control · Mathematics 2017-05-24 Kostas Margellos , Alessandro Falsone , Simone Garatti , Maria Prandini

Bilevel learning refers to machine learning problems that can be formulated as bilevel optimization models, where decisions are organized in a hierarchical structure. This paradigm has recently gained considerable attention in machine…

Optimization and Control · Mathematics 2026-05-05 Riccardo Grazzi , Massimiliano Pontil , Saverio Salzo , Alain Zemkoho

In this paper, we study the distributed optimization problem for a system of agents embedded in time-varying directed communication networks. Each agent has its own cost function and agents cooperate to determine the global decision that…

Optimization and Control · Mathematics 2022-09-27 Angelia Nedich , Duong Thuy Anh Nguyen , Duong Tung Nguyen

This thesis is concerned with the design of distributed algorithms for solving optimization problems. We consider networks where each node has exclusive access to a cost function, and design algorithms that make all nodes cooperate to find…

Optimization and Control · Mathematics 2013-12-03 João F. C. Mota

This paper studies the distributed optimization problem with possibly nonidentical local constraints, where its global objective function is composed of $N$ convex functions. The aim is to solve the considered optimization problem in a…

Optimization and Control · Mathematics 2022-08-26 Hongzhe Liu , Wenwu Yu , Guanghui Wen , Wei Xing Zheng

We study dual-based algorithms for distributed convex optimization problems over networks, where the objective is to minimize a sum $\sum_{i=1}^{m}f_i(z)$ of functions over in a network. We provide complexity bounds for four different…

Optimization and Control · Mathematics 2020-03-17 César A. Uribe , Soomin Lee , Alexander Gasnikov , Angelia Nedić

This paper investigates the distributed continuous-time nonconvex optimization problem over unbalanced directed networks. The objective is to cooperatively drive all the agent states to an optimal solution that minimizes the sum of the…

Optimization and Control · Mathematics 2022-12-01 Jin Zhang , Yahui Hao , Lu Liu , Haibo Ji

We develop distributed algorithms to allocate resources in multi-hop wireless networks with the aim of minimizing total cost. In order to observe the fundamental duplexing constraint that co-located transmitters and receivers cannot operate…

Networking and Internet Architecture · Computer Science 2016-11-15 Yufang Xi , Edmund M. Yeh

We study distributed optimization problems over a network when the communication between the nodes is constrained, and so information that is exchanged between the nodes must be quantized. This imperfect communication poses a fundamental…

Optimization and Control · Mathematics 2018-10-30 Thinh T. Doan , Siva Theja Maguluri , Justin Romberg

This paper focuses on the distributed online convex optimization problem with time-varying inequality constraints over a network of agents, where each agent collaborates with its neighboring agents to minimize the cumulative network-wide…

Optimization and Control · Mathematics 2024-05-06 Kunpeng Zhang , Xinlei Yi , Yuzhe Li , Ming Cao , Tianyou Chai , Tao Yang

We propose a new distributed optimization algorithm for solving a class of constrained optimization problems in which (a) the objective function is separable (i.e., the sum of local objective functions of agents), (b) the optimization…

Optimization and Control · Mathematics 2021-06-16 Van Sy Mai , Richard J. La , Tao Zhang , Abdella Battou