English
Related papers

Related papers: Bilevel optimization in flow networks: A message-p…

200 papers

Optimization networks are a new methodology for holistically solving interrelated problems that have been developed with combinatorial optimization problems in mind. In this contribution we revisit the core principles of optimization…

We propose an algorithm for distributed optimization over time-varying communication networks. Our algorithm uses an optimized ratio between the number of rounds of communication and gradient evaluations to achieve fast convergence. The…

Optimization and Control · Mathematics 2020-01-08 Bryan Van Scoy , Laurent Lessard

Bilevel optimization has become a powerful framework in various machine learning applications including meta-learning, hyperparameter optimization, and network architecture search. There are generally two classes of bilevel optimization…

Machine Learning · Computer Science 2021-08-03 Kaiyi Ji

A wide range of decision problems can be formulated as bilevel programs with independent followers, which as a special case include two-stage stochastic programs. These problems are notoriously difficult to solve especially when a large…

Optimization and Control · Mathematics 2025-09-25 Timothy C. Y. Chan , Bo Lin , Shoshanna Saxe

We propose a distributed algorithm for controlling traffic signals, allowing constraints such as periodic switching sequences of phases and minimum and maximum green time to be incorporated. Our algorithm is adapted from backpressure…

Systems and Control · Computer Science 2014-07-07 Tichakorn Wongpiromsarn , Tawit Uthaicharoenpong , Emilio Frazzoli , Yu Wang , Danwei Wang

Graph Neural Networks (GNNs) have achieved tremendous success in a variety of real-world applications by relying on the fixed graph data as input. However, the initial input graph might not be optimal in terms of specific downstream tasks,…

Machine Learning · Computer Science 2023-09-22 Beidi Zhao , Boxin Du , Zhe Xu , Liangyue Li , Hanghang Tong

Many large-scale constrained optimization problems can be formulated as bilevel distributed optimization tasks over undirected networks, where agents collaborate to minimize a global cost function while adhering to constraints, relying only…

Optimization and Control · Mathematics 2025-11-25 Ajay Tak , Mayank Baranwal

The packet is the fundamental unit of transportation in modern communication networks such as the Internet. Physical layer scheduling decisions are made at the level of packets, and packet-level models with exogenous arrival processes have…

Networking and Internet Architecture · Computer Science 2010-03-05 Ciamac Moallemi , Devavrat Shah

Data flow analysis and optimization is considered for homogeneous rectangular mesh networks. We propose a flow matrix equation which allows a closed-form characterization of the nature of the minimal time solution, speedup and a simple…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-30 Junwei Zhang , Yang Liu , Li Shi , Thomas G. Robertazzi

In modern data center networks, thousands of hosts contend for shared link capacity; the scale of these systems makes centralized scheduling impractical. This article models such scheduling as a bipartite matching problem under…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-14 Moonmoon Mohanty , Gautham Bolar , Preetam Patil , Ayalvadi Ganesh , Jean-Francois Chamberland , Parimal Parag

In this paper, we introduce a new functional point of view on bilevel optimization problems for machine learning, where the inner objective is minimized over a function space. These types of problems are most often solved by using methods…

Machine Learning · Statistics 2024-12-10 Ieva Petrulionyte , Julien Mairal , Michael Arbel

We study an information design problem in transportation networks, in the presence of a random state that affects the travel times on the links. An omniscient system planner -- aiming at reducing congestion -- observes the network state…

Optimization and Control · Mathematics 2025-09-04 Alexia Ambrogio , Leonardo Cianfanelli , Giacomo Como

Bilevel optimization has been widely applied in many important machine learning applications such as hyperparameter optimization and meta-learning. Recently, several momentum-based algorithms have been proposed to solve bilevel optimization…

Machine Learning · Computer Science 2021-12-17 Junjie Yang , Kaiyi Ji , Yingbin Liang

Data-driven machine learning approaches have recently been proposed to facilitate wireless network optimization by learning latent knowledge from historical optimization instances. However, existing methods do not well handle the topology…

Networking and Internet Architecture · Computer Science 2021-01-06 Shuai Zhang , Bo Yin , Yu Cheng

We describe a synchronous distributed algorithm which identifies the edge-biconnected components of a connected network. It requires a leader, and uses messages of size O(log |V|). The main idea is to preorder a BFS spanning tree, and then…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 David Pritchard

In this paper we investigate networks whose evolution is governed by the interaction of a random assembly process and an optimization process. In the first process, new nodes are added one at a time and form connections to randomly selected…

Disordered Systems and Neural Networks · Physics 2011-05-16 Markus Brede

The coflow scheduling problem has emerged as a popular abstraction in the last few years to study data communication problems within a data center. In this basic framework, each coflow has a set of communication demands and the goal is to…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-18 Mosharaf Chowdhury , Samir Khuller , Manish Purohit , Sheng Yang , Jie You

The interconnection network is a crucial subsystem in High-Performance Computing clusters and Data-centers, guaranteeing high bandwidth and low latency to the applications' communication operations. Unfortunately, congestion situations may…

Networking and Internet Architecture · Computer Science 2025-02-04 Jose Rocher-Gonzalez , Jesus Escudero-Sahuquillo , Pedro J. Garcia , Francisco J. Quiles

This paper studies convergence properties of inexact iterative solution schemes for bilevel optimization problems. Bilevel optimization problems emerge in control-aware design optimization, where the system design parameters are optimized…

Optimization and Control · Mathematics 2024-03-26 Torbjørn Cunis Ilya Kolmanovsky

Bilevel optimization is a powerful tool for many machine learning problems, such as hyperparameter optimization and meta-learning. Estimating hypergradients (also known as implicit gradients) is crucial for developing gradient-based methods…

Optimization and Control · Mathematics 2025-05-06 Youran Dong , Junfeng Yang , Wei Yao , Jin Zhang