English
Related papers

Related papers: Differentiable Bilevel Programming for Stackelberg…

200 papers

Federated learning (FL) has achieved great success as a privacy-preserving distributed training paradigm, where many edge devices collaboratively train a machine learning model by sharing the model updates instead of the raw data with a…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-21 Yuchang Sun , Jiawei Shao , Yuyi Mao , Songze Li , Jun Zhang

Stochastic gradient descent (SGD) is a promising method for solving large-scale inverse problems, due to its excellent scalability with respect to data size. In this work, we analyze a new data-driven regularized stochastic gradient descent…

Numerical Analysis · Mathematics 2024-09-30 Zehui Zhou

Designing socially optimal policies in multi-agent environments is a fundamental challenge in both economics and artificial intelligence. This paper studies a general framework for learning Stackelberg equilibria in dynamic and uncertain…

Systems and Control · Electrical Eng. & Systems 2025-09-23 Jun He , Andrew L. Liu , Yihsu Chen

We compute equilibrium strategies in multi-stage games with continuous signal and action spaces as they are widely used in the management sciences and economics. Examples include sequential sales via auctions, multi-stage elimination…

Computer Science and Game Theory · Computer Science 2024-07-23 Fabian R. Pieroth , Nils Kohring , Martin Bichler

When using stochastic gradient descent to solve large-scale machine learning problems, a common practice of data processing is to shuffle the training data, partition the data across multiple machines if needed, and then perform several…

Machine Learning · Statistics 2017-10-02 Qi Meng , Wei Chen , Yue Wang , Zhi-Ming Ma , Tie-Yan Liu

In this study, we explore the application of game theory, in particular Stackelberg games, to address the issue of effective coordination strategy generation for heterogeneous robots with one-way communication. To that end, focusing on the…

Robotics · Computer Science 2023-08-01 Yuhan Zhao , Baichuan Huang , Jingjin Yu , Quanyan Zhu

Constrained Markov games offer a formal mathematical framework for modeling multi-agent reinforcement learning problems where the behavior of the agents is subject to constraints. In this work, we focus on the recently introduced class of…

Machine Learning · Computer Science 2024-02-29 Philip Jordan , Anas Barakat , Niao He

In machine learning, the goal of multi-task learning (MTL) is to optimize multiple objectives together. Recent works, for example, Multiple Gradient Descent Algorithm (MGDA) and its variants, show promising results with dynamically adjusted…

Machine Learning · Computer Science 2026-03-10 Xuxing Chen , Yun He , Jiayi Xu , Minhui Huang , Xiaoyi Liu , Boyang Liu , Fei Tian , Xiaohan Wei , Rong Jin , Sem Park , Bo Long , Xue Feng

We analyze stochastic gradient algorithms for optimizing nonconvex problems. In particular, our goal is to find local minima (second-order stationary points) instead of just finding first-order stationary points which may be some bad…

Machine Learning · Computer Science 2019-06-24 Zhize Li

In centralized settings, it is well known that stochastic gradient descent (SGD) avoids saddle points and converges to local minima in nonconvex problems. However, similar guarantees are lacking for distributed first-order algorithms. The…

Optimization and Control · Mathematics 2022-03-07 Brian Swenson , Ryan Murray , H. Vincent Poor , Soummya Kar

Distributed gradient descent (DGD) is an efficient way of implementing gradient descent (GD), especially for large data sets, by dividing the computation tasks into smaller subtasks and assigning to different computing servers (CSs) to be…

Information Theory · Computer Science 2018-11-29 Emre Ozfatura , Deniz Gunduz , Sennur Ulukus

The concept of leader--follower (or Stackelberg) equilibrium plays a central role in a number of real--world applications of game theory. While the case with a single follower has been thoroughly investigated, results with multiple…

Computer Science and Game Theory · Computer Science 2017-07-10 Nicola Basilico , Stefano Coniglio , Nicola Gatti

In this paper, we investigate a new model of a linear-quadratic mean-field stochastic Stackelberg differential game with one leader and two followers, in which the leader is allowed to stop her strategy at a random time. Our overarching…

Optimization and Control · Mathematics 2021-06-08 Zhun Gou , Nan-jing Huang , Ming-hui Wang

We propose a single-level numerical approach to solve Stackelberg mean field game (MFG) problems. In Stackelberg MFG, an infinite population of agents play a non-cooperative game and choose their controls to optimize their individual…

Optimization and Control · Mathematics 2024-04-24 Gokce Dayanikli , Mathieu Lauriere

In this work, a novel Stackelberg game theoretic framework is proposed for trading energy bidirectionally between the demand-response (DR) aggregator and the prosumers. This formulation allows for flexible energy arbitrage and additional…

Machine Learning · Computer Science 2024-10-28 Styliani I. Kampezidou , Justin Romberg , Kyriakos G. Vamvoudakis , Dimitri N. Mavris

A wide range of decision problems can be formulated as bilevel programs with independent followers, which as a special case include two-stage stochastic programs. These problems are notoriously difficult to solve especially when a large…

Optimization and Control · Mathematics 2025-09-25 Timothy C. Y. Chan , Bo Lin , Shoshanna Saxe

In this paper,we mainly focus on the numerical solution of high-dimensional stochastic optimal control problem driven by fully-coupled forward-backward stochastic differential equations (FBSDEs in short) through deep learning. We first…

Optimization and Control · Mathematics 2024-08-21 Shaolin Ji , Shige Peng , Ying Peng , Xichuan Zhang

Motivated by the complex dynamics of cooperative and competitive interactions within networked agent systems, multi-cluster games provide a framework for modeling the interconnected goals of self-interested clusters of agents. For this…

Optimization and Control · Mathematics 2024-04-24 Duong Thuy Anh Nguyen , Mattia Bianchi , Florian Dörfler , Duong Tung Nguyen , Angelia Nedić

We study a bilevel optimization problem which is a zero-sum Stackelberg game. In this problem, there are two players, a leader and a follower, who pick items from a common set. Both the leader and the follower have their own…

Data Structures and Algorithms · Computer Science 2022-04-26 Lin Chen , Xiaoyu Wu , Guochuan Zhang

This paper studies the convergence of clipped stochastic gradient descent (SGD) algorithms with decision-dependent data distribution. Our setting is motivated by privacy preserving optimization algorithms that interact with performative…

Optimization and Control · Mathematics 2025-01-31 Qiang Li , Michal Yemini , Hoi-To Wai