English
Related papers

Related papers: Decentralized Stochastic Bilevel Optimization with…

200 papers

Adam has become one of the most popular optimizers for training modern deep neural networks, such as transformers. However, its applicability is largely restricted to single-level optimization problems. In this paper, we aim to extend…

Machine Learning · Computer Science 2025-03-07 Xiaochuan Gong , Jie Hao , Mingrui Liu

Bilevel optimization has been successfully applied to many important machine learning problems. Algorithms for solving bilevel optimization have been studied under various settings. In this paper, we study the nonconvex-strongly-convex…

Optimization and Control · Mathematics 2022-06-14 Xuxing Chen , Minhui Huang , Shiqian Ma

In this paper, we develop zeroth-order algorithms with provably (nearly) optimal sample complexity for stochastic bilevel optimization, where only noisy function evaluations are available. We propose two distinct algorithms: the first is…

Optimization and Control · Mathematics 2025-10-07 Alireza Aghasi , Jeongyeol Kwon , Saeed Ghadimi

Stochastic multi-level compositional optimization problems cover many new machine learning paradigms, e.g., multi-step model-agnostic meta-learning, which require efficient optimization algorithms for large-scale data. This paper studies…

Machine Learning · Computer Science 2024-06-03 Hongchang Gao

Bilevel optimization have gained growing interests, with numerous applications found in meta learning, minimax games, reinforcement learning, and nested composition optimization. This paper studies the problem of distributed bilevel…

Machine Learning · Statistics 2022-06-23 Shuoguang Yang , Xuezhou Zhang , Mengdi Wang

Decentralized optimization is critical for solving large-scale machine learning problems over distributed networks, where multiple nodes collaborate through local communication. In practice, the variances of stochastic gradient estimators…

Optimization and Control · Mathematics 2026-02-13 Hongxu Chen , Ke Wei , Luo Luo

We study bilevel optimization problems where the lower-level problems are strongly convex and have coupled linear constraints. To overcome the potential non-smoothness of the hyper-objective and the computational challenges associated with…

Optimization and Control · Mathematics 2026-02-06 Wei Shen , Jiawei Zhang , Minhui Huang , Cong Shen

Bilevel optimization is widely applied in many machine learning tasks such as hyper-parameter learning, meta learning and reinforcement learning. Although many algorithms recently have been developed to solve the bilevel optimization…

Optimization and Control · Mathematics 2024-07-26 Feihu Huang

Collaborative learning is an important tool to train multiple clients more effectively by enabling communication among clients. Identifying helpful clients, however, presents challenging and often introduces significant overhead. In this…

Machine Learning · Computer Science 2024-09-10 Diba Hashemi , Lie He , Martin Jaggi

Bilevel optimization has been widely applied in many important machine learning applications such as hyperparameter optimization and meta-learning. Recently, several momentum-based algorithms have been proposed to solve bilevel optimization…

Machine Learning · Computer Science 2021-12-17 Junjie Yang , Kaiyi Ji , Yingbin Liang

Decentralized optimization, particularly the class of decentralized composite convex optimization (DCCO) problems, has found many applications. Due to ubiquitous communication congestion and random dropouts in practice, it is highly…

Optimization and Control · Mathematics 2022-10-12 Changxin Liu , Zirui Zhou , Jian Pei , Yong Zhang , Yang Shi

In recent years, decentralized bilevel optimization problems have received increasing attention in the networking and machine learning communities thanks to their versatility in modeling decentralized learning problems over peer-to-peer…

Machine Learning · Computer Science 2022-10-07 Zhuqing Liu , Xin Zhang , Prashant Khanduri , Songtao Lu , Jia Liu

Decentralized bilevel optimization has received increasing attention recently due to its foundational role in many emerging multi-agent learning paradigms (e.g., multi-agent meta-learning and multi-agent reinforcement learning) over…

Machine Learning · Computer Science 2023-01-23 Peiwen Qiu , Yining Li , Zhuqing Liu , Prashant Khanduri , Jia Liu , Ness B. Shroff , Elizabeth Serena Bentley , Kurt Turck

In modern decentralized applications, ensuring communication efficiency and privacy for the users are the key challenges. In order to train machine-learning models, the algorithm has to communicate to the data center and sample data for its…

Optimization and Control · Mathematics 2024-04-04 Hoang Huy Nguyen , Yan Li , Tuo Zhao

Contextual Stochastic Bilevel Optimization (CSBO) extends standard stochastic bilevel optimization (SBO) by incorporating context-dependent lower-level problems. CSBO problems are generally intractable since existing methods require solving…

Optimization and Control · Mathematics 2025-10-07 Maxime Bouscary , Jiawei Zhang , Saurabh Amin

A novel multiscale consensus-based optimization (CBO) algorithm for solving bi- and tri-level optimization problems is introduced. Existing CBO techniques are generalized by the proposed method through the employment of multiple interacting…

Optimization and Control · Mathematics 2025-06-23 Michael Herty , Yuyang Huang , Dante Kalise , Hicham Kouhkouh

We tackle the general differentiable meta learning problem that is ubiquitous in modern deep learning, including hyperparameter optimization, loss function learning, few-shot learning, invariance learning and more. These problems are often…

Machine Learning · Computer Science 2024-10-15 Minyoung Kim , Timothy M. Hospedales

Existing decentralized stochastic optimization methods assume the lower-level loss function is strongly convex and the stochastic gradient noise has finite variance. These strong assumptions typically are not satisfied in real-world machine…

Machine Learning · Computer Science 2026-05-26 Xinwen Zhang , Yihan Zhang , Heng Liang , Hongchang Gao

We present a new class of decentralized first-order methods for nonsmooth and stochastic optimization problems defined over multiagent networks. Considering that communication is a major bottleneck in decentralized optimization, our main…

Optimization and Control · Mathematics 2017-02-07 Guanghui Lan , Soomin Lee , Yi Zhou

In this paper, we consider non-convex multi-block bilevel optimization (MBBO) problems, which involve $m\gg 1$ lower level problems and have important applications in machine learning. Designing a stochastic gradient and controlling its…

Optimization and Control · Mathematics 2023-06-05 Quanqi Hu , Zi-Hao Qiu , Zhishuai Guo , Lijun Zhang , Tianbao Yang