English
Related papers

Related papers: Decentralized Stochastic Bilevel Optimization with…

200 papers

Bilevel optimization has recently attracted considerable attention due to its abundant applications in machine learning problems. However, existing methods rely on prior knowledge of problem parameters to determine stepsizes, resulting in…

Machine Learning · Computer Science 2024-10-10 Yifan Yang , Hao Ban , Minhui Huang , Shiqian Ma , Kaiyi Ji

We study finite-time performance of a recently proposed distributed dual subgradient (DDSG) method for convex constrained multi-agent optimization problems. The algorithm enjoys performance guarantees on the last primal iterate, as opposed…

Optimization and Control · Mathematics 2023-07-28 Subhonmesh Bose , Hoa Dinh Nguyen , Haitian Liu , Ye Guo , Thinh T. Doan , Carolyn L. Beck

This paper studies the effect of data homogeneity on multi-agent stochastic optimization. We consider the decentralized stochastic gradient (DSGD) algorithm and perform a refined convergence analysis. Our analysis is explicit on the…

Optimization and Control · Mathematics 2024-09-09 Qiang Li , Hoi-To Wai

In this thesis, we propose new theoretical frameworks for the analysis of stochastic and distributed methods with error compensation and local updates. Using these frameworks, we develop more than 20 new optimization methods, including the…

Optimization and Control · Mathematics 2021-12-21 Eduard Gorbunov

This paper analyzes a two-timescale stochastic algorithm framework for bilevel optimization. Bilevel optimization is a class of problems which exhibit a two-level structure, and its goal is to minimize an outer objective function with…

Optimization and Control · Mathematics 2022-06-09 Mingyi Hong , Hoi-To Wai , Zhaoran Wang , Zhuoran Yang

In recent years, a variety of gradient-based first-order methods have been developed to solve bi-level optimization problems for learning applications. However, theoretical guarantees of these existing approaches heavily rely on the…

Machine Learning · Computer Science 2020-07-03 Risheng Liu , Pan Mu , Xiaoming Yuan , Shangzhi Zeng , Jin Zhang

We consider distributed optimization problems where forming the Hessian is computationally challenging and communication is a significant bottleneck. We develop unbiased parameter averaging methods for randomized second order optimization…

Machine Learning · Statistics 2020-02-18 Burak Bartan , Mert Pilanci

Distributed stochastic non-convex optimization problems have recently received attention due to the growing interest of signal processing, computer vision, and natural language processing communities in applications deployed over…

Systems and Control · Electrical Eng. & Systems 2024-10-14 Yiyue Chen , Abolfazl Hashemi , Haris Vikalo

We develop a distributed stochastic gradient descent algorithm for solving non-convex optimization problems under the assumption that the local objective functions are twice continuously differentiable with Lipschitz continuous gradients…

Optimization and Control · Mathematics 2019-08-20 Jemin George , Tao Yang , He Bai , Prudhvi Gurram

We consider the challenge of black-box optimization within hybrid discrete-continuous and variable-length spaces, a problem that arises in various applications, such as decision tree learning and symbolic regression. We propose DisCo-DSO…

Machine Learning · Computer Science 2024-12-17 Jacob F. Pettit , Chak Shing Lee , Jiachen Yang , Alex Ho , Daniel Faissol , Brenden Petersen , Mikel Landajuela

Hyperparameter optimization in machine learning is often achieved using naive techniques that only lead to an approximate set of hyperparameters. Although techniques such as Bayesian optimization perform an intelligent search on a given…

Machine Learning · Computer Science 2023-06-21 Ankur Sinha , Satender Gunwal , Shivam Kumar

This work provides the first finite-time convergence guarantees for linearly constrained stochastic bilevel optimization using only first-order methods, requiring solely gradient information without any Hessian computations or second-order…

Optimization and Control · Mathematics 2025-11-18 Cac Phan , Kai Wang

Bilevel optimization (BO) is widely applicable to many machine learning problems. Scaling BO, however, requires repeatedly computing hypergradients, which involves solving inverse Hessian-vector products (IHVPs). In practice, these…

Machine Learning · Computer Science 2026-04-01 Disen Liao , Felix Dangel , Yaoliang Yu

Recently, there has been a growing interest in distributionally robust optimization (DRO) as a principled approach to data-driven decision making. In this paper, we consider a distributionally robust two-stage stochastic optimization…

Optimization and Control · Mathematics 2020-12-07 Zhe Zhang , Shabbir Ahmed , Guanghui Lan

Consider a network of $N$ decentralized computing agents collaboratively solving a nonconvex stochastic composite problem. In this work, we propose a single-loop algorithm, called DEEPSTORM, that achieves optimal sample complexity for this…

Optimization and Control · Mathematics 2023-04-14 Gabriel Mancino-Ball , Shengnan Miao , Yangyang Xu , Jie Chen

In this paper we consider a distributed optimization scenario in which a set of agents has to solve a convex optimization problem with separable cost function, local constraint sets and a coupling inequality constraint. We propose a novel…

Systems and Control · Computer Science 2018-04-25 Ivano Notarnicola , Giuseppe Notarstefano

In this work, we study decentralized convex constrained optimization problems in networks. We focus on the dual averaging-based algorithmic framework that is well-documented to be superior in handling constraints and complex communication…

Optimization and Control · Mathematics 2022-08-16 Changxin Liu , Yang Shi , Huiping Li , Wenli Du

This paper presents a novel decentralized high-dimensional Bayesian optimization (DEC-HBO) algorithm that, in contrast to existing HBO algorithms, can exploit the interdependent effects of various input components on the output of the…

Machine Learning · Statistics 2018-01-25 Trong Nghia Hoang , Quang Minh Hoang , Ruofei Ouyang , Kian Hsiang Low

Training deep neural network is a high dimensional and a highly non-convex optimization problem. Stochastic gradient descent (SGD) algorithm and it's variations are the current state-of-the-art solvers for this task. However, due to…

Machine Learning · Computer Science 2017-01-17 Xi He , Dheevatsa Mudigere , Mikhail Smelyanskiy , Martin Takáč

Federated bilevel optimization (FBO) has shown great potential recently in machine learning and edge computing due to the emerging nested optimization structure in meta-learning, fine-tuning, hyperparameter tuning, etc. However, existing…

Machine Learning · Computer Science 2023-12-29 Yifan Yang , Peiyao Xiao , Kaiyi Ji