English
Related papers

Related papers: Online Nonconvex Bilevel Optimization with Bregman…

200 papers

In this paper, online convex optimization is applied to the problem of controlling linear dynamical systems. An algorithm similar to online gradient descent, which can handle time-varying and unknown cost functions, is proposed. Then,…

Optimization and Control · Mathematics 2021-11-03 Marko Nonhoff , Matthias A. Müller

Spurred by the enthusiasm surrounding the "Big Data" paradigm, the mathematical and algorithmic tools of online optimization have found widespread use in problems where the trade-off between data exploration and exploitation plays a…

Machine Learning · Computer Science 2018-04-18 E. Veronica Belmega , Panayotis Mertikopoulos , Romain Negrel , Luca Sanguinetti

We consider a generic min-max multi-objective bilevel optimization problem with applications in robust machine learning such as representation learning and hyperparameter optimization. We design MORBiT, a novel single-loop gradient…

Machine Learning · Computer Science 2023-03-08 Alex Gu , Songtao Lu , Parikshit Ram , Lily Weng

Bilevel Optimization has witnessed notable progress recently with new emerging efficient algorithms and has been applied to many machine learning tasks such as data cleaning, few-shot learning, and neural architecture search. However,…

Machine Learning · Computer Science 2022-05-04 Junyi Li , Feihu Huang , Heng Huang

We consider an online two-stage stochastic optimization with long-term constraints over a finite horizon of $T$ periods. At each period, we take the first-stage action, observe a model parameter realization and then take the second-stage…

Machine Learning · Computer Science 2024-01-03 Piao Hu , Jiashuo Jiang , Guodong Lyu , Hao Su

We study the convergence rate of Bregman gradient methods for convex optimization in the space of measures on a $d$-dimensional manifold. Under basic regularity assumptions, we show that the suboptimality gap at iteration $k$ is in…

Optimization and Control · Mathematics 2023-03-15 Lénaïc Chizat

Bilevel optimization, addressing challenges in hierarchical learning tasks, has gained significant interest in machine learning. The practical implementation of the gradient descent method to bilevel optimization encounters computational…

Machine Learning · Computer Science 2025-02-04 Sheng Fang , Yong-Jin Liu , Wei Yao , Chengming Yu , Jin Zhang

Stochastic bilevel optimization (SBO) is becoming increasingly essential in machine learning due to its versatility in handling nested structures. To address large-scale SBO, decentralized approaches have emerged as effective paradigms in…

Optimization and Control · Mathematics 2025-11-27 Boao Kong , Shuchen Zhu , Songtao Lu , Xinmeng Huang , Kun Yuan

Integrated learning and optimization (ILO) is a framework in contextual optimization which aims to train a predictive model for the probability distribution of the underlying problem data uncertainty, with the goal of enhancing the quality…

Optimization and Control · Mathematics 2026-01-26 Yuan Tao , Huifu Xu

In recent years, bilevel optimization (BLO) has attracted significant attention for its broad applications in machine learning. However, most existing works on BLO remain confined to the single-task setting and rely on the lower-level…

Machine Learning · Computer Science 2026-05-15 Zhiyao Zhang , Myeung Suk Oh , Zhen Qin , Jiaxiang Li , Xin Zhang , Jia Liu

We study Constrained Online Convex Optimization with Memory (COCO-M), where both the loss and the constraints depend on a finite window of past decisions made by the learner. This setting extends the previously studied unconstrained online…

Machine Learning · Computer Science 2026-03-24 Mohammed Abdullah , George Iosifidis , Salah Eddine Elayoubi , Tijani Chahed

This paper studies the problem of stochastic bilevel optimization where the upper-level function is nonconvex with potentially unbounded smoothness and the lower-level function is strongly convex. This problem is motivated by meta-learning…

Machine Learning · Computer Science 2024-12-31 Xiaochuan Gong , Jie Hao , Mingrui Liu

A novel multiscale consensus-based optimization (CBO) algorithm for solving bi- and tri-level optimization problems is introduced. Existing CBO techniques are generalized by the proposed method through the employment of multiple interacting…

Optimization and Control · Mathematics 2025-06-23 Michael Herty , Yuyang Huang , Dante Kalise , Hicham Kouhkouh

We introduce an online mathematical framework for survival analysis, allowing real time adaptation to dynamic environments and censored data. This framework enables the estimation of event time distributions through an optimal second order…

Machine Learning · Computer Science 2024-02-09 Camila Fernandez , Pierre Gaillard , Joseph de Vilmarest , Olivier Wintenberger

Many techniques for online optimization problems involve making decisions based solely on presently available information: fewer works take advantage of potential predictions. In this paper, we discuss the problem of online convex…

Optimization and Control · Mathematics 2019-02-04 Robert Ravier , Vahid Tarokh

Bilevel optimization is widely applied in many machine learning tasks such as hyper-parameter learning, meta learning and reinforcement learning. Although many algorithms recently have been developed to solve the bilevel optimization…

Optimization and Control · Mathematics 2024-07-26 Feihu Huang

A well-studied generalization of the standard online convex optimization (OCO) framework is constrained online convex optimization (COCO). In COCO, on every round, a convex cost function and a convex constraint function are revealed to the…

Machine Learning · Computer Science 2024-10-29 Abhishek Sinha , Rahul Vaze

Bilevel optimization has been widely applied in many important machine learning applications such as hyperparameter optimization and meta-learning. Recently, several momentum-based algorithms have been proposed to solve bilevel optimization…

Machine Learning · Computer Science 2021-12-17 Junjie Yang , Kaiyi Ji , Yingbin Liang

Bilevel optimization has witnessed a resurgence of interest, driven by its critical role in trustworthy and efficient AI applications. While many recent works have established convergence to stationary points or local minima, obtaining the…

Optimization and Control · Mathematics 2024-12-25 Quan Xiao , Tianyi Chen

Single-objective bilevel optimization is a specialized form of constraint optimization problems where one of the constraints is an optimization problem itself. These problems are typically non-convex and strongly NP-Hard. Recently, there…

Neural and Evolutionary Computing · Computer Science 2024-02-13 Anuraganand Sharma