English
Related papers

Related papers: Bilevel Learning with Inexact Stochastic Gradients

200 papers

Variational regularization is commonly used to solve linear inverse problems, and involves augmenting a data fidelity by a regularizer. The regularizer is used to promote a priori information and is weighted by a regularization parameter.…

Optimization and Control · Mathematics 2024-01-23 Matthias J. Ehrhardt , Silvia Gazzola , Sebastian J. Scott

In this paper, we show how to transform any optimization problem that arises from fitting a machine learning model into one that (1) detects and removes contaminated data from the training set while (2) simultaneously fitting the trimmed…

Machine Learning · Statistics 2017-02-07 Aleksandr Aravkin , Damek Davis

We develop and analyze stochastic approximation algorithms for solving nested compositional bi-level optimization problems. These problems involve a nested composition of $T$ potentially non-convex smooth functions in the upper-level, and a…

Optimization and Control · Mathematics 2023-07-12 Xuxing Chen , Krishnakumar Balasubramanian , Saeed Ghadimi

Stochastic bilevel optimization tackles challenges involving nested optimization structures. Its fast-growing scale nowadays necessitates efficient distributed algorithms. In conventional distributed bilevel methods, each worker must…

Optimization and Control · Mathematics 2024-05-30 Yutong He , Jie Hu , Xinmeng Huang , Songtao Lu , Bin Wang , Kun Yuan

Gradient-based optimization has been critical to the success of machine learning, updating a single set of parameters to minimize a single loss. A growing number of applications rely on a generalization of this, where we have a bilevel or…

Machine Learning · Computer Science 2024-07-02 Jonathan Lorraine

Bilevel optimization, the problem of minimizing a value function which involves the arg-minimum of another function, appears in many areas of machine learning. In a large scale empirical risk minimization setting where the number of samples…

Machine Learning · Statistics 2024-12-03 Mathieu Dagréou , Pierre Ablin , Samuel Vaiter , Thomas Moreau

Bilevel optimization formulates hierarchical decision-making processes that arise in many real-world applications such as in pricing, network design, and infrastructure defense planning. In this paper, we consider a class of bilevel…

Optimization and Control · Mathematics 2021-04-20 Geunyeong Byeon , Pascal Van Hentenryck

We study stochastic optimization of nonconvex loss functions, which are typical objectives for training neural networks. We propose stochastic approximation algorithms which optimize a series of regularized, nonlinearized losses on large…

Machine Learning · Computer Science 2019-03-12 Weiran Wang , Nathan Srebro

Gradient descent methods and especially their stochastic variants have become highly popular in the last decade due to their efficiency on big data optimization problems. In this thesis we present the development of data sampling strategies…

Optimization and Control · Mathematics 2018-04-03 Dominik Csiba

Stochastic bilevel optimization (SBO) has been integrated into many machine learning paradigms recently, including hyperparameter optimization, meta learning, and reinforcement learning. Along with the wide range of applications, there have…

Machine Learning · Computer Science 2026-04-07 Xuelin Zhang , Hong Chen , Bin Gu , Tieliang Gong , Feng Zheng

It seems that in the current age, computers, computation, and data have an increasingly important role to play in scientific research and discovery. This is reflected in part by the rise of machine learning and artificial intelligence,…

Machine Learning · Computer Science 2024-05-15 Ronan Keane

Many applications in machine learning or signal processing involve nonsmooth optimization problems. This nonsmoothness brings a low-dimensional structure to the optimal solutions. In this paper, we propose a randomized proximal gradient…

Optimization and Control · Mathematics 2020-04-29 Dmitry Grishchenko , Franck Iutzeler , Jérôme Malick

Machine learning problems with multiple objective functions appear either in learning with multiple criteria where learning has to make a trade-off between multiple performance metrics such as fairness, safety and accuracy; or, in…

Machine Learning · Computer Science 2024-03-20 Heshan Fernando , Han Shen , Miao Liu , Subhajit Chaudhury , Keerthiram Murugesan , Tianyi Chen

Adaptive moment methods have been remarkably successful in deep learning optimization, particularly in the presence of noisy and/or sparse gradients. We further the advantages of adaptive moment techniques by proposing a family of double…

Machine Learning · Statistics 2018-11-07 Kin Gutierrez , Jin Li , Cristian Challu , Artur Dubrawski

In this paper, we consider non-convex multi-block bilevel optimization (MBBO) problems, which involve $m\gg 1$ lower level problems and have important applications in machine learning. Designing a stochastic gradient and controlling its…

Optimization and Control · Mathematics 2023-06-05 Quanqi Hu , Zi-Hao Qiu , Zhishuai Guo , Lijun Zhang , Tianbao Yang

Many important machine learning applications involve regularized nonconvex bi-level optimization. However, the existing gradient-based bi-level optimization algorithms cannot handle nonconvex or nonsmooth regularizers, and they suffer from…

Machine Learning · Computer Science 2022-06-06 Ziyi Chen , Bhavya Kailkhura , Yi Zhou

We propose novel randomized optimization methods for high-dimensional convex problems based on restrictions of variables to random subspaces. We consider oblivious and data-adaptive subspaces and study their approximation properties via…

Information Theory · Computer Science 2020-12-15 Jonathan Lacotte , Mert Pilanci

Many problems in machine learning involve bilevel optimization (BLO), including hyperparameter optimization, meta-learning, and dataset distillation. Bilevel problems consist of two nested sub-problems, called the outer and inner problems,…

Machine Learning · Computer Science 2022-12-29 Paul Vicol , Jonathan Lorraine , Fabian Pedregosa , David Duvenaud , Roger Grosse

The study of optimal control problems under uncertainty plays an important role in scientific numerical simulations. This class of optimization problems is strongly utilized in engineering, biology and finance. In this paper, a stochastic…

Optimization and Control · Mathematics 2023-04-06 Caroline Geiersbach , Teresa Scarinci

This work provides the first finite-time convergence guarantees for linearly constrained stochastic bilevel optimization using only first-order methods, requiring solely gradient information without any Hessian computations or second-order…

Optimization and Control · Mathematics 2025-11-18 Cac Phan , Kai Wang