English
Related papers

Related papers: A Bilevel Optimization Method for Inverse Mean-Fie…

200 papers

In this paper, we focus on the nonconvex-strongly-convex bilevel optimization problem (BLO). In this BLO, the objective function of the upper-level problem is nonconvex and possibly nonsmooth, and the lower-level problem is smooth and…

Optimization and Control · Mathematics 2022-12-26 Xiaoyin Hu , Nachuan Xiao , Xin Liu , Kim-Chuan Toh

In this paper, we study a class of bilevel optimization problems where the lower-level problem is a convex composite optimization model, which arises in various applications, including bilevel hyperparameter selection for regularized…

Optimization and Control · Mathematics 2026-05-13 Xiaoning Bai , Shangzhi Zeng , Jin Zhang , Lezhi Zhang

Bilevel optimization, a well-established field for modeling hierarchical decision-making problems, has recently intersected with sustainability studies and practices, resulting in a series of works focusing on bilevel optimization problems…

Optimization and Control · Mathematics 2026-04-07 Giulia Caselli , Manuel Iori , Ivana Ljubić

This paper studies a class of simple bilevel optimization problems where we minimize a composite convex function at the upper-level subject to a composite convex lower-level problem. Existing methods either provide asymptotic guarantees for…

Optimization and Control · Mathematics 2024-03-06 Jiulin Wang , Xu Shi , Rujun Jiang

Bilevel optimization has arisen as a powerful tool for many machine learning problems such as meta-learning, hyperparameter optimization, and reinforcement learning. In this paper, we investigate the nonconvex-strongly-convex bilevel…

Machine Learning · Computer Science 2021-08-30 Kaiyi Ji , Junjie Yang , Yingbin Liang

In recent years, mean field games (MFGs) have garnered considerable attention and emerged as a dynamic and actively researched field across various domains, including economics, social sciences, finance, and transportation. The inverse…

Analysis of PDEs · Mathematics 2024-10-02 Hongyu Liu , Catharine W. K. Lo , Shen Zhang

In this paper, we study multi-block min-max bilevel optimization problems, where the upper level is non-convex strongly-concave minimax objective and the lower level is a strongly convex objective, and there are multiple blocks of dual…

Optimization and Control · Mathematics 2022-11-22 Quanqi Hu , Yongjian Zhong , Tianbao Yang

This paper studies convergence properties of inexact iterative solution schemes for bilevel optimization problems. Bilevel optimization problems emerge in control-aware design optimization, where the system design parameters are optimized…

Optimization and Control · Mathematics 2024-03-26 Torbjørn Cunis Ilya Kolmanovsky

Bilevel optimization is one of the fundamental problems in machine learning and optimization. Recent theoretical developments in bilevel optimization focus on finding the first-order stationary points for nonconvex-strongly-convex cases. In…

Machine Learning · Computer Science 2023-05-11 Minhui Huang , Xuxing Chen , Kaiyi Ji , Shiqian Ma , Lifeng Lai

The policy iteration method is a classical algorithm for solving optimal control problems. In this paper, we introduce a policy iteration method for Mean Field Games systems, and we study the convergence of this procedure to a solution of…

Analysis of PDEs · Mathematics 2021-07-12 Simone Cacace , Fabio Camilli , Alessandro Goffi

Optimization plays an important role in solving many inverse problems. Indeed, the task of inversion often either involves or is fully cast as a solution of an optimization problem. In this light, the mere non-linear, non-convex, and…

Optimization and Control · Mathematics 2017-12-04 Nan Ye , Farbod Roosta-Khorasani , Tiangang Cui

Fitting an unknown number of hyperplanes to data is a fundamental yet challenging problem in machine learning, characterized by its non-convexity, non-differentiability, and unknown model order. Existing approaches often struggle with local…

Machine Learning · Computer Science 2026-05-28 Zhiqin Cheng , Yu Zhan , Mingjin Zhang , Lingbo Liu , Liang Lin

In this paper we study a class of matrix-valued linear-quadratic mean-field-type games for both the risk-neutral, risk-sensitive and robust cases. Non-cooperation, full cooperation and adversarial between teams are treated. We provide a…

Optimization and Control · Mathematics 2019-06-06 Julian Barreiro-Gomez , Tyrone E. Duncan , Hamidou Tembine

In this paper, we study the problem of solving a simple bilevel optimization problem, where the upper-level objective is minimized over the solution set of the lower-level problem. We focus on the general setting in which both the upper-…

Optimization and Control · Mathematics 2025-08-01 Jincheng Cao , Ruichen Jiang , Erfan Yazdandoost Hamedani , Aryan Mokhtari

This paper studies the connections between mean-field games and the social welfare optimization problems. We consider a mean field game in functional spaces with a large population of agents, each of which seeks to minimize an individual…

Optimization and Control · Mathematics 2016-09-27 Sen Li , Wei Zhang , Lin Zhao

In this paper, we studied the federated bilevel optimization problem, which has widespread applications in machine learning. In particular, we developed two momentum-based algorithms for optimizing this kind of problem and established the…

Machine Learning · Computer Science 2022-12-22 Hongchang Gao

The focus of this paper is a Bayesian framework for solving a class of problems termed multi-agent inverse reinforcement learning (MIRL). Compared to the well-known inverse reinforcement learning (IRL) problem, MIRL is formalized in the…

Computer Science and Game Theory · Computer Science 2019-07-31 Xiaomin Lin , Peter A. Beling , Randy Cogill

This paper investigates a class of stochastic bilevel optimization problems where the upper-level function is nonconvex with potentially unbounded smoothness and the lower-level problem is strongly convex. These problems have significant…

Machine Learning · Computer Science 2025-01-16 Xiaochuan Gong , Jie Hao , Mingrui Liu

Bilevel optimization aims to optimize an outer objective function that depends on the solution to an inner optimization problem. It is routinely used in Machine Learning, notably for hyperparameter tuning. The conventional method to compute…

Machine Learning · Computer Science 2024-02-27 Zhenzhang Ye , Gabriel Peyré , Daniel Cremers , Pierre Ablin

Handling uncertainty is critical for ensuring reliable decision-making in intelligent systems. Modern neural networks are known to be poorly calibrated, resulting in predicted confidence scores that are difficult to use. This article…

Machine Learning · Computer Science 2026-05-18 Gabriele Sanguin , Arjun Pakrashi , Marco Viola , Francesco Rinaldi