English
Related papers

Related papers: Convex Approximations for a Bi-level Formulation o…

200 papers

Data-driven control that circumvents the process of system identification by providing optimal control inputs directly from system data has attracted renewed attention in recent years. In this paper, we focus on understanding the effects of…

Systems and Control · Electrical Eng. & Systems 2021-05-12 Linbin Huang , Jianzhe Zhen , John Lygeros , Florian Dörfler

Bilevel optimization is a fundamental tool in hierarchical decision-making and has been widely applied to machine learning tasks such as hyperparameter tuning, meta-learning, and continual learning. While significant progress has been made…

Optimization and Control · Mathematics 2025-04-25 Nazanin Abolfazli , Sina Sharifi , Mahyar Fazlyab , Erfan Yazdandoost Hamedani

Bilevel optimization enjoys a wide range of applications in emerging machine learning and signal processing problems such as hyper-parameter optimization, image reconstruction, meta-learning, adversarial training, and reinforcement…

Machine Learning · Computer Science 2025-01-08 Han Shen , Quan Xiao , Tianyi Chen

This paper investigates simple bilevel optimization problems where we minimize an upper-level objective over the optimal solution set of a convex lower-level objective. Existing methods for such problems either only guarantee asymptotic…

Optimization and Control · Mathematics 2024-11-05 Pengyu Chen , Xu Shi , Rujun Jiang , Jiulin Wang

We primarily consider bilevel programs where the lower level is a convex quadratic minimization problem under integer constraints. We show that it is $\Sigma_2^p$-hard to decide if the optimal objective for the leader is lesser than a given…

Optimization and Control · Mathematics 2024-12-23 Sriram Sankaranarayanan , V. Shubha Vatsalya

A Learning Model Predictive Controller (LMPC) is presented and tailored to platooning and Connected Autonomous Vehicles (CAVs) applications. The proposed controller builds on previous work on nonlinear LMPC, adapting its architecture and…

Optimization and Control · Mathematics 2019-08-09 Hassan Jafarzadeh , Cody Fleming

Decentralized non-convex optimization is important in many problems of practical relevance. Existing decentralized methods, however, typically either lack convergence guarantees for general non-convex problems, or they suffer from a high…

Optimization and Control · Mathematics 2025-10-20 Gösta Stomberg , Alexander Engelmann , Timm Faulwasser

The root-cause diagnostics of product quality defects in multistage manufacturing processes often requires a joint identification of crucial stages and process variables. To meet this requirement, this paper proposes a novel penalized…

Applications · Statistics 2020-06-11 Cheoljoon Jeong , Xiaolei Fang

In this paper, a decentralized proximal method of multipliers (DPMM) is proposed to solve constrained convex optimization problems over multi-agent networks, where the local objective of each agent is a general closed convex function, and…

Optimization and Control · Mathematics 2023-10-25 Kai Gong , Liwei Zhang

Multilevel optimization has gained renewed interest in machine learning due to its promise in applications such as hyperparameter tuning and continual learning. However, existing methods struggle with the inherent difficulty of efficiently…

Machine Learning · Computer Science 2024-10-16 Yuntian Gu , Xuzheng Chen

Analysis of over-parameterized neural networks has drawn significant attention in recentyears. It was shown that such systems behave like convex systems under various restrictedsettings, such as for two-level neural networks, and when…

Machine Learning · Computer Science 2019-11-19 Cong Fang , Yihong Gu , Weizhong Zhang , Tong Zhang

(Stochastic) bilevel optimization is a frequently encountered problem in machine learning with a wide range of applications such as meta-learning, hyper-parameter optimization, and reinforcement learning. Most of the existing studies on…

Machine Learning · Computer Science 2023-03-16 Meng Ding , Mingxi Lei , Yunwen Lei , Di Wang , Jinhui Xu

Data-driven control of discrete-time and continuous-time systems is of tremendous research interest. In this paper, we explore data-driven optimal control of continuous-time linear systems using input-output data. Based on a density result,…

Optimization and Control · Mathematics 2024-07-18 Philipp Schmitz , Timm Faulwasser , Paolo Rapisarda , Karl Worthmann

We consider the primal and dual forms of the optimality conditions for PDE-contrained optimization problems arising in Data-Driven Computational Mechanics when specialized to the reaction-diffusion context. Starting with the continuous…

Numerical Analysis · Mathematics 2025-12-24 Ramon Codina , Roberto Federico Ausas , Pedro Balbão Bazon , Cristian Guillermo Gebhardt

Bilevel optimization is an important class of optimization problems where one optimization problem is nested within another. While various methods have emerged to address unconstrained general bilevel optimization problems, there has been a…

Optimization and Control · Mathematics 2024-03-15 Nazanin Abolfazli , Ruichen Jiang , Aryan Mokhtari , Erfan Yazdandoost Hamedani

Bilevel optimization is a central tool in machine learning for high-dimensional hyperparameter tuning. Its applications are vast; for instance, in imaging it can be used for learning data-adaptive regularizers and optimizing forward…

Optimization and Control · Mathematics 2025-11-11 Mohammad Sadegh Salehi , Subhadip Mukherjee , Lindon Roberts , Matthias J. Ehrhardt

Numerically computing global policies to optimal control problems for complex dynamical systems is mostly intractable. In consequence, a number of approximation methods have been developed. However, none of the current methods can quantify…

Robotics · Computer Science 2021-03-05 Ashwin Khadke , Hartmut Geyer

A Task Decomposition method for iterative learning Model Predictive Control (TDMPC) for linear time-varying systems is presented. We consider the availability of state-input trajectories which solve an original task T1, and design a…

Systems and Control · Electrical Eng. & Systems 2020-05-05 Charlott Vallon , Francesco Borrelli

We study a class of bilevel convex optimization problems where the goal is to find the minimizer of an objective function in the upper level, among the set of all optimal solutions of an optimization problem in the lower level. A wide range…

Optimization and Control · Mathematics 2018-09-27 Mostafa Amini , Farzad Yousefian

Data-driven control approaches for the minimization of energy consumption of buildings have the potential to significantly reduce deployment costs and increase uptake of advanced control in this sector. A number of recent approaches based…

Systems and Control · Electrical Eng. & Systems 2023-03-23 Yingzhao Lian , Jicheng Shi , Manuel Koch , Colin Neil Jones