English
Related papers

Related papers: Introduction to Bilevel Optimization: A perspectiv…

200 papers

Optimization problems over dynamic networks have been extensively studied and widely used in the past decades to formulate numerous real-world problems. However, (1) traditional optimization-based approaches do not scale to large networks,…

Machine Learning · Computer Science 2023-05-17 Daniele Gammelli , James Harrison , Kaidi Yang , Marco Pavone , Filipe Rodrigues , Francisco C. Pereira

This is a lecture notes for a mini-course in Department of Mathematics, Ghent University, 14 Mar.-25 Mar. 2023.

Logic · Mathematics 2023-04-04 Toshiyasu Arai

This paper develops a risk-aware net demand forecasting product for virtual power plants, which helps reduce the risk of high operation costs. At the training phase, a bilevel program for parameter estimation is formulated, where the upper…

Systems and Control · Electrical Eng. & Systems 2024-06-18 Yufan Zhang , Jiajun Han , Yuanyuan Shi

Bilevel optimization (BLO) is a popular approach with many applications including hyperparameter optimization, neural architecture search, adversarial robustness and model-agnostic meta-learning. However, the approach suffers from time and…

Machine Learning · Computer Science 2021-06-08 Valerii Likhosherstov , Xingyou Song , Krzysztof Choromanski , Jared Davis , Adrian Weller

Multilevel Splitting is a Sequential Monte Carlo method to simulate realisations of a rare event as well as to estimate its probability. This article is concerned with the convergence and the fluctuation analysis of Adaptive Multilevel…

Statistics Theory · Mathematics 2015-09-21 Frederic Cerou , Arnaud Guyader

We propose an analysis in fair learning that preserves the utility of the data while reducing prediction disparities under the criteria of group sufficiency. We focus on the scenario where the data contains multiple or even many subgroups,…

Machine Learning · Statistics 2022-11-30 Changjian Shui , Gezheng Xu , Qi Chen , Jiaqi Li , Charles Ling , Tal Arbel , Boyu Wang , Christian Gagné

This work proposes an uncertainty-informed bid adjustment framework for integrating variable renewable energy sources (VRES) into electricity markets. This framework adopts a bilevel model to compute the optimal VRES day-ahead bids. It aims…

Systems and Control · Electrical Eng. & Systems 2023-12-08 Dongwei Zhao , Vladimir Dvorkin , Stefanos Delikaraoglou , Alberto J. Lamadrid L. , Audun Botterud

We present an efficient optimization framework that solves trajectory optimization problems by decoupling state variables from timing variables, thereby decomposing a challenging nonlinear programming (NLP) problem into two easier…

Robotics · Computer Science 2021-04-28 Weidong Sun , Gao Tang , Kris Hauser

These lecture notes are derived from a graduate-level course in dynamic optimization, offering an introduction to techniques and models extensively used in management science, economics, operations research, engineering, and computer…

Optimization and Control · Mathematics 2024-10-11 Bar Light

There is a growing cross-disciplinary effort in the broad domain of optimization and learning with streams of data, applied to settings where traditional batch optimization techniques cannot produce solutions at time scales that match the…

Optimization and Control · Mathematics 2021-11-29 Emiliano Dall'Anese , Andrea Simonetto , Stephen Becker , Liam Madden

Reinforcement learning techniques achieved human-level performance in several tasks in the last decade. However, in recent years, the need for interpretability emerged: we want to be able to understand how a system works and the reasons…

Machine Learning · Computer Science 2023-01-13 Leonardo Lucio Custode , Giovanni Iacca

Temporal action segmentation in untrimmed procedural videos aims to densely label frames into action classes. These videos inherently exhibit long-tailed distributions, where actions vary widely in frequency and duration. In temporal action…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Zhanzhong Pang , Fadime Sener , Shrinivas Ramasubramanian , Angela Yao

Bilevel optimization has recently attracted significant attention in machine learning due to its wide range of applications and advanced hierarchical optimization capabilities. In this paper, we propose a plug-and-play framework, named…

Optimization and Control · Mathematics 2025-05-05 Tianshu Chu , Dachuan Xu , Wei Yao , Chengming Yu , Jin Zhang

We propose a model of incentives for data pricing in large mobile networks, in which an operator wishes to balance the number of connections (active users) of different classes of users in the different cells and at different time instants,…

Optimization and Control · Mathematics 2019-01-09 Marianne Akian , Mustapha Bouhtou , Jean Bernard Eytard , Stéphane Gaubert

This paper introduces and studies the convergence properties of a new class of explicit $\epsilon$-subgradient methods for the task of minimizing a convex function over the set of minimizers of another convex minimization problem. The…

Optimization and Control · Mathematics 2019-04-03 Elias Salomão Helou , Lucas Eduardo Azevedo Simões

The present notes provide an extended version of a small lecture course given at the Humboldt Universit\"at zu Berlin in the Winter Term 2022/23 (of 36 hours). The material starting in Section 5.4 was added afterwards. The aim of these…

Mathematical Physics · Physics 2023-06-09 Alexander Mielke

Topology optimization (TO) is a method of deriving an optimal design that satisfies a given load and boundary conditions within a design domain. This method enables effective design without initial design, but has been limited in use due to…

Machine Learning · Computer Science 2023-06-06 Seungyeon Shin , Dongju Shin , Namwoo Kang

This work seeks to tackle the inherent complexity of dataspaces by introducing a novel data structure that can represent datasets across multiple levels of abstraction, ranging from local to global. We propose the concept of a multilevel…

Data Structures and Algorithms · Computer Science 2025-04-01 Marco Caputo , Michele Russo , Emanuela Merelli

This article overviews how gradient flows, and discretizations thereof, are useful to design and analyze optimization and sampling algorithms. The interplay between optimization, sampling, and gradient flows is an active research area; our…

Computation · Statistics 2023-02-23 N. Garcia Trillos , B. Hosseini , D. Sanz-Alonso

Existing decentralized stochastic optimization methods assume the lower-level loss function is strongly convex and the stochastic gradient noise has finite variance. These strong assumptions typically are not satisfied in real-world machine…

Machine Learning · Computer Science 2026-05-26 Xinwen Zhang , Yihan Zhang , Heng Liang , Hongchang Gao