English
Related papers

Related papers: Bilevel optimisation with embedded neural networks…

200 papers

Bilevel optimization has found successful applications in various machine learning problems, including hyper-parameter optimization, data cleaning, and meta-learning. However, its huge computational cost presents a significant challenge for…

Machine Learning · Computer Science 2024-11-05 Xiaoyu Wang , Rui Pan , Renjie Pi , Jipeng Zhang

We study optimization problems where the objective function is modeled through feedforward neural networks with rectified linear unit (ReLU) activation. Recent literature has explored the use of a single neural network to model either…

Machine Learning · Computer Science 2022-05-11 Keliang Wang , Leonardo Lozano , Carlos Cardonha , David Bergman

By exploiting the correlation between the structure and the solution of Mixed-Integer Linear Programming (MILP), Machine Learning (ML) has become a promising method for solving large-scale MILP problems. Existing ML-based MILP solvers…

Machine Learning · Computer Science 2025-01-03 Yixuan Li , Can Chen , Jiajun Li , Jiahui Duan , Xiongwei Han , Tao Zhong , Vincent Chau , Weiwei Wu , Wanyuan Wang

Recently, neural networks have been widely applied in the power system area. They can be used for better predicting input information and modeling system performance with increased accuracy. In some applications such as battery degradation…

Machine Learning · Computer Science 2025-05-27 Cunzhi Zhao , Fan Jiang , Xingpeng Li

The manpower scheduling problem is a kind of critical combinational optimization problem. Researching solutions to scheduling problems can improve the efficiency of companies, hospitals, and other work units. This paper proposes a new model…

Machine Learning · Computer Science 2021-05-11 Tianyu Liu , Lingyu Zhang

Real-life parallel machine scheduling problems can be characterized by: (i) limited information about the exact task duration at scheduling time, and (ii) an opportunity to reschedule the remaining tasks each time a task processing is…

Optimization and Control · Mathematics 2023-11-22 Izack Cohen , Krzysztof Postek , Shimrit Shtern

A large number of application problems involve two levels of optimization, where one optimization task is nested inside the other. These problems are known as bilevel optimization problems and have been studied by both classical…

Optimization and Control · Mathematics 2017-05-09 Ankur Sinha , Zhichao Lu , Kalyanmoy Deb , Pekka Malo

Increasingly volatile electricity prices make simultaneous scheduling optimization desirable for production processes and their energy systems. Simultaneous scheduling needs to account for both process dynamics and binary on/off-decisions…

Optimization and Control · Mathematics 2022-07-28 Florian Joseph Baader , André Bardow , Manuel Dahmen

In this paper, it is demonstrated through a case study that multilayer feedforward neural networks activated by ReLU functions can in principle be trained iteratively with Mixed Integer Linear Programs (MILPs) as follows. Weights are…

Machine Learning · Computer Science 2021-04-12 Steffen Goebbels

Finding optimal join orders is among the most crucial steps to be performed by query optimisers. Though extensively studied in data management research, the problem remains far from solved: While query optimisers rely on exhaustive search…

Databases · Computer Science 2025-10-24 Manuel Schönberger , Immanuel Trummer , Wolfgang Mauerer

Machine Reassignment is a challenging problem for constraint programming (CP) and mixed-integer linear programming (MILP) approaches, especially given the size of data centres. The multi-objective version of the Machine Reassignment Problem…

Artificial Intelligence · Computer Science 2021-03-19 Takfarinas Saber , Anthony Ventresque , Joao Marques-Silva , James Thorburn , Liam Murphy

ReLU neural networks have been modelled as constraints in mixed integer linear programming (MILP), enabling surrogate-based optimisation in various domains and efficient solution of machine learning certification problems. However, previous…

Optimization and Control · Mathematics 2023-12-05 Tom McDonald , Calvin Tsay , Artur M. Schweidtmann , Neil Yorke-Smith

Bilevel programming is one of the very active areas of research with many real-life applications in economics and engineering. Bilevel problems are hierarchical problems consisting of lower-level and upper-level problems, respectively. The…

Optimization and Control · Mathematics 2025-10-24 Kuntal Som , Thirumulanathan D , Joydeep Dutta

In this work, we explore the efficacy of rectified linear unit artificial neural networks in addressing the intricate challenges of convoluted constraints arising from feedback linearization mapping. Our approach involves a comprehensive…

Systems and Control · Electrical Eng. & Systems 2024-05-27 Huu-Thinh Do , Ionela Prodan

We propose a supervised learning framework for computing solutions of multi-parametric Mixed Integer Linear Programs (MILPs) that arise in Model Predictive Control. Our approach also quantifies sub-optimality for the computed solutions.…

Systems and Control · Electrical Eng. & Systems 2023-03-24 Luigi Russo , Siddharth H. Nair , Luigi Glielmo , Francesco Borrelli

Influence diagrams represent decision-making problems with interdependencies between random events, decisions, and consequences. Traditionally, they have been solved using algorithms that determine the expected utility-maximizing decision…

Optimization and Control · Mathematics 2026-01-14 Topias Terho , Fabricio Oliveira , Ahti Salo , Pedro Munari

We introduce a framework based on bilevel programming that unifies gradient-based hyperparameter optimization and meta-learning. We show that an approximate version of the bilevel problem can be solved by taking into explicit account the…

Machine Learning · Statistics 2018-07-04 Luca Franceschi , Paolo Frasconi , Saverio Salzo , Riccardo Grazzi , Massimilano Pontil

Scheduling on dataflow graphs (also known as computation graphs) is an NP-hard problem. The traditional exact methods are limited by runtime complexity, while reinforcement learning (RL) and heuristic-based approaches struggle with…

Machine Learning · Computer Science 2023-08-24 Jiaqi Yin , Cunxi Yu

Scientific and data science applications are becoming increasingly complex, with growing computational and memory demands. Modern high performance computing (HPC) systems provide high parallelism and heterogeneity across nodes, devices, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-29 Jonas H. Müller Korndörfer , Ali Mohammed , Ahmed Eleliemy , Quentin Guilloteau , Reto Krummenacher , Florina M. Ciorba

Bilevel optimization is a powerful tool for modeling hierarchical decision making processes. However, the resulting problems are challenging to solve - both in theory and practice. Fortunately, there have been significant algorithmic…

Optimization and Control · Mathematics 2023-01-25 Yasmine Beck , Ivana Ljubić , Martin Schmidt