English
Related papers

Related papers: Modeling Design and Control Problems Involving Neu…

200 papers

In this technical report, a new formulation for embedding a neural network into an optimization model is described. This formulation does not require binary variables to properly compute the output of the neural network for specific types…

Optimization and Control · Mathematics 2024-02-06 Héctor G. -de-Alba , Andres Tellez , Cipriano Santos , Emmanuel Gómez

Mixed-integer optimization is at the core of many online decision-making systems that demand frequent updates of decisions in real time. However, due to their combinatorial nature, mixed-integer linear programs (MILPs) can be difficult to…

Optimization and Control · Mathematics 2026-04-21 Shivi Dixit , Rishabh Gupta , Qi Zhang

The growing penetration of distributed energy resources (DERs), electric vehicles (EVs), and heat pumps (HPs) in distribution networks underscores the need for secure, computationally efficient optimal power flow (OPF) solutions.…

Systems and Control · Electrical Eng. & Systems 2026-04-15 Savvas Panagi , Chrysovalantis Spanias , Petros Aristidou

After showing the efficiency of feedforward networks to estimate control in high dimension in the global optimization of some storages problems, we develop a modification of an algorithm based on some dynamic programming principle. We show…

Optimization and Control · Mathematics 2023-05-31 Xavier Warin

Surrogate Neural Networks are nowadays routinely used in industry as substitutes for computationally demanding engineering simulations (e.g., in structural analysis). They allow to generate faster predictions and thus analyses in industrial…

ReLU neural networks have been modelled as constraints in mixed integer linear programming (MILP), enabling surrogate-based optimisation in various domains and efficient solution of machine learning certification problems. However, previous…

Optimization and Control · Mathematics 2023-12-05 Tom McDonald , Calvin Tsay , Artur M. Schweidtmann , Neil Yorke-Smith

Trained ML models are commonly embedded in optimization problems. In many cases, this leads to large-scale NLPs that are difficult to solve to global optimality. While ML models frequently lead to large problems, they also exhibit…

Optimization and Control · Mathematics 2024-01-17 Artur M. Schweidtmann , Dominik Bongartz , Alexander Mitsos

In this contribution, we develop an efficient surrogate modeling framework for simulation-based optimization of enhanced oil recovery, where we particularly focus on polymer flooding. The computational approach is based on an adaptive…

Numerical Analysis · Mathematics 2022-03-04 Tim Keil , Hendrik Kleikamp , Rolf J Lorentzen , Micheal B Oguntola , Mario Ohlberger

Robust optimization is concerned with constructing solutions that remain feasible also when a limited number of resources is removed from the solution. Most studies of robust combinatorial optimization to date made the assumption that every…

Optimization and Control · Mathematics 2015-04-21 David Adjiashvili

This paper presents a unified mixed-integer programming framework for training sparse and interpretable neural networks. We develop exact formulations for both fully connected and convolutional architectures by modeling nonlinearities such…

Artificial Intelligence · Computer Science 2025-04-22 Masoud Ataei , Edrin Hasaj , Jacob Gipp , Sepideh Forouzi

We compare full-space, reduced-space, and gray-box formulations for representing trained neural networks in nonlinear constrained optimization problems. We test these formulations on a transient stability-constrained, security-constrained…

Machine Learning · Computer Science 2024-12-17 Robert B. Parker , Oscar Dowson , Nicole LoGiudice , Manuel Garcia , Russell Bent

When optimizing a nonlinear objective, one can employ a neural network as a surrogate for the nonlinear function. However, the resulting optimization model can be time-consuming to solve globally with exact methods. As a result, local…

Optimization and Control · Mathematics 2026-03-19 Jiatai Tong , Yilin Zhu , Thiago Serra , Samuel Burer

The increasing penetration of renewables in distribution networks calls for faster and more advanced voltage regulation strategies. A promising approach is to formulate the problem as an optimization problem, where the optimal reactive…

Optimization and Control · Mathematics 2020-02-24 Yize Chen , Yuanyuan Shi , Baosen Zhang

Deploying deep learning models, comprising of non-linear combination of millions, even billions, of parameters is challenging given the memory, power and compute constraints of the real world. This situation has led to research into model…

Machine Learning · Computer Science 2020-05-29 Muhammad A. Shah , Raphael Olivier , Bhiksha Raj

Neural networks can be trained to solve regression problems by using gradient-based methods to minimize the square loss. However, practitioners often prefer to reformulate regression as a classification problem, observing that training on…

Machine Learning · Computer Science 2023-03-02 Lawrence Stewart , Francis Bach , Quentin Berthet , Jean-Philippe Vert

A challenging problem in both engineering and computer science is that of minimising a function for which we have no mathematical formulation available, that is expensive to evaluate, and that contains continuous and integer variables, for…

Machine Learning · Computer Science 2021-07-28 Laurens Bliek , Arthur Guijt , Sicco Verwer , Mathijs de Weerdt

Motivated by the residual type neural networks (ResNet), this paper studies optimal control problems constrained by a non-smooth integral equation. Such non-smooth equations, for instance, arise in the continuous representation of…

Optimization and Control · Mathematics 2023-02-13 Harbir Antil , Livia Betz , Daniel Wachsmuth

Complementarity problems, a class of mathematical optimization problems with orthogonality constraints, are widely used in many robotics tasks, such as locomotion and manipulation, due to their ability to model non-smooth phenomena (e.g.,…

Systems and Control · Electrical Eng. & Systems 2020-11-17 Alp Aydinoglu , Mahyar Fazlyab , Manfred Morari , Michael Posa

Surrogate models of numerical relativity simulations of merging black holes provide the most accurate tools for gravitational-wave data analysis. Neural network-based surrogates promise evaluation speedups, but their accuracy relies on…

General Relativity and Quantum Cosmology · Physics 2025-05-21 Lucy M. Thomas , Katerina Chatziioannou , Vijay Varma , Scott E. Field

Neural network models and deep models are one of the leading and state of the art models in machine learning. Most successful deep neural models are the ones with many layers which highly increases their number of parameters. Training such…

Machine Learning · Computer Science 2018-07-17 Soufiane Belharbi