English
Related papers

Related papers: ICNN-enhanced 2SP: Leveraging input convex neural …

200 papers

Classical ReLU-based Input Convex Neural Networks (ICNNs) are equivalent to the optimal value functions of Linear Programming (LP). This intrinsic structural equivalence restricts their representational capacity to piecewise-linear…

Machine Learning · Computer Science 2026-05-06 Kang Liu , Jianchen Hu , Wei Peng

We describe algorithms for two-stage stochastic linear programming with recourse and their implementation on a grid computing platform. In particular, we examine serial and asynchronous versions of the L-shaped method and a trust-region…

Optimization and Control · Mathematics 2007-05-23 Jeff Linderoth , Stephen Wright

Embedding deep neural networks (NNs) into mixed-integer programs (MIPs) is attractive for decision making with learned constraints, yet state-of-the-art monolithic linearisations blow up in size and quickly become intractable. In this…

Optimization and Control · Mathematics 2025-11-13 Shuli Zeng , Sijia Zhang , Feng Wu , Shaojie Tang , Xiang-Yang Li

Stochastic dual dynamic programming (SDDP) is a state-of-the-art method for solving multi-stage stochastic optimization, widely used for modeling real-world process optimization tasks. Unfortunately, SDDP has a worst-case complexity that…

Machine Learning · Computer Science 2021-12-03 Hanjun Dai , Yuan Xue , Zia Syed , Dale Schuurmans , Bo Dai

Complex machine learning (ML) inference algorithms like recurrent neural networks (RNNs) use standard functions from math libraries like exponentiation, sigmoid, tanh, and reciprocal of square root. Although prior work on secure 2-party…

Cryptography and Security · Computer Science 2021-05-11 Deevashwer Rathee , Mayank Rathee , Rahul Kranti Kiran Goli , Divya Gupta , Rahul Sharma , Nishanth Chandran , Aseem Rastogi

In this paper, we have studied a decomposition method for solving a class of nonconvex two-stage stochastic programs, where both the objective and constraints of the second-stage problem are nonlinearly parameterized by the first-stage…

Optimization and Control · Mathematics 2022-11-16 Hanyang Li , Ying Cui

Mixed-integer optimization is at the core of many online decision-making systems that demand frequent updates of decisions in real time. However, due to their combinatorial nature, mixed-integer linear programs (MILPs) can be difficult to…

Optimization and Control · Mathematics 2026-04-21 Shivi Dixit , Rishabh Gupta , Qi Zhang

Evolutionary algorithms are increasingly recognised as a viable computational approach for the automated optimisation of deep neural networks (DNNs) within artificial intelligence. This method extends to the training of DNNs, an approach…

Neural and Evolutionary Computing · Computer Science 2024-03-29 Fergal Stapleton , Brendan Cody-Kenny , Edgar Galván

In this study, we introduce an innovative deep learning framework that employs a transformer model to address the challenges of mixed-integer programs, specifically focusing on the Capacitated Lot Sizing Problem (CLSP). Our approach, to our…

Artificial Intelligence · Computer Science 2024-05-27 Joshua F. Cooper , Seung Jin Choi , I. Esra Buyuktahtakin

Physics informed neural networks (PINNs) represent a very popular class of neural solvers for partial differential equations. In practice, one often employs stochastic gradient descent type algorithms to train the neural network. Therefore,…

Machine Learning · Computer Science 2025-09-01 Bangti Jin , Longjun Wu

We study a two-stage mixed-integer linear program (MILP) with more than 1 million binary variables in the second stage. We develop a two-level approach by constructing a semi-coarse model (coarsened with respect to variables) and a coarse…

Optimization and Control · Mathematics 2015-04-20 Fu Lin , Sven Leyffer , Todd Munson

This work introduces a framework to address the computational complexity inherent in Mixed-Integer Programming (MIP) models by harnessing the potential of deep learning. By employing deep learning, we construct problem-specific heuristics…

Optimization and Control · Mathematics 2024-05-13 Niki Triantafyllou , Maria M. Papathanasiou

Recent work has shown potential in using Mixed Integer Programming (MIP) solvers to optimize certain aspects of neural networks (NNs). However the intriguing approach of training NNs with MIP solvers is under-explored.…

Machine Learning · Computer Science 2023-04-03 Tómas Thorbjarnarson , Neil Yorke-Smith

Two-stage stochastic programs with binary recourse are challenging to solve and efficient solution methods for such problems have been limited. In this work, we generalize an existing binary decision diagram-based (BDD-based) approach of…

Optimization and Control · Mathematics 2023-11-16 Moira MacNeil , Merve Bodur

Recently, message-passing graph neural networks (MPNNs) have shown potential for solving combinatorial and continuous optimization problems due to their ability to capture variable-constraint interactions. While existing approaches leverage…

Artificial Intelligence · Computer Science 2025-02-05 Chendi Qian , Christopher Morris

Face parsing is an important computer vision task that requires accurate pixel segmentation of facial parts (such as eyes, nose, mouth, etc.), providing a basis for further face analysis, modification, and other applications. Interlinked…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Zi Yin , Valentin Yiu , Xiaolin Hu , Liang Tang

In this paper, we propose the neural Born iterative method (NeuralBIM) for solving 2D inverse scattering problems (ISPs) by drawing on the scheme of physics-informed supervised residual learning (PhiSRL) to emulate the computing process of…

Computational Physics · Physics 2023-11-22 Tao Shan , Zhichao Lin , Xiaoqian Song , Maokun Li , Fan Yang , Zhensheng Xu

We consider so called $2$-stage stochastic integer programs (IPs) and their generalized form of multi-stage stochastic IPs. A $2$-stage stochastic IP is an integer program of the form $\max \{ c^T x \mid Ax = b, l \leq x \leq u, x \in…

Data Structures and Algorithms · Computer Science 2019-02-22 Kim-Manuel Klein

Unstructured pruning is well suited to reduce the memory footprint of convolutional neural networks (CNNs), both at training and inference time. CNNs contain parameters arranged in $K \times K$ filters. Standard unstructured pruning (SP)…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Paul Wimmer , Jens Mehnert , Alexandru Paul Condurache

Convolutional neural networks (CNNs) are now predominant components in a variety of computer vision (CV) systems. These systems typically include an image signal processor (ISP), even though the ISP is traditionally designed to produce…

Image and Video Processing · Electrical Eng. & Systems 2021-03-18 Patrick Hansen , Alexey Vilkin , Yury Khrustalev , James Imber , David Hanwell , Matthew Mattina , Paul N. Whatmough