English
Related papers

Related papers: ICNN-enhanced 2SP: Leveraging input convex neural …

200 papers

Binary (0-1) integer programming (BIP) is pivotal in scientific domains requiring discrete decision-making. As the advance of AI computing, recent works explore neural network-based solvers for integer linear programming (ILP) problems.…

Machine Learning · Computer Science 2025-05-28 Sen Bai , Chunqi Yang , Xin Bai , Xin Zhang , Zhengang Jiang

We study a new two-time-scale stochastic gradient method for solving optimization problems, where the gradients are computed with the aid of an auxiliary variable under samples generated by time-varying MDPs controlled by the underlying…

Optimization and Control · Mathematics 2024-08-27 Sihan Zeng , Thinh T. Doan , Justin Romberg

We propose a novel Two-Stage framework for Structured Pruning (\textsc{2SSP}) for pruning Large Language Models (LLMs), which combines two different strategies of pruning, namely Width and Depth Pruning. The first stage (Width Pruning)…

Computation and Language · Computer Science 2025-08-19 Fabrizio Sandri , Elia Cunegatti , Giovanni Iacca

Learning-to-learn (L2L), defined as progressively faster learning across similar tasks, is fundamental to both neuroscience and artificial intelligence. However, its neural basis remains elusive, as most studies emphasize neural population…

Neural and Evolutionary Computing · Computer Science 2025-09-29 Yingchao Yu , Yaochu Jin , Kuangrong Hao , Yuchen Xiao , Yuping Yan , Hengjie Yu , Zeqi Zheng , Wenxuan Pan

In this work, we propose ReStoCNet, a residual stochastic multilayer convolutional Spiking Neural Network (SNN) composed of binary kernels, to reduce the synaptic memory footprint and enhance the computational efficiency of SNNs for complex…

Computer Vision and Pattern Recognition · Computer Science 2019-02-13 Gopalakrishnan Srinivasan , Kaushik Roy

Spiking Neural Networks (SNNs) are one of the most promising bio-inspired neural networks models and have drawn increasing attention in recent years. The event-driven communication mechanism of SNNs allows for sparse and theoretically…

Neural and Evolutionary Computing · Computer Science 2025-10-29 Andrea Castagnetti , Alain Pegatoquet , Benoît Miramond

Two-stage stochastic programs become computationally challenging when the number of scenarios representing parameter uncertainties grows. Motivated by this, we propose the TULIP-algorithm ("Two-step warm start method Used for solving…

Optimization and Control · Mathematics 2024-12-16 Berend Markhorst , Markus Leitner , Joost Berkhout , Alessandro Zocca , Rob van der Mei

In this paper, we propose a Bi-layer Predictionbased Reduction Branch (BP-RB) framework to speed up the process of finding a high-quality feasible solution for Mixed Integer Programming (MIP) problems. A graph convolutional network (GCN) is…

Optimization and Control · Mathematics 2022-09-28 Lingying Huang , Xiaomeng Chen , Wei Huo , Jiazheng Wang , Fan Zhang , Bo Bai , Ling Shi

Due to the non-convex nature of training Deep Neural Network (DNN) models, their effectiveness relies on the use of non-convex optimization heuristics. Traditional methods for training DNNs often require costly empirical methods to produce…

Machine Learning · Computer Science 2023-12-21 Tolga Ergen , Mert Pilanci

Data-driven inverse optimization for mixed-integer linear programs (MILPs), which seeks to learn an objective function and constraints consistent with observed decisions, is important for building accurate mathematical models in a variety…

Optimization and Control · Mathematics 2026-02-17 Akira Kitaoka

A stochastic program typically involves several parameters, including deterministic first-stage parameters and stochastic second-stage elements that serve as input data. These programs are re-solved whenever any input parameter changes.…

Optimization and Control · Mathematics 2026-03-16 Chhavi Sharma , Harsha Gangammanavar

Electroencephalogram-based motor imagery (MI) classification is an important paradigm of non-invasive brain-computer interfaces. Common spatial pattern (CSP), which exploits different energy distributions on the scalp while performing…

Signal Processing · Electrical Eng. & Systems 2024-11-20 Xue Jiang , Lubin Meng , Xinru Chen , Yifan Xu , Dongrui Wu

Mixed Integer Programming (MIP) solvers rely on an array of sophisticated heuristics developed with decades of research to solve large-scale MIP instances encountered in practice. Machine learning offers to automatically construct better…

We introduce two-stage stochastic min-max and min-min integer programs with bi-parameterized recourse (BTSPs), where the first-stage decisions affect both the objective function and the feasible region of the second-stage problem. To solve…

Optimization and Control · Mathematics 2025-10-30 Sumin Kang , Manish Bansal

In this paper, we design, analyze, and implement a variant of the two-loop L-shaped algorithms for solving two-stage stochastic programming problems that arise from important application areas including revenue management and power systems.…

Optimization and Control · Mathematics 2023-09-06 John R. Birge , Haihao Lu , Baoyu Zhou

Two-stage stochastic unit commitment (2S-SUC) problems have been widely adopted to manage the uncertainties introduced by high penetrations of intermittent renewable energy resources. While decomposition-based algorithms such as…

Systems and Control · Electrical Eng. & Systems 2026-04-16 Zhentong Shao , Jingtao Qin , Nanpeng Yu

We introduce an aggregation framework to address multi-stage stochastic programs with mixed-integer state variables and continuous local variables (MSILPs). Our aggregation framework imposes additional structure to the integer state…

Optimization and Control · Mathematics 2023-05-11 Margarita P. Castro , Merve Bodur , Yongjia Song

We propose a new algorithm for solving multistage stochastic mixed integer linear programming (MILP) problems with complete continuous recourse. In a similar way to cutting plane methods, we construct nonlinear Lipschitz cuts to build lower…

Optimization and Control · Mathematics 2019-05-24 Shabbir Ahmed , Filipe Goulart Cabral , Bernardo Freitas Paulo da Costa

Multi-block separable convex problems recently received considerable attention. This class of optimization problems minimizes a separable convex objective function with linear constraints. The algorithmic challenges come from the fact that…

Optimization and Control · Mathematics 2016-08-18 Qia Li , Yuesheng Xu , Na Zhang

Explicit machine learning-based model predictive control (explicit ML-MPC) has been developed to reduce the real-time computational demands of traditional ML-MPC. However, the evaluation of candidate control actions in explicit ML-MPC can…

Optimization and Control · Mathematics 2024-08-14 Wenlong Wang , Haohao Zhang , Yujia Wang , Yuhe Tian , Zhe Wu