English
Related papers

Related papers: Markov Chain-based Policies for Multi-stage Stocha…

200 papers

Second order conic programming (SOCP) has been used to model various applications in power systems, such as operation and expansion planning. In this paper, we present a two-stage stochastic mixed integer SOCP (MISOCP) model for the…

Optimization and Control · Mathematics 2017-04-04 Hossein Haghighat , Bo Zeng

Optimal queueing control of multi-hop networks remains a challenging problem even in the simplest scenarios. In this paper, we consider a two-hop half-duplex relaying system with random channel connectivity. The relay is equipped with a…

Information Theory · Computer Science 2015-10-28 Bo Zhou , Ying Cui , Meixia Tao

This paper presents a scalable and fault-tolerant framework for unmanned aerial vehicle (UAV) mission management in complex and uncertain environments. The proposed approach addresses the computational bottleneck inherent in solving…

Robotics · Computer Science 2025-12-02 Md Muzakkir Quamar , Ali Nasir , Sami ELFerik

Efficient planning of activities is essential for modern industrial assembly lines to uphold manufacturing standards, prevent project constraint violations, and achieve cost-effective operations. While exact solutions to such challenges can…

Artificial Intelligence · Computer Science 2025-07-23 Ali Mohamed Ali , Luca Tirel , Hashim A. Hashim

Service Function Chaining (SFC) establishes efficient communication paths by ensuring that traffic traverses a predefined sequence of network functions in a specified order to meet particular service requirements. Inspired by this concept,…

Networking and Internet Architecture · Computer Science 2026-04-29 Takanori Hara , Masahiro Sasabe

Recently-proposed particle MCMC methods provide a flexible way of performing Bayesian inference for parameters governing stochastic kinetic models defined as Markov (jump) processes (MJPs). Each iteration of the scheme requires an estimate…

Computation · Statistics 2014-05-19 Andrew Golightly , Daniel A. Henderson , Chris Sherlock

A two-stage stochastic optimization model for the design of the closed-loop cable layout of an Offshore Wind Farm (OWF) is presented. The model consists on a Mixed Integer Linear Program (MILP) with scenario numeration incorporation to…

Systems and Control · Electrical Eng. & Systems 2020-12-30 Juan-Andrés Pérez-Rúa , Sara Lumbreras , Andrés Ramos , Nicolaos A. Cutululis

In this paper, we propose a novel reinforcement- learning algorithm consisting in a stochastic variance-reduced version of policy gradient for solving Markov Decision Processes (MDPs). Stochastic variance-reduced gradient (SVRG) methods…

Machine Learning · Computer Science 2018-06-15 Matteo Papini , Damiano Binaghi , Giuseppe Canonaco , Matteo Pirotta , Marcello Restelli

In this paper, we describe a comprehensive algorithmic framework for solving mixed integer bilevel linear optimization problems (MIBLPs) using a generalized branch-and-cut approach. The framework presented merges features from existing…

Optimization and Control · Mathematics 2021-04-20 Sahar Tahernejad , Ted K. Ralphs , Scott T. DeNegre

In this work, we develop an adaptive, multivariate partitioning algorithm for solving mixed-integer nonlinear programs (MINLP) with multi-linear terms to global optimality. This iterative algorithm primarily exploits the advantages of…

Optimization and Control · Mathematics 2019-02-05 Harsha Nagarajan , Mowen Lu , Site Wang , Russell Bent , Kaarthik Sundar

Markov decision process models and algorithms can be used to identify optimal policies for dispatching ambulances to spatially distributed customers, where the optimal policies indicate the ambulance to dispatch to each customer type in…

Optimization and Control · Mathematics 2023-03-03 Laura A. Albert

Markov Decision Processes (MDPs) are mathematical models of sequential decision-making under uncertainty that have found applications in healthcare, manufacturing, logistics, and others. In these models, a decision-maker observes the state…

Optimization and Control · Mathematics 2024-05-22 Madeleine Pollack , Lauren N. Steimle

This paper introduces a new hierarchical facility location model with three levels: first-level facilities which manufacture different products, second-level facilities which act as warehouses and a third-level consisting of the clients who…

Optimization and Control · Mathematics 2024-03-29 Marta Baldomero-Naranjo , Luisa I. Martínez-Merino , Antonio M. Rodríguez-Chía

We consider the linear programming approach for constrained and unconstrained Markov decision processes (MDPs) under the long-run average cost criterion, where the class of MDPs in our study have Borel state spaces and discrete countable…

Optimization and Control · Mathematics 2021-04-20 Huizhen Yu

This work presents an efficient approach for accelerating multilevel Markov Chain Monte Carlo (MCMC) sampling for large-scale problems using low-fidelity machine learning models. While conventional techniques for large-scale Bayesian…

Machine Learning · Statistics 2024-05-21 Sohail Reddy , Hillary Fairbanks

In this paper, we develop approximate dynamic programming methods for stochastic systems modeled as Markov Decision Processes, given both soft performance criteria and hard constraints in a class of probabilistic temporal logic called…

Optimization and Control · Mathematics 2018-10-08 Lening Li , Jie Fu

This study introduces a mixed-integer linear programming (MILP) model, effectively co-optimizing patrolling, damage assessment, fault isolation, repair, and load re-energization processes. The model is designed to solve a vital operational…

Systems and Control · Electrical Eng. & Systems 2024-01-12 Ali Jalilian , Babak Taheri , Daniel K. Molzahn

Mixed-integer linear programming (MILP) has been a fundamental problem in combinatorial optimization. Conventional MILP solving mainly relies on carefully designed heuristics embedded in the branch-and-bound framework. Driven by the strong…

Artificial Intelligence · Computer Science 2026-01-13 Siyuan Li , Yifan Yu , Zhihao Zhang , Mengjing Chen , Fangzhou Zhu , Tao Zhong , Peng Liu , Jianye Hao

Mixed Integer Linear Programming (MILP) is a fundamental tool for modeling combinatorial optimization problems. Recently, a growing body of research has used machine learning to accelerate MILP solving. Despite the increasing popularity of…

Machine Learning · Computer Science 2024-10-29 Weimin Huang , Taoan Huang , Aaron M Ferber , Bistra Dilkina

Modern large-scale computing deployments consist of complex applications running over machine clusters. An important issue in these is the offering of elasticity, i.e., the dynamic allocation of resources to applications to meet fluctuating…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-13 Konstantinos Lolos , Ioannis Konstantinou , Verena Kantere , Nectarios Koziris