English
Related papers

Related papers: The Complexity of the Simplex Method

200 papers

Motivated by the analysis of the performance of the simplex method we study the behavior of families of pivot rules of linear programs. We introduce normalized-weight pivot rules which are fundamental for the following reasons: First, they…

Combinatorics · Mathematics 2022-01-14 Alexander E. Black , Jesús A. De Loera , Niklas Lütjeharms , Raman Sanyal

This paper develops a general framework for solving a variety of convex cone problems that frequently arise in signal processing, machine learning, statistics, and other fields. The approach works as follows: first, determine a conic…

Optimization and Control · Mathematics 2011-12-20 Stephen R. Becker , Emmanuel J. Candès , Michael Grant

The smoothed analysis of algorithms is concerned with the expected running time of an algorithm under slight random perturbations of arbitrary inputs. Spielman and Teng proved that the shadow-vertex simplex method has polynomial smoothed…

Data Structures and Algorithms · Computer Science 2016-12-23 Roman Vershynin

We study robust Markov decision processes (RMDPs) with general policy parameterization under s-rectangular and non-rectangular uncertainty sets. Prior work is largely limited to tabular policies, and hence either lacks sample complexity…

Machine Learning · Computer Science 2026-02-13 Anirudh Satheesh , Ziyi Chen , Furong Huang , Heng Huang

Markov decision processes (MDPs) describe sequential decision-making processes; MDP policies return for every state in that process an advised action. Classical algorithms can efficiently compute policies that are optimal with respect to,…

Logic in Computer Science · Computer Science 2025-05-23 Roman Andriushchenko , Milan Češka , Sebastian Junges , Filip Macák

Although simplices are trivial from a linear optimization standpoint, the simplex algorithm can exhibit quite complex behavior. In this paper we study the behavior of max-slope pivot rules on (products of) simplices and describe the…

Combinatorics · Mathematics 2024-05-15 Alexander E. Black , Niklas Lütjeharms , Raman Sanyal

Markov decision processes (MDP) are finite-state systems with both strategic and probabilistic choices. After fixing a strategy, an MDP produces a sequence of probability distributions over states. The sequence is eventually synchronizing…

Computer Science and Game Theory · Computer Science 2013-11-01 Laurent Doyen , Thierry Massart , Mahsa Shirmohammadi

Multi-objective optimization problems require simultaneously optimizing two or more objective functions. Many studies have reported that the solution set of an M-objective optimization problem often forms an (M-1)-dimensional topological…

Optimization and Control · Mathematics 2018-12-14 Ken Kobayashi , Naoki Hamada , Akiyoshi Sannai , Akinori Tanaka , Kenichi Bannai , Masashi Sugiyama

In this paper, we introduce a powerful technique based on Leave-one-out analysis to the study of low-rank matrix completion problems. Using this technique, we develop a general approach for obtaining fine-grained, entrywise bounds for…

Machine Learning · Statistics 2020-06-18 Lijun Ding , Yudong Chen

This paper considers parametric Markov decision processes (pMDPs) whose transitions are equipped with affine functions over a finite set of parameters. The synthesis problem is to find a parameter valuation such that the instantiated pMDP…

Artificial Intelligence · Computer Science 2018-08-01 Murat Cubuktepe , Nils Jansen , Sebastian Junges , Joost-Pieter Katoen , Ufuk Topcu

Given a Markov Decision Process (MDP) with $n$ states and a totalnumber $m$ of actions, we study the number of iterations needed byPolicy Iteration (PI) algorithms to converge to the optimal$\gamma$-discounted policy. We consider two…

Optimization and Control · Mathematics 2016-02-11 Bruno Scherrer

We consider the problem of learning the optimal policy for infinite-horizon Markov decision processes (MDPs). For this purpose, some variant of Stochastic Mirror Descent is proposed for convex programming problems with Lipschitz-continuous…

Optimization and Control · Mathematics 2022-03-01 Daniil Tiapkin , Alexander Gasnikov

In this paper, we consider the finite-state approximation of a discrete-time constrained Markov decision process (MDP) under the discounted and average cost criteria. Using the linear programming formulation of the constrained discounted…

Optimization and Control · Mathematics 2018-07-10 Naci Saldi

Dantzig-Wolfe (DW) decomposition is a well-known technique in mixed-integer programming (MIP) for decomposing and convexifying constraints to obtain potentially strong dual bounds. We investigate cutting planes that can be derived using the…

Optimization and Control · Mathematics 2023-10-09 Rui Chen , Oktay Gunluk , Andrea Lodi

We consider the stochastic shortest path (SSP) problem for succinct Markov decision processes (MDPs), where the MDP consists of a set of variables, and a set of nondeterministic rules that update the variables. First, we show that several…

Programming Languages · Computer Science 2018-07-18 Krishnendu Chatterjee , Hongfei Fu , Amir Kafshdar Goharshady , Nastaran Okati

Iterative algorithms are ubiquitous in the field of data mining. Widely known examples of such algorithms are the least mean square algorithm, backpropagation algorithm of neural networks. Our contribution in this paper is an improvement…

Machine Learning · Computer Science 2013-10-09 Rangeet Mitra , Amit Kumar Mishra

We propose a new algorithm for solving multistage stochastic mixed integer linear programming (MILP) problems with complete continuous recourse. In a similar way to cutting plane methods, we construct nonlinear Lipschitz cuts to build lower…

Optimization and Control · Mathematics 2019-05-24 Shabbir Ahmed , Filipe Goulart Cabral , Bernardo Freitas Paulo da Costa

The Random-Facet algorithm of Kalai and of Matousek, Sharir and Welzl is an elegant randomized algorithm for solving linear programs and more general LP-type problems. Its expected subexponential time of $2^{\tilde{O}(\sqrt{m})}$, where $m$…

Data Structures and Algorithms · Computer Science 2014-10-29 Oliver Friedmann , Thomas Dueholm Hansen , Uri Zwick

Low rank matrix recovery problems appear widely in statistics, combinatorics, and imaging. One celebrated method for solving these problems is to formulate and solve a semidefinite program (SDP). It is often known that the exact solution to…

Optimization and Control · Mathematics 2021-07-26 Lijun Ding , Madeleine Udell

It is well known that selecting a good Mixed Integer Programming (MIP) formulation is crucial for an effective solution with state-of-the art solvers. While best practices and guidelines for constructing good formulations abound, there is…

Optimization and Control · Mathematics 2017-05-23 Juan Pablo Vielma