English
Related papers

Related papers: When to stop value iteration: stability and near-o…

200 papers

The Value Iteration (VI) algorithm is an iterative procedure to compute the value function of a Markov decision process, and is the basis of many reinforcement learning (RL) algorithms as well. As the error convergence rate of VI as a…

Machine Learning · Computer Science 2025-06-12 Jongmin Lee , Amin Rakhsha , Ernest K. Ryu , Amir-massoud Farahmand

Algorithms that solve zero-sum games, multi-objective agent objectives, or, more generally, variational inequality (VI) problems are notoriously unstable on general problems. Owing to the increasing need for solving such problems in machine…

Machine Learning · Statistics 2022-07-15 Tatjana Chavdarova , Ya-Ping Hsieh , Michael I. Jordan

Value Iteration (VI) is foundational to the theory and practice of modern reinforcement learning, and it is known to converge at a $\mathcal{O}(\gamma^k)$-rate, where $\gamma$ is the discount factor. Surprisingly, however, the optimal rate…

Machine Learning · Computer Science 2023-10-31 Jongmin Lee , Ernest K. Ryu

Classical value iteration approaches are not applicable to environments with continuous states and actions. For such environments, the states and actions are usually discretized, which leads to an exponential increase in computational…

Machine Learning · Computer Science 2021-05-12 Michael Lutter , Shie Mannor , Jan Peters , Dieter Fox , Animesh Garg

When transferring a control policy from simulation to a physical system, the policy needs to be robust to variations in the dynamics to perform well. Commonly, the optimal policy overfits to the approximate model and the corresponding…

Machine Learning · Computer Science 2021-05-27 Michael Lutter , Shie Mannor , Jan Peters , Dieter Fox , Animesh Garg

Bayesian optimization (BO) is a widely popular approach for the hyperparameter optimization (HPO) in machine learning. At its core, BO iteratively evaluates promising configurations until a user-defined budget, such as wall-clock time or…

Value iteration is a fixed point iteration technique utilized to obtain the optimal value function and policy in a discounted reward Markov Decision Process (MDP). Here, a contraction operator is constructed and applied repeatedly to arrive…

Machine Learning · Computer Science 2021-09-21 Chandramouli Kamanchi , Raghuram Bharadwaj Diddigi , Shalabh Bhatnagar

Active learning is a framework for supervised learning to improve the predictive performance by adaptively annotating a small number of samples. To realize efficient active learning, both an acquisition function that determines the next…

Machine Learning · Statistics 2021-04-12 Hideaki Ishibashi , Hideitsu Hino

Value Iteration is a widely used algorithm for solving Markov Decision Processes (MDPs). While previous studies have extensively analyzed its convergence properties, they primarily focus on convergence with respect to the infinity norm. In…

Machine Learning · Computer Science 2025-02-06 Arsenii Mustafin , Sebastien Colla , Alex Olshevsky , Ioannis Ch. Paschalidis

Computing reachability probabilities is at the heart of probabilistic model checking. All model checkers compute these probabilities in an iterative fashion using value iteration. This technique approximates a fixed point from below by…

Logic in Computer Science · Computer Science 2018-04-16 Tim Quatmann , Joost-Pieter Katoen

Markov decision processes are widely used for planning and verification in settings that combine controllable or adversarial choices with probabilistic behaviour. The standard analysis algorithm, value iteration, only provides a lower bound…

Logic in Computer Science · Computer Science 2019-10-21 Arnd Hartmanns , Benjamin Lucien Kaminski

Sequential Bayesian experimental design typically assumes that the number of experiments is fixed before data collection begins. In practical campaigns, however, experimentation may need to terminate early because additional measurements…

Methodology · Statistics 2026-05-29 Chen Cheng , Xun Huan

Stability under model predictive control (MPC) schemes is frequently ensured by terminal ingredients. Employing a (control) Lyapunov function as the terminal cost constitutes a common choice. Learning-based methods may be used to construct…

Systems and Control · Electrical Eng. & Systems 2022-12-02 Francisco Moreno-Mora , Lukas Beckenbach , Stefan Streif

Absolute value linear programming problems is quite a new area of optimization problems, involving linear functions and absolute values in the description of the model. In this paper, we consider interval uncertainty of the input…

Optimization and Control · Mathematics 2025-10-07 Milan Hladík

In reinforcement learning, a decision needs to be made at some point as to whether it is worthwhile to carry on with the learning process or to terminate it. In many such situations, stochastic elements are often present which govern the…

Machine Learning · Computer Science 2019-02-13 Nikki Lijing Kuang , Clement H. C. Leung

This note provides a simple example demonstrating that, if exact computations are allowed, the number of iterations required for the value iteration algorithm to find an optimal policy for discounted dynamic programming problems may grow…

Artificial Intelligence · Computer Science 2013-12-25 Eugene A. Feinberg , Jefferson Huang

Markov decision processes (MDPs) are used to model stochastic systems in many applications. Several efficient algorithms to compute optimal policies have been studied in the literature, including value iteration (VI) and policy iteration.…

Optimization and Control · Mathematics 2021-08-30 Vineet Goyal , Julien Grand-Clement

The general approach taken when training deep learning classifiers is to save the parameters after every few iterations, train until either a human observer or a simple metric-based heuristic decides the network isn't learning anymore, and…

Machine Learning · Computer Science 2021-11-17 J. K. Terry , Mario Jayakumar , Kusal De Alwis

The core principle of Variational Inference (VI) is to convert the statistical inference problem of computing complex posterior probability densities into a tractable optimization problem. This property enables VI to be faster than several…

Machine Learning · Computer Science 2023-10-25 Ankush Ganguly , Sanjana Jain , Ukrit Watchareeruetai

A key part of any evolutionary algorithm is fitness evaluation. When fitness evaluations are corrupted by noise, as happens in many real-world problems as a consequence of various types of uncertainty, a strategy is needed in order to cope…

Neural and Evolutionary Computing · Computer Science 2017-07-13 Simon M. Lucas , Jialin Liu , Diego Pérez-Liébana