English
Related papers

Related papers: A relaxed technical assumption for posterior sampl…

200 papers

TWe establish regret lower bounds for adaptively controlling an unknown linear Gaussian system with quadratic costs. We combine ideas from experiment design, estimation theory and a perturbation bound of certain information matrices to…

Machine Learning · Computer Science 2024-06-13 Ingvar Ziemann , Henrik Sandberg

The Linear-Quadratic Regulation (LQR) problem with unknown system parameters has been widely studied, but it has remained unclear whether $\tilde{ \mathcal{O}}(\sqrt{T})$ regret, which is the best known dependence on time, can be achieved…

Optimization and Control · Mathematics 2025-01-28 Yiwen Lu , Yilin Mo

This paper considers the use of a simple posterior sampling algorithm to balance between exploration and exploitation when learning to optimize actions such as in multi-armed bandit problems. The algorithm, also known as Thompson Sampling,…

Machine Learning · Computer Science 2014-02-04 Daniel Russo , Benjamin Van Roy

This paper investigates the problem of regret minimization in linear time-varying (LTV) dynamical systems. Due to the simultaneous presence of uncertainty and non-stationarity, designing online control algorithms for unknown LTV systems…

Machine Learning · Computer Science 2022-06-07 Yuzhen Han , Ruben Solozabal , Jing Dong , Xingyu Zhou , Martin Takac , Bin Gu

We study finite-time horizon continuous-time linear-quadratic reinforcement learning problems in an episodic setting, where both the state and control coefficients are unknown to the controller. We first propose a least-squares algorithm…

Optimization and Control · Mathematics 2022-06-22 Matteo Basei , Xin Guo , Anran Hu , Yufei Zhang

Thompson sampling (TS) is a powerful and widely used strategy for sequential decision-making, with applications ranging from Bayesian optimization to reinforcement learning (RL). Despite its success, the theoretical foundations of TS remain…

Machine Learning · Computer Science 2025-10-24 Jasmine Bayrooti , Sattar Vakili , Amanda Prorok , Carl Henrik Ek

Learning to control an unknown dynamical system with respect to high-level temporal specifications is an important problem in control theory. We present the first regret-free online algorithm for learning a controller for linear temporal…

Artificial Intelligence · Computer Science 2025-06-09 Rupak Majumdar , Mahmoud Salamati , Sadegh Soudjani

This work theoretically studies a ubiquitous reinforcement learning policy for controlling the canonical model of continuous-time stochastic linear-quadratic systems. We show that randomized certainty equivalent policy addresses the…

Machine Learning · Computer Science 2022-08-23 Mohamad Kazem Shirani Faradonbeh

This work tackles the complexities of multi-player scenarios in \emph{unknown games}, where the primary challenge lies in navigating the uncertainty of the environment through bandit feedback alongside strategic decision-making. We…

Machine Learning · Computer Science 2024-02-27 Yingru Li , Liangqi Liu , Wenqiang Pu , Hao Liang , Zhi-Quan Luo

We design a new provably efficient algorithm for episodic reinforcement learning with generalized linear function approximation. We analyze the algorithm under a new expressivity assumption that we call "optimistic closure," which is…

Machine Learning · Statistics 2019-12-10 Yining Wang , Ruosong Wang , Simon S. Du , Akshay Krishnamurthy

We consider the problem of controlling an unknown linear time-invariant dynamical system from a single chain of black-box interactions, with no access to resets or offline simulation. Under the assumption that the system is controllable, we…

Machine Learning · Computer Science 2021-02-19 Xinyi Chen , Elad Hazan

``Sim2real gap", in which the system learned in simulations is not the exact representation of the real system, can lead to loss of stability and performance when controllers learned using data from the simulated system are used on the real…

Systems and Control · Electrical Eng. & Systems 2025-05-15 Shivam Bajaj , Prateek Jaiswal , Vijay Gupta

This paper studies the Bayesian regret of a variant of the Thompson-Sampling algorithm for bandit problems. It builds upon the information-theoretic framework of [Russo and Van Roy, 2015] and, more specifically, on the rate-distortion…

Machine Learning · Statistics 2024-03-07 Amaury Gouverneur , Borja Rodríguez-Gálvez , Tobias J. Oechtering , Mikael Skoglund

The problem of regret minimization for online adaptive control of linear-quadratic systems is studied. In this problem, the true system transition parameters (matrices $A$ and $B$) are unknown, and the objective is to design and analyze…

Optimization and Control · Mathematics 2022-10-31 Mohammad Akbari , Bahman Gharesifard , Tamas Linder

We study online control of time-varying linear systems with unknown dynamics in the nonstochastic control model. At a high level, we demonstrate that this setting is \emph{qualitatively harder} than that of either unknown time-invariant or…

Machine Learning · Computer Science 2022-02-17 Edgar Minasyan , Paula Gradu , Max Simchowitz , Elad Hazan

While Bayesian-based exploration often demonstrates superior empirical performance compared to bonus-based methods in model-based reinforcement learning (RL), its theoretical understanding remains limited for model-free settings. Existing…

Machine Learning · Computer Science 2026-02-05 He Wang , Xingyu Xu , Yuejie Chi

We present an algorithm based on posterior sampling (aka Thompson sampling) that achieves near-optimal worst-case regret bounds when the underlying Markov Decision Process (MDP) is communicating with a finite, though unknown, diameter. Our…

Machine Learning · Computer Science 2020-04-01 Shipra Agrawal , Randy Jia

We consider the problem of learning an unknown Markov Decision Process (MDP) that is weakly communicating in the infinite horizon setting. We propose a Thompson Sampling-based reinforcement learning algorithm with dynamic episodes (TSDE).…

Machine Learning · Computer Science 2017-09-15 Yi Ouyang , Mukul Gagrani , Ashutosh Nayyar , Rahul Jain

We study the problem of regret minimization in partially observable linear quadratic control systems when the model dynamics are unknown a priori. We propose ExpCommit, an explore-then-commit algorithm that learns the model Markov…

Machine Learning · Computer Science 2020-03-10 Sahin Lale , Kamyar Azizzadenesheli , Babak Hassibi , Anima Anandkumar

Understanding how to efficiently learn while adhering to safety constraints is essential for using online reinforcement learning in practical applications. However, proving rigorous regret bounds for safety-constrained reinforcement…

Machine Learning · Statistics 2025-04-29 Benjamin Schiffer , Lucas Janson