English
Related papers

Related papers: Cost-sensitive retraining via posterior learning d…

200 papers

We study predictive control in a setting where the dynamics are time-varying and linear, and the costs are time-varying and well-conditioned. At each time step, the controller receives the exact predictions of costs, dynamics, and…

Optimization and Control · Mathematics 2021-06-22 Yiheng Lin , Yang Hu , Haoyuan Sun , Guanya Shi , Guannan Qu , Adam Wierman

In this work, we study the learning theory of reward modeling with pairwise comparison data using deep neural networks. We establish a novel non-asymptotic regret bound for deep reward estimators in a non-parametric setting, which depends…

Machine Learning · Statistics 2025-05-13 Yuanhang Luo , Yeheng Ge , Ruijian Han , Guohao Shen

We derive instance-dependent tail bounds for the regret of optimism-based reinforcement learning in finite-horizon tabular Markov decision processes with unknown transition dynamics. We first study a UCBVI-type (model-based) algorithm and…

Machine Learning · Computer Science 2026-03-18 Sajad Khodadadian , Mehrdad Moharrami

TWe establish regret lower bounds for adaptively controlling an unknown linear Gaussian system with quadratic costs. We combine ideas from experiment design, estimation theory and a perturbation bound of certain information matrices to…

Machine Learning · Computer Science 2024-06-13 Ingvar Ziemann , Henrik Sandberg

Sequential design of experiments for optimizing a reward function in causal systems can be effectively modeled by the sequential design of interventions in causal bandits (CBs). In the existing literature on CBs, a critical assumption is…

Machine Learning · Statistics 2024-03-06 Zirui Yan , Arpan Mukherjee , Burak Varıcı , Ali Tajer

Policy design in non-stationary Markov Decision Processes (MDPs) is inherently challenging due to the complexities introduced by time-varying system transition and reward, which make it difficult for learners to determine the optimal…

Machine Learning · Computer Science 2025-11-17 Ziyi Zhang , Yorie Nakahira , Guannan Qu

The theory of reinforcement learning has focused on two fundamental problems: achieving low regret, and identifying $\epsilon$-optimal policies. While a simple reduction allows one to apply a low-regret algorithm to obtain an…

Machine Learning · Computer Science 2022-06-23 Andrew Wagenmaker , Max Simchowitz , Kevin Jamieson

Modular Bayesian methods perform inference in models that are specified through a collection of coupled sub-models, known as modules. These modules often arise from modelling different data sources or from combining domain knowledge from…

Methodology · Statistics 2024-11-26 David T. Frazier , David J. Nott

We consider model selection for sequential decision making in stochastic environments with bandit feedback, where a meta-learner has at its disposal a pool of base learners, and decides on the fly which action to take based on the policies…

Machine Learning · Computer Science 2024-01-24 Aldo Pacchiano , Christoph Dann , Claudio Gentile

Tight performance specifications in combination with operational constraints make model predictive control (MPC) the method of choice in various industries. As the performance of an MPC controller depends on a sufficiently accurate…

Systems and Control · Electrical Eng. & Systems 2020-06-09 Kim P. Wabersich , Melanie N. Zeilinger

Many real-world combinatorial problems involve uncertain parameters, which can be predicted given contextual features and historical data. These `predict-then-optimize' or `contextual optimization' problems have gained significant…

Machine Learning · Computer Science 2026-05-19 Noah Schutte , Senne Berden , Tias Guns , Krzysztof Postek , Neil Yorke-Smith

This paper studies the safe reinforcement learning problem formulated as an episodic finite-horizon tabular constrained Markov decision process with an unknown transition kernel and stochastic reward and cost functions. We propose a…

Machine Learning · Computer Science 2024-10-15 Kihyun Yu , Duksang Lee , William Overman , Dabeen Lee

In predictive maintenance, model performance is usually assessed by means of precision, recall, and F1-score. However, employing the model with best performance, e.g. highest F1-score, does not necessarily result in minimum maintenance…

Machine Learning · Computer Science 2018-10-01 Stephan Spiegel , Fabian Mueller , Dorothea Weismann , John Bird

Policy learning algorithms are widely used in areas such as personalized medicine and advertising to develop individualized treatment regimes. However, most methods force a decision even when predictions are uncertain, which is risky in…

Machine Learning · Computer Science 2026-01-30 Ayush Sawarni , Jikai Jin , Justin Whitehouse , Vasilis Syrgkanis

Learning with rejection is an important framework that can refrain from making predictions to avoid critical mispredictions by balancing between prediction and rejection. Previous studies on cost-based rejection only focused on the…

Machine Learning · Computer Science 2023-11-09 Xin Cheng , Yuzhou Cao , Haobo Wang , Hongxin Wei , Bo An , Lei Feng

Learning robot controllers by minimizing a black-box objective cost using Bayesian optimization (BO) can be time-consuming and challenging. It is very often the case that some roll-outs result in failure behaviors, causing premature…

Machine Learning · Computer Science 2020-11-11 Alonso Marco , Dominik Baumann , Philipp Hennig , Sebastian Trimpe

Bayesian doubly robust (DR) causal inference faces a fundamental dilemma: joint modeling of outcome and propensity score suffers from the feedback problem where outcome information contaminates propensity score estimation, while two-step…

Methodology · Statistics 2026-01-05 Shunichiro Orihara , Tomotaka Momozaki , Shonosuke Sugasawa

An efficient algorithm is proposed for Bayesian model calibration, which is commonly used to estimate the model parameters of non-linear, computationally expensive models using measurement data. The approach is based on Bayesian statistics:…

Numerical Analysis · Mathematics 2019-11-06 L. M. M. van den Bos , B. Sanderse , W. A. A. M. Bierbooms , G. J. W. van Bussel

This work advances randomized exploration in reinforcement learning (RL) with function approximation modeled by linear mixture MDPs. We establish the first prior-dependent Bayesian regret bound for RL with function approximation; and refine…

Machine Learning · Statistics 2024-03-19 Yingru Li , Zhi-Quan Luo

Linear dynamical systems that obey stochastic differential equations are canonical models. While optimal control of known systems has a rich literature, the problem is technically hard under model uncertainty and there are hardly any…

Systems and Control · Electrical Eng. & Systems 2023-06-09 Mohamad Kazem Shirani Faradonbeh , Mohamad Sadegh Shirani Faradonbeh