English
Related papers

Related papers: Active Inference with Reusable State-Dependent Val…

200 papers

Neural models are usually adapted through changes in parameters shared among model components via fine-tuning, alignment-based training, and reinforcement learning. These changes have been found effective in short-term optimization.…

Machine Learning · Computer Science 2026-03-04 Pardhu Sri Rushi Varma Konduru

Adaptive Computing is an application-agnostic outer loop framework to strategically deploy simulations and experiments to guide decision making for scale-up analysis. Resources are allocated over successive batches, which makes the…

We introduce Recurrent Predictive State Policy (RPSP) networks, a recurrent architecture that brings insights from predictive state representations to reinforcement learning in partially observable environments. Predictive state policy…

Machine Learning · Statistics 2018-03-06 Ahmed Hefny , Zita Marinho , Wen Sun , Siddhartha Srinivasa , Geoffrey Gordon

Contact-rich manipulation plays an important role in daily human activities. However, uncertain physical parameters often pose significant challenges for both planning and control. A promising strategy is to develop policies that are robust…

Robotics · Computer Science 2025-05-29 Teng Xue , Amirreza Razmjoo , Suhan Shetty , Sylvain Calinon

We study data-driven learning of robust stochastic control for infinite-horizon systems with potentially continuous state and action spaces. In many managerial settings--supply chains, finance, manufacturing, services, and dynamic…

Machine Learning · Statistics 2025-11-18 Shengbo Wang , Jason Meng , Nian Si , Jose Blanchet , Zhengyuan Zhou

Model-based reinforcement learning has the potential to be more sample efficient than model-free approaches. However, existing model-based methods are vulnerable to model bias, which leads to poor generalization and asymptotic performance…

Machine Learning · Computer Science 2019-06-27 Tung-Long Vuong , Kenneth Tran

Interpretable policy learning seeks to estimate intelligible decision policies from observed actions; however, existing models force a tradeoff between accuracy and interpretability, limiting data-driven interpretations of human…

Machine Learning · Computer Science 2024-05-09 Jannik Deuschel , Caleb N. Ellington , Yingtao Luo , Benjamin J. Lengerich , Pascal Friederich , Eric P. Xing

Model-Free Reinforcement Learning has achieved meaningful results in stable environments but, to this day, it remains problematic in regime changing environments like financial markets. In contrast, model-based RL is able to capture some…

Machine Learning · Computer Science 2021-04-23 Eric Benhamou , David Saltiel , Serge Tabachnik , Sui Kai Wong , François Chareyron

Dynamic treatment regimes or policies are a sequence of decision functions over multiple stages that are tailored to individual features. One important class of treatment policies in practice, namely multi-stage stationary treatment…

Machine Learning · Statistics 2025-01-09 Daiqi Gao , Yufeng Liu , Donglin Zeng

This manuscript presents an advanced framework for Bayesian learning by incorporating action and state-dependent signal variances into decision-making models. This framework is pivotal in understanding complex data-feedback loops and…

Methodology · Statistics 2023-11-29 Kaiwen Hou

Adapting an interface requires taking into account both the positive and negative effects that changes may have on the user. A carelessly picked adaptation may impose high costs to the user -- for example, due to surprise or relearning…

Human-Computer Interaction · Computer Science 2021-03-12 Kashyap Todi , Gilles Bailly , Luis A. Leiva , Antti Oulasvirta

In this paper we propose a data-driven distributionally robust Model Predictive Control framework for constrained stochastic systems with unbounded additive disturbances. Recursive feasibility is ensured by optimizing over an linearly…

Optimization and Control · Mathematics 2023-03-07 Christoph Mark , Steven Liu

The beneficial effects of treatments vary across individuals in most studies. Treatment heterogeneity motivates practitioners to search for the optimal policy based on personal characteristics. A long-standing common practice in policy…

Statistics Theory · Mathematics 2025-01-06 Xuqiao Li , Ying Yan

Individuals use models to guide decisions, but many models are wrong. This paper studies which misspecified models are likely to persist when individuals also entertain alternative models. Consider an agent who uses her model to learn the…

Theoretical Economics · Economics 2023-08-22 Cuimin Ba

This paper deals with the problem of formulating an adaptive Model Predictive Control strategy for constrained uncertain systems. We consider a linear system, in presence of bounded time varying additive uncertainty. The uncertainty is…

Systems and Control · Electrical Eng. & Systems 2021-04-13 Monimoy Bujarbaruah , Xiaojing Zhang , Marko Tanaskovic , Francesco Borrelli

In this work, we have developed a framework for synthesizing data driven controllers for a class of uncertain switched systems arising in an application to physical activity interventions. In particular, we present an application of…

Systems and Control · Electrical Eng. & Systems 2021-08-27 Ibrahim E. Bardakci , Sahar Hojjatinia , Sarah Hojjatinia , Constantino M. Lagoa , David E. Conroy

Active Inference is a theory of action arising from neuroscience which casts action and planning as a bayesian inference problem to be solved by minimizing a single quantity - the variational free energy. Active Inference promises a…

Machine Learning · Computer Science 2019-07-10 Beren Millidge

Ensuring safety is a crucial challenge when deploying reinforcement learning (RL) to real-world systems. We develop confidence-based safety filters, a control-theoretic approach for certifying state safety constraints for nominal policies…

Machine Learning · Computer Science 2022-07-05 Sebastian Curi , Armin Lederer , Sandra Hirche , Andreas Krause

Inferring control parameters in non-linear dynamical systems is an important task in analysing general dynamical behaviours, particularly in the presence of inherently deterministic chaos. Traditional approaches often rely on…

Chaotic Dynamics · Physics 2025-06-19 L. Lober , M. S. Palmero , F. A. Rodrigues

A new interpretable experiential learning model based on state history and global feedback is presented. It is capable of learning a behavioral model represented by a transition graph between sets of states, with transitions attributed with…

Machine Learning · Computer Science 2026-05-05 Anton Kolonin