中文
相关论文

相关论文: Behaviorally Grounded Model-Based and Model Free C…

200 篇论文

This work presents a suboptimality study of a particular model predictive control with a stage cost shaping based on the ideas of reinforcement learning. The focus of the suboptimality study is to derive quantities relating the…

最优化与控制 · 数学 2020-04-28 Lukas Beckenbach , Pavel Osinenko , Stefan Streif

Model-Based Reinforcement Learning involves learning a \textit{dynamics model} from data, and then using this model to optimise behaviour, most often with an online \textit{planner}. Much of the recent research along these lines presents a…

Much of model-based reinforcement learning involves learning a model of an agent's world, and training an agent to leverage this model to perform a task more efficiently. While these models are demonstrably useful for agents, every…

神经与进化计算 · 计算机科学 2019-11-01 C. Daniel Freeman , Luke Metz , David Ha

Most existing literature on supply chain and inventory management consider stochastic demand processes with zero or constant lead times. While it is true that in certain niche scenarios, uncertainty in lead times can be ignored, most…

机器学习 · 计算机科学 2022-03-10 Hardik Meisheri , Somjit Nath , Mayank Baranwal , Harshad Khadilkar

The naive application of Reinforcement Learning algorithms to continuous control problems -- such as locomotion and manipulation -- often results in policies which rely on high-amplitude, high-frequency control signals, known colloquially…

机器人学 · 计算机科学 2019-02-14 Steven Bohez , Abbas Abdolmaleki , Michael Neunert , Jonas Buchli , Nicolas Heess , Raia Hadsell

Model bias is an inherent limitation of the current dominant approach to optimal quantum control, which relies on a system simulation for optimization of control policies. To overcome this limitation, we propose a circuit-based approach for…

量子物理 · 物理学 2022-03-31 V. V. Sivak , A. Eickbusch , H. Liu , B. Royer , I. Tsioutsios , M. H. Devoret

Model-free reinforcement learning algorithms can compute policy gradients given sampled environment transitions, but require large amounts of data. In contrast, model-based methods can use the learned model to generate new data, but model…

机器学习 · 计算机科学 2022-03-04 Lukas P. Fröhlich , Maksym Lefarov , Melanie N. Zeilinger , Felix Berkenkamp

Model-based reinforcement learning is a widely accepted solution for solving excessive sample demands. However, the predictions of the dynamics models are often not accurate enough, and the resulting bias may incur catastrophic decisions…

机器学习 · 计算机科学 2024-05-03 Wanpeng Zhang , Xi Xiao , Yao Yao , Mingzhe Chen , Dijun Luo

Model-free reinforcement learning algorithms have exhibited great potential in solving single-task sequential decision-making problems with high-dimensional observations and long horizons, but are known to be hard to generalize across…

机器学习 · 计算机科学 2023-05-30 Boyuan Chen , Chuning Zhu , Pulkit Agrawal , Kaiqing Zhang , Abhishek Gupta

Modeling and optimization of multi-echelon supply chain systems is challenging as it requires a holistic approach that exploits synergies and interactions between echelons while accurately accounting for variability observed by these…

最优化与控制 · 数学 2019-01-03 Anshul Agarwal

The application of learning-based control methods in robotics presents significant challenges. One is that model-free reinforcement learning algorithms use observation data with low sample efficiency. To address this challenge, a prevalent…

机器学习 · 计算机科学 2024-07-19 Andrey Gorodetskiy , Konstantin Mironov , Aleksandr Panov

We study reinforcement learning for the optimal control of Branching Markov Decision Processes (BMDPs), a natural extension of (multitype) Branching Markov Chains (BMCs). The state of a (discrete-time) BMCs is a collection of entities of…

机器学习 · 计算机科学 2021-06-15 Ernst Moritz Hahn , Mateo Perez , Sven Schewe , Fabio Somenzi , Ashutosh Trivedi , Dominik Wojtczak

Reinforcement learning suffers from limitations in real practices primarily due to the number of required interactions with virtual environments. It results in a challenging problem because we are implausible to obtain a local optimal…

机器学习 · 计算机科学 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen

With the increasing availability of open-source robotic data, imitation learning has become a promising approach for both manipulation and locomotion. Diffusion models are now widely used to train large, generalized policies that predict…

机器学习 · 计算机科学 2025-12-15 Shashank Hegde , Satyajeet Das , Gautam Salhotra , Gaurav S. Sukhatme

State-of-the-art reinforcement learning algorithms mostly rely on being allowed to directly interact with their environment to collect millions of observations. This makes it hard to transfer their success to industrial control problems,…

机器学习 · 计算机科学 2021-07-23 Phillip Swazinna , Steffen Udluft , Thomas Runkler

Models play an essential role in the design process of cyber-physical systems. They form the basis for simulation and analysis and help in identifying design problems as early as possible. However, the construction of models that comprise…

Model-based reinforcement learning is an appealing framework for creating agents that learn, plan, and act in sequential environments. Model-based algorithms typically involve learning a transition model that takes a state and an action and…

机器学习 · 计算机科学 2019-06-03 Kavosh Asadi , Dipendra Misra , Seungchan Kim , Michel L. Littman

We study non-stationary single-item, periodic-review inventory control problems in which the demand distribution is unknown and may change over time. We analyze how demand non-stationarity affects learning performance across inventory…

最优化与控制 · 数学 2026-02-06 Nele H. Amiri , Sean R. Sinclair , Maximiliano Udenio

Designing effective model-based reinforcement learning algorithms is difficult because the ease of data generation must be weighed against the bias of model-generated data. In this paper, we study the role of model usage in policy…

机器学习 · 计算机科学 2021-11-30 Michael Janner , Justin Fu , Marvin Zhang , Sergey Levine

Model-based reinforcement learning (MBRL) is believed to have higher sample efficiency compared with model-free reinforcement learning (MFRL). However, MBRL is plagued by dynamics bottleneck dilemma. Dynamics bottleneck dilemma is the…

机器学习 · 计算机科学 2021-06-25 Xiyao Wang , Junge Zhang , Wenzhen Huang , Qiyue Yin