中文
相关论文

相关论文: Data-efficient Model Learning and Prediction for C…

200 篇论文

Conventionally, model-based reinforcement learning (MBRL) aims to learn a global model for the dynamics of the environment. A good model can potentially enable planning algorithms to generate a large variety of behaviors and solve diverse…

机器学习 · 计算机科学 2020-02-18 Archit Sharma , Shixiang Gu , Sergey Levine , Vikash Kumar , Karol Hausman

Poor sample efficiency continues to be the primary challenge for deployment of deep Reinforcement Learning (RL) algorithms for real-world applications, and in particular for visuo-motor control. Model-based RL has the potential to be highly…

机器学习 · 计算机科学 2022-12-13 Nicklas Hansen , Yixin Lin , Hao Su , Xiaolong Wang , Vikash Kumar , Aravind Rajeswaran

This paper comprehensively surveys research trends in imitation learning for contact-rich robotic tasks. Contact-rich tasks, which require complex physical interactions with the environment, represent a central challenge in robotics due to…

机器人学 · 计算机科学 2025-06-17 Toshiaki Tsuji , Yasuhiro Kato , Gokhan Solak , Heng Zhang , Tadej Petrič , Francesco Nori , Arash Ajoudani

Reinforcement Learning is divided in two main paradigms: model-free and model-based. Each of these two paradigms has strengths and limitations, and has been successfully applied to real world domains that are appropriate to its…

机器学习 · 计算机科学 2017-10-19 Somil Bansal , Roberto Calandra , Kurtland Chua , Sergey Levine , Claire Tomlin

In recent years, industrial robots have been installed in various industries to handle advanced manufacturing and high precision tasks. However, further integration of industrial robots is hampered by their limited flexibility, adaptability…

机器人学 · 计算机科学 2020-10-27 Oren Spector , Miriam Zacksenhouse

Model-based reinforcement learning (MBRL) is a promising route to sample-efficient policy optimization. However, a known vulnerability of reconstruction-based MBRL consists of scenarios in which detailed aspects of the world are highly…

机器学习 · 计算机科学 2024-12-10 Miles Hutson , Isaac Kauvar , Nick Haber

Model-free reinforcement learning (RL) is a powerful, general tool for learning complex behaviors. However, its sample efficiency is often impractically large for solving challenging real-world problems, even with off-policy algorithms such…

机器学习 · 计算机科学 2020-02-25 Vitchyr Pong , Shixiang Gu , Murtaza Dalal , Sergey Levine

Contact-rich manipulation involves kinematic constraints on the task motion, typically with discrete transitions between these constraints during the task. Allowing the robot to detect and reason about these contact constraints can support…

机器人学 · 计算机科学 2023-04-05 Christian Hegeler , Filippo Rozzi , Loris Roveda , Kevin Haninger

Model-based reinforcement learning attempts to use an available or learned model to improve the data efficiency of reinforcement learning. This work proposes a one-step lookback approach that jointly learns the deep incremental model and…

机器人学 · 计算机科学 2025-02-28 Cong Li

The empirical success of Reinforcement Learning (RL) in the setting of contact-rich manipulation leaves much to be understood from a model-based perspective, where the key difficulties are often attributed to (i) the explosion of contact…

机器人学 · 计算机科学 2023-03-01 Tao Pang , H. J. Terry Suh , Lujie Yang , Russ Tedrake

Learning for model based control can be sample-efficient and generalize well, however successfully learning models and controllers that represent the problem at hand can be challenging for complex tasks. Using inaccurate models for learning…

机器人学 · 计算机科学 2020-11-10 Sarah Bechtle , Bilal Hammoud , Akshara Rai , Franziska Meier , Ludovic Righetti

Model-based reinforcement learning (RL) enjoys several benefits, such as data-efficiency and planning, by learning a model of the environment's dynamics. However, learning a global model that can generalize across different dynamics is a…

机器学习 · 计算机科学 2020-06-30 Kimin Lee , Younggyo Seo , Seunghyun Lee , Honglak Lee , Jinwoo Shin

Differentiable environments have heralded new possibilities for learning control policies by offering rich differentiable information that facilitates gradient-based methods. In comparison to prevailing model-free reinforcement learning…

机器学习 · 计算机科学 2025-03-04 Xiaoyuan Zhang , Xinyan Cai , Bo Liu , Weidong Huang , Song-Chun Zhu , Siyuan Qi , Yaodong Yang

Applying reinforcement learning (RL) to real-world applications requires addressing a trade-off between asymptotic performance, sample efficiency, and inference time. In this work, we demonstrate how to address this triple challenge by…

机器学习 · 计算机科学 2024-07-03 Zakariae El Asri , Olivier Sigaud , Nicolas Thome

Model-based next state prediction and state value prediction are slow to converge. To address these challenges, we do the following: i) Instead of a neural network, we do model-based planning using a parallel memory retrieval system (which…

人工智能 · 计算机科学 2023-02-02 John Chong Min Tan , Mehul Motani

The intrinsic high dimension of fluid dynamics is an inherent challenge to control of aerodynamic flows, and this is further complicated by a flow's nonlinear response to strong disturbances. Deep reinforcement learning, which takes…

流体动力学 · 物理学 2025-07-28 Zhecheng Liu , Diederik Beckers , Jeff D. Eldredge

In-Hand Manipulation, as many other dexterous tasks, remains a difficult challenge in robotics by combining complex dynamic systems with the capability to control and manoeuvre various objects using its actuators. This work presents the…

机器人学 · 计算机科学 2025-12-15 Alexandre Lopes , Catarina Barata , Plinio Moreno

When environmental interaction is expensive, model-based reinforcement learning offers a solution by planning ahead and avoiding costly mistakes. Model-based agents typically learn a single-step transition model. In this paper, we propose a…

机器学习 · 计算机科学 2018-11-02 Kavosh Asadi , Evan Cater , Dipendra Misra , Michael L. Littman

Reinforcement learning (RL) solves sequential decision-making problems via a trial-and-error process interacting with the environment. While RL achieves outstanding success in playing complex video games that allow huge trial-and-error,…

机器学习 · 计算机科学 2022-06-22 Fan-Ming Luo , Tian Xu , Hang Lai , Xiong-Hui Chen , Weinan Zhang , Yang Yu

Traditionally, model-based reinforcement learning (MBRL) methods exploit neural networks as flexible function approximators to represent $\textit{a priori}$ unknown environment dynamics. However, training data are typically scarce in…

机器人学 · 计算机科学 2024-10-29 Jacob Levy , Tyler Westenbroek , David Fridovich-Keil