English
Related papers

Related papers: Neural Network Dynamics for Model-Based Deep Reinf…

200 papers

Although deep reinforcement learning (RL) has been successfully applied to a variety of robotic control tasks, it's still challenging to apply it to real-world tasks, due to the poor sample efficiency. Attempting to overcome this…

Robotics · Computer Science 2021-03-09 Junfan Lin , Zhongzhan Huang , Keze Wang , Xiaodan Liang , Weiwei Chen , Liang Lin

We consider reinforcement learning in input-driven environments, where an exogenous, stochastic input process affects the dynamics of the system. Input processes arise in many applications, including queuing systems, robotics control with…

Machine Learning · Computer Science 2019-02-28 Hongzi Mao , Shaileshh Bojja Venkatakrishnan , Malte Schwarzkopf , Mohammad Alizadeh

Effective traffic control methods have great potential in alleviating network congestion. Existing literature generally focuses on a single control approach, while few studies have explored the effectiveness of integrated and coordinated…

Machine Learning · Computer Science 2023-03-08 Zijian Hu , Wei Ma

Modern deep learning usually treats models as separate artifacts: trained independently, specialized for particular purposes, and replaced when improved versions appear. This thesis studies model merging as an alternative paradigm:…

Machine Learning · Computer Science 2026-05-05 Donato Crisostomi

The objective of this paper is to design novel multi-layer neural network architectures for multiscale simulations of flows taking into account the observed data and physical modeling concepts. Our approaches use deep learning concepts…

Numerical Analysis · Mathematics 2018-06-14 Yating Wang , Siu Wun Cheung , Eric T. Chung , Yalchin Efendiev , Min Wang

This paper addresses the challenge of terrain-adaptive dynamic locomotion in humanoid robots, a problem traditionally tackled by optimization-based methods or reinforcement learning (RL). Optimization-based methods, such as model-predictive…

Robotics · Computer Science 2024-07-30 Shangqun Yu , Nisal Perera , Daniel Marew , Donghyun Kim

Natural intelligence processes experience as a continuous stream, sensing, acting, and learning moment-by-moment in real time. Streaming learning, the modus operandi of classic reinforcement learning (RL) algorithms like Q-learning and TD,…

Machine Learning · Computer Science 2024-12-09 Mohamed Elsayed , Gautham Vasan , A. Rupam Mahmood

While larger neural models are pushing the boundaries of what deep learning can do, often more weights are needed to train models rather than to run inference for tasks. This paper seeks to understand this behavior using search spaces --…

Machine Learning · Computer Science 2021-05-28 Darko Stosic , Dusan Stosic

Traditional RL-based locomotion controllers often suffer from low data efficiency, requiring extensive interaction to achieve robust performance. We present a model-based reinforcement learning (MBRL) framework that improves sample…

Machine Learning models should ideally be compact and robust. Compactness provides efficiency and comprehensibility whereas robustness provides resilience. Both topics have been studied in recent years but in isolation. Here we present a…

Machine Learning · Computer Science 2021-03-16 Omri Armstrong , Ran Gilad-Bachrach

Although reinforcement learning methods can achieve impressive results in simulation, the real world presents two major challenges: generating samples is exceedingly expensive, and unexpected perturbations or unseen situations cause…

Machine Learning · Computer Science 2019-03-01 Anusha Nagabandi , Ignasi Clavera , Simin Liu , Ronald S. Fearing , Pieter Abbeel , Sergey Levine , Chelsea Finn

Model-based methods are the dominant paradigm for controlling robotic systems, though their efficacy depends heavily on the accuracy of the model used. Deep neural networks have been used to learn models of robot dynamics from data, but…

Robotics · Computer Science 2020-04-23 Jayesh K. Gupta , Kunal Menda , Zachary Manchester , Mykel J. Kochenderfer

While reinforcement learning has achieved considerable successes in recent years, state-of-the-art models are often still limited by the size of state and action spaces. Model-free reinforcement learning approaches use some form of state…

Machine Learning · Computer Science 2021-08-23 Paul J. Pritz , Liang Ma , Kin K. Leung

Model-based reinforcement learning (RL) is a sample-efficient way of learning complex behaviors by leveraging a learned single-step dynamics model to plan actions in imagination. However, planning every action for long-horizon tasks is not…

Machine Learning · Computer Science 2022-12-13 Lucy Xiaoyang Shi , Joseph J. Lim , Youngwoon Lee

For over a decade, model-based reinforcement learning has been seen as a way to leverage control-based domain knowledge to improve the sample-efficiency of reinforcement learning agents. While model-based agents are conceptually appealing,…

Machine Learning · Computer Science 2021-05-28 Brandon Amos , Samuel Stanton , Denis Yarats , Andrew Gordon Wilson

Model-based reinforcement learning could enable sample-efficient learning by quickly acquiring rich knowledge about the world and using it to improve behaviour without additional data. Learned dynamics models can be directly used for…

Machine Learning · Computer Science 2019-10-15 Rinu Boney , Juho Kannala , Alexander Ilin

The appearance of transformer-based models in Reinforcement Learning (RL) has expanded the horizons of possibilities in robotics tasks, but it has simultaneously brought a wide range of challenges during its implementation, especially in…

Machine Learning · Computer Science 2025-10-01 Daniil Zelezetsky , Alexey K. Kovalev , Aleksandr I. Panov

The control and modeling of robot dynamics have increasingly adopted model-free control strategies using machine learning. Given the non-linear elastic nature of bionic robotic systems, learning-based methods provide reliable alternatives…

Robotics · Computer Science 2024-10-08 Po-Yu Hsieh , June-Hao Hou

Deep reinforcement learning (deep RL) holds the promise of automating the acquisition of complex controllers that can map sensory inputs directly to low-level actions. In the domain of robotic locomotion, deep RL could enable learning…

Machine Learning · Computer Science 2019-06-20 Tuomas Haarnoja , Sehoon Ha , Aurick Zhou , Jie Tan , George Tucker , Sergey Levine

Meta-learning algorithms can accelerate the model-based reinforcement learning (MBRL) algorithms by finding an initial set of parameters for the dynamical model such that the model can be trained to match the actual dynamics of the system…

Robotics · Computer Science 2021-01-08 Rituraj Kaushik , Timothée Anne , Jean-Baptiste Mouret