English
Related papers

Related papers: Pretrained Bayesian Non-parametric Knowledge Prior…

200 papers

Current reinforcement learning (RL) in robotics often experiences difficulty in generalizing to new downstream tasks due to the innate task-specific training paradigm. To alleviate it, unsupervised RL, a framework that pre-trains the agent…

Robotics · Computer Science 2022-10-13 Daesol Cho , Jigang Kim , H. Jin Kim

Pretraining is a common technique in deep learning for increasing performance and reducing training time, with promising experimental results in deep reinforcement learning (RL). However, pretraining requires a relevant dataset for…

Machine Learning · Computer Science 2021-10-07 Saurav Kadavath , Samuel Paradis , Brian Yao

While model-based deep reinforcement learning (RL) holds great promise for sample efficiency and generalization, learning an accurate dynamics model is often challenging and requires substantial interaction with the environment. A wide…

Machine Learning · Computer Science 2019-07-12 Yilun Du , Karthik Narasimhan

Despite the potential of reinforcement learning (RL) for building general-purpose robotic systems, training RL agents to solve robotics tasks still remains challenging due to the difficulty of exploration in purely continuous action spaces.…

Machine Learning · Computer Science 2021-10-29 Murtaza Dalal , Deepak Pathak , Ruslan Salakhutdinov

Offline meta-reinforcement learning (meta-RL) methods, which adapt to unseen target tasks with prior experience, are essential in robot control tasks. Current methods typically utilize task contexts and skills as prior experience, where…

Machine Learning · Computer Science 2023-12-12 Hongcai He , Anjie Zhu , Shuang Liang , Feiyu Chen , Jie Shao

Constructing 3D representations of object geometry is critical for many robotics tasks, particularly manipulation problems. These representations must be built from potentially noisy partial observations. In this work, we focus on the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Herbert Wright , Weiming Zhi , Martin Matak , Matthew Johnson-Roberson , Tucker Hermans

In the field of legged robot motion control, reinforcement learning (RL) holds great promise but faces two major challenges: high computational cost for training individual robots and poor generalization of trained models. To address these…

Robotics · Computer Science 2025-04-09 Haodong Huang , Shilong Sun , Zida Zhao , Hailin Huang , Changqing Shen , Wenfu Xu

Skill-based reinforcement learning (RL) has emerged as a promising strategy to leverage prior knowledge for accelerated robot learning. Skills are typically extracted from expert demonstrations and are embedded into a latent space from…

Robotics · Computer Science 2022-11-07 Krishan Rana , Ming Xu , Brendan Tidd , Michael Milford , Niko Sünderhauf

Reinforcement learning methods as a promising technique have achieved superior results in the motion planning of free-floating space robots. However, due to the increase in planning dimension and the intensification of system dynamics…

Robotics · Computer Science 2022-09-07 Yuxue Cao , Shengjie Wang , Xiang Zheng , Wenke Ma , Xinru Xie , Lei Liu

Pre-training is crucial for learning deep neural networks. Most of existing pre-training methods train simple models (e.g., restricted Boltzmann machines) and then stack them layer by layer to form the deep structure. This layer-wise…

Machine Learning · Computer Science 2015-06-09 Zhiyuan Tang , Dong Wang , Yiqiao Pan , Zhiyong Zhang

Legged robots have enormous potential in their range of capabilities, from navigating unstructured terrains to high-speed running. However, designing robust controllers for highly agile dynamic motions remains a substantial challenge for…

Robotics · Computer Science 2023-04-20 Laura Smith , J. Chase Kew , Tianyu Li , Linda Luu , Xue Bin Peng , Sehoon Ha , Jie Tan , Sergey Levine

Robotic grasp detection is a fundamental capability for intelligent manipulation in unstructured environments. Previous work mainly employed visual and tactile fusion to achieve stable grasp, while, the whole process depending heavily on…

Robotics · Computer Science 2019-09-17 Teng Xue , Wenhai Liu , Mingshuo Han , Zhenyu Pan , Jin Ma , Quanquan Shao , Weiming Wang

Robot introspection, as opposed to anomaly detection typical in process monitoring, helps a robot understand what it is doing at all times. A robot should be able to identify its actions not only when failure or novelty occurs, but also as…

Robotics · Computer Science 2018-01-23 Hongmin Wu , Hongbin Lin , Yisheng Guan , Kensuke Harada , Juan Rojas

Recent advances in learning reusable motion priors have demonstrated their effectiveness in generating naturalistic behaviors. In this paper, we propose a new learning framework in this paradigm for controlling physics-based characters with…

Graphics · Computer Science 2023-10-10 Qingxu Zhu , He Zhang , Mengting Lan , Lei Han

We provide a framework for accelerating reinforcement learning (RL) algorithms by heuristics constructed from domain knowledge or offline data. Tabula rasa RL algorithms require environment interactions or computation that scales with the…

Machine Learning · Computer Science 2021-11-23 Ching-An Cheng , Andrey Kolobov , Adith Swaminathan

Dealing with uncertainty is essential for efficient reinforcement learning. There is a growing literature on uncertainty estimation for deep learning from fixed datasets, but many of the most popular approaches are poorly-suited to…

Machine Learning · Statistics 2018-11-16 Ian Osband , John Aslanides , Albin Cassirer

When autonomous vehicles are deployed on public roads, they will encounter countless and diverse driving situations. Many manually designed driving policies are difficult to scale to the real world. Fortunately, reinforcement learning has…

Robotics · Computer Science 2023-05-09 Letian Wang , Jie Liu , Hao Shao , Wenshuo Wang , Ruobing Chen , Yu Liu , Steven L. Waslander

Model-based reinforcement learning (RL) is a sample-efficient way of learning complex behaviors by leveraging a learned single-step dynamics model to plan actions in imagination. However, planning every action for long-horizon tasks is not…

Machine Learning · Computer Science 2022-12-13 Lucy Xiaoyang Shi , Joseph J. Lim , Youngwoon Lee

We present a non-parametric Bayesian latent variable model capable of learning dependency structures across dimensions in a multivariate setting. Our approach is based on flexible Gaussian process priors for the generative mappings and…

Machine Learning · Statistics 2018-07-16 Andrew R. Lawrence , Carl Henrik Ek , Neill D. F. Campbell

Deep Reinforcement Learning (DRL) experiments are commonly performed in simulated environments due to the tremendous training sample demands from deep neural networks. In contrast, model-based Bayesian Learning allows a robot to learn good…

Robotics · Computer Science 2022-01-11 Jingyi Huang , Yizheng Zhang , Fabio Giardina , Andre Rosendo