English
Related papers

Related papers: Bridging the Sim-to-Real Gap with Bayesian Inferen…

200 papers

The success of deep reinforcement learning (RL) and imitation learning (IL) in vision-based robotic manipulation typically hinges on the expense of large scale data collection. With simulation, data to train a policy can be collected…

Robotics · Computer Science 2021-07-06 Daniel Ho , Kanishka Rao , Zhuo Xu , Eric Jang , Mohi Khansari , Yunfei Bai

This paper studies the problem of predicting future trajectories of people in unseen cameras of novel scenarios and views. We approach this problem through the real-data-free setting in which the model is trained only on 3D simulation data…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Junwei Liang , Lu Jiang , Alexander Hauptmann

The Robotics community has started to heavily rely on increasingly realistic 3D simulators for large-scale training of robots on massive amounts of data. But once robots are deployed in the real world, the simulation gap, as well as changes…

Robotics · Computer Science 2021-12-06 Theo Jaunet , Guillaume Bono , Romain Vuillemot , Christian Wolf

Endowing robots with human-like physical reasoning abilities remains challenging. We argue that existing methods often disregard spatio-temporal relations and by using Graph Neural Networks (GNNs) that incorporate a relational inductive…

Machine Learning · Computer Science 2019-10-24 Fabio Ferreira , Lin Shao , Tamim Asfour , Jeannette Bohg

Simulating soft robots in cluttered environments remains an open problem due to the challenge of capturing complex dynamics and interactions with the environment. Furthermore, fast simulation is desired for quickly exploring robot behaviors…

Robotics · Computer Science 2020-11-04 Rianna Jitosho , Nathaniel Agharese , Allison Okamura , Zac Manchester

Deep reinforcement learning has recently seen huge success across multiple areas in the robotics domain. Owing to the limitations of gathering real-world data, i.e., sample inefficiency and the cost of collecting it, simulation environments…

Machine Learning · Computer Science 2021-07-09 Wenshuai Zhao , Jorge Peña Queralta , Tomi Westerlund

In this paper, we present a state-of-the-art reinforcement learning method for autonomous driving. Our approach employs temporal difference learning in a Bayesian framework to learn vehicle control signals from sensor data. The agent has…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Zahra Gharaee , Karl Holmquist , Linbo He , Michael Felsberg

Deep reinforcement learning provides a promising approach for vision-based control of real-world robots. However, the generalization of such models depends critically on the quantity and variety of data available for training. This data can…

Machine Learning · Computer Science 2019-02-12 Katie Kang , Suneel Belkhale , Gregory Kahn , Pieter Abbeel , Sergey Levine

Forklifts are used extensively in various industrial settings and are in high demand for automation. In particular, counterbalance forklifts are highly versatile and employed in diverse scenarios. However, efforts to automate these…

Robotics · Computer Science 2025-05-07 Koshi Oishi , Teruki Kato , Hiroya Makino , Seigo Ito

Despite the increasing adoption of Deep Reinforcement Learning (DRL) for Autonomous Surface Vehicles (ASVs), there still remain challenges limiting real-world deployment. In this paper, we first integrate buoyancy and hydrodynamics models…

In this paper, we examine the effectiveness of pre-training for visuo-motor control tasks. We revisit a simple Learning-from-Scratch (LfS) baseline that incorporates data augmentation and a shallow ConvNet, and find that this baseline is…

Machine Learning · Computer Science 2023-06-16 Nicklas Hansen , Zhecheng Yuan , Yanjie Ze , Tongzhou Mu , Aravind Rajeswaran , Hao Su , Huazhe Xu , Xiaolong Wang

Deep neural network based reinforcement learning (RL) can learn appropriate visual representations for complex tasks like vision-based robotic grasping without the need for manually engineering or prior learning a perception system.…

Robotics · Computer Science 2020-06-17 Kanishka Rao , Chris Harris , Alex Irpan , Sergey Levine , Julian Ibarz , Mohi Khansari

Learning from Demonstrations (LfD) and Reinforcement Learning (RL) have enabled robot agents to accomplish complex tasks. Reward Machines (RMs) enhance RL's capability to train policies over extended time horizons by structuring high-level…

Robotics · Computer Science 2024-12-16 Mattijs Baert , Sam Leroux , Pieter Simoens

The rise of deep learning has caused a paradigm shift in robotics research, favoring methods that require large amounts of data. Unfortunately, it is prohibitively expensive to generate such data sets on a physical platform. Therefore,…

Robotics · Computer Science 2022-01-19 Fabio Muratore , Fabio Ramos , Greg Turk , Wenhao Yu , Michael Gienger , Jan Peters

We present Sym2Real, a fully data-driven framework that provides a principled way to train low-level adaptive controllers in a highly data-efficient manner. Using only about 10 trajectories, we achieve robust control of both a quadrotor and…

Robotics · Computer Science 2025-09-22 Easop Lee , Samuel A. Moore , Boyuan Chen

Teaching robots dexterous manipulation skills often requires collecting hundreds of demonstrations using wearables or teleoperation, a process that is challenging to scale. Videos of human-object interactions are easier to collect and…

Robotics · Computer Science 2025-08-19 Tyler Ga Wei Lum , Olivia Y. Lee , C. Karen Liu , Jeannette Bohg

Designing agile locomotion for quadruped robots often requires extensive expertise and tedious manual tuning. In this paper, we present a system to automate this process by leveraging deep reinforcement learning techniques. Our system can…

As robots venture into the real world, they are subject to unmodeled dynamics and disturbances. Traditional model-based control approaches have been proven successful in relatively static and known operating environments. However, when an…

Robotics · Computer Science 2021-12-08 Siqi Zhou , Karime Pereida , Wenda Zhao , Angela P. Schoellig

This paper presents a Long Short-Term Memory network-based Fluid Experiment Data-Driven model (FED-LSTM) for predicting unsteady, nonlinear hydrodynamic forces on the underwater quadruped robot we constructed. Trained on experimental data…

Robotics · Computer Science 2025-09-05 Fei Han , Pengming Guo , Hao Chen , Weikun Li , Jingbo Ren , Naijun Liu , Ning Yang , Dixia Fan

Pre-training for Reinforcement Learning (RL) with purely video data is a valuable yet challenging problem. Although in-the-wild videos are readily available and inhere a vast amount of prior world knowledge, the absence of action…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Hao Luo , Bohan Zhou , Zongqing Lu