English
Related papers

Related papers: THE COLOSSEUM: A Benchmark for Evaluating Generali…

200 papers

Data scaling and standardized evaluation benchmarks have driven significant advances in natural language processing and computer vision. However, robotics faces unique challenges in scaling data and establishing evaluation protocols.…

Training control policies in simulation is more appealing than on real robots directly, as it allows for exploring diverse states in an efficient manner. Yet, robot simulators inevitably exhibit disparities from the real-world…

Robotics · Computer Science 2023-10-23 Peide Huang , Xilun Zhang , Ziang Cao , Shiqi Liu , Mengdi Xu , Wenhao Ding , Jonathan Francis , Bingqing Chen , Ding Zhao

Reasoning from diverse observations is a fundamental capability for generalist robot policies to operate in a wide range of environments. Despite recent advancements, many large-scale robotic policies still remain sensitive to key sources…

Robotics · Computer Science 2025-12-08 Jonathan Yang , Chelsea Finn , Dorsa Sadigh

The future robots are expected to work in a shared physical space with humans [1], however, the presence of humans leads to a dynamic environment that is challenging for mobile robots to navigate. The path planning algorithms designed to…

Robotics · Computer Science 2022-02-09 Prabhjot Kaur , Zichuan Liu , Weisong Shi

Simulators are a critical component of modern robotics research. Strategies for both perception and decision making can be studied in simulation first before deployed to real world systems, saving on time and costs. Despite significant…

Machine Learning · Computer Science 2020-11-19 Bhairav Mehta , Ankur Handa , Dieter Fox , Fabio Ramos

The pursuit of general-purpose robotics has yielded impressive foundation models, yet simulation-based benchmarking remains a bottleneck due to rapid performance saturation and a lack of true generalization testing. Existing benchmarks…

Data scaling has revolutionized fields like natural language processing and computer vision, providing models with remarkable generalization capabilities. In this paper, we investigate whether similar data scaling laws exist in robotics,…

Robotics · Computer Science 2025-10-14 Yingdong Hu , Fanqi Lin , Pingyue Sheng , Chuan Wen , Jiacheng You , Yang Gao

Meticulously analysing the empirical strengths and weaknesses of reinforcement learning methods in hard (challenging) environments is essential to inspire innovations and assess progress in the field. In tabular reinforcement learning,…

Machine Learning · Computer Science 2022-10-25 Michelangelo Conserva , Paulo Rauber

Recent advancements in robotics have enabled robots to navigate complex scenes or manipulate diverse objects independently. However, robots are still impotent in many household tasks requiring coordinated behaviors such as opening doors.…

Robotics · Computer Science 2024-12-09 Ruihan Yang , Yejin Kim , Rose Hendrix , Aniruddha Kembhavi , Xiaolong Wang , Kiana Ehsani

Selecting an optimal robot, its base pose, and trajectory for a given task is currently mainly done by human expertise or trial and error. To evaluate automatic approaches to this combined optimization problem, we introduce a benchmark…

Robotics · Computer Science 2024-03-22 Matthias Mayer , Jonathan Külz , Matthias Althoff

Autonomous robots have the potential to serve as versatile caregivers that improve quality of life for millions of people worldwide. Yet, conducting research in this area presents numerous challenges, including the risks of physical…

Robotics · Computer Science 2019-10-11 Zackory Erickson , Vamsee Gangaram , Ariel Kapusta , C. Karen Liu , Charles C. Kemp

We introduce BiGym, a new benchmark and learning environment for mobile bi-manual demo-driven robotic manipulation. BiGym features 40 diverse tasks set in home environments, ranging from simple target reaching to complex kitchen cleaning.…

Robotics · Computer Science 2024-07-12 Nikita Chernyadev , Nicholas Backshall , Xiao Ma , Yunfan Lu , Younggyo Seo , Stephen James

Robustness is a crucial factor for the successful deployment of robots in unstructured environments, particularly in the domain of Simultaneous Localization and Mapping (SLAM). Simulation-based benchmarks have emerged as a highly scalable…

Uncertainties in the real world mean that is impossible for system designers to anticipate and explicitly design for all scenarios that a robot might encounter. Thus, robots designed like this are fragile and fail outside of…

Robotics · Computer Science 2023-10-02 Ricardo Cannizzaro , Jonathan Routley , Lars Kunze

Simulation engines are widely adopted in robotics. However, they lack either full simulation control, ROS integration, realistic physics, or photorealism. Recently, synthetic data generation and realistic rendering has advanced tasks like…

Robotics · Computer Science 2023-05-29 Elia Bonetto , Chenghao Xu , Aamir Ahmad

Deformable Object Manipulation (DOM) is of significant importance to both daily and industrial applications. Recent successes in differentiable physics simulators allow learning algorithms to train a policy with analytic gradients through…

Robotics · Computer Science 2023-03-13 Siwei Chen , Yiqing Xu , Cunjun Yu , Linfeng Li , Xiao Ma , Zhongwen Xu , David Hsu

In this paper, we study the problem of enabling a vision-based robotic manipulation system to generalize to novel tasks, a long-standing challenge in robot learning. We approach the challenge from an imitation learning perspective, aiming…

We present MOSAIC, a modular architecture for coordinating multiple robots to (a) interact with users using natural language and (b) manipulate an open vocabulary of everyday objects. MOSAIC employs modularity at several levels: it…

General-purpose robots coexisting with humans in their environment must learn to relate human language to their perceptions and actions to be useful in a range of daily tasks. Moreover, they need to acquire a diverse repertoire of…

Robotics · Computer Science 2022-07-14 Oier Mees , Lukas Hermann , Erick Rosete-Beas , Wolfram Burgard

The environments in which the collaboration of a robot would be the most helpful to a person are frequently uncontrolled and cluttered with many objects present. Legible robot arm motion is crucial in tasks like these in order to avoid…

Robotics · Computer Science 2024-06-04 Melanie Schmidt-Wolf , Tyler Becker , Denielle Oliva , Monica Nicolescu , David Feil-Seifer