English
Related papers

Related papers: THE COLOSSEUM: A Benchmark for Evaluating Generali…

200 papers

Robot manipulation is increasingly poised to interact with humans in co-shared workspaces. Despite increasingly robust manipulation and control algorithms, failure modes continue to exist whenever models do not capture the dynamics of the…

Imitation learning benchmarks often lack sufficient variation between training and evaluation, limiting meaningful generalisation assessment. We introduce Labyrinth, a benchmarking environment designed to test generalisation with precise…

Machine Learning · Computer Science 2025-09-30 Nathan Gavenski , Odinaldo Rodrigues

Learning is usually performed by observing real robot executions. Physics-based simulators are a good alternative for providing highly valuable information while avoiding costly and potentially destructive robot executions. We present a…

We introduce RoboEval, a structured evaluation framework and benchmark for robotic manipulation that augments binary success with principled behavioral and outcome metrics. Existing evaluations often collapse performance into outcome…

While recent advances in artificial intelligence have achieved human-level performance in environments like Starcraft and Go, many physical reasoning tasks remain challenging for modern algorithms. To date, few algorithms have been…

Artificial Intelligence · Computer Science 2023-02-02 Ken Kansky , Skanda Vaidyanath , Scott Swingle , Xinghua Lou , Miguel Lazaro-Gredilla , Dileep George

One of the most important promises of decentralized systems is scalability, which is often assumed to be present in robot swarm systems without being contested. Simple limitations, such as movement congestion and communication conflicts,…

Robotics · Computer Science 2023-07-18 Karthik Soma , Vivek Shankar Vardharajan , Heiko Hamann , Giovanni Beltrame

Robots assisting us in environments such as factories or homes must learn to make use of objects as tools to perform tasks, for instance using a tray to carry objects. We consider the problem of learning commonsense knowledge of when a tool…

Robotics · Computer Science 2022-06-22 Shreshth Tuli , Rajas Bansal , Rohan Paul , Mausam

Generalist robot policies can now perform a wide range of manipulation skills, but evaluating and improving their ability with unfamiliar objects and instructions remains a significant challenge. Rigorous evaluation requires a large number…

Robotics · Computer Science 2026-03-03 Yanjiang Guo , Lucy Xiaoyang Shi , Jianyu Chen , Chelsea Finn

This work addresses the coordination problem of multiple robots with the goal of finding specific hazardous targets in an unknown area and dealing with them cooperatively. The desired behaviour for the robotic system entails multiple…

Robotics · Computer Science 2019-03-29 Nunzia Palmieri , Xin-She Yang , Floriano De Rango , Amilcare Francesco Santamaria

Imitation learning frameworks for robotic manipulation have drawn attention in the recent development of language model grounded robotics. However, the success of the frameworks largely depends on the coverage of the demonstration cases:…

Robotics · Computer Science 2025-03-10 Tong Mu , Yihao Liu , Mehran Armand

The problem of coordination without a priori information about the environment is important in robotics. Applications vary from formation control to search and rescue. This paper considers the problem of search by a group of solitary…

Robotics · Computer Science 2019-05-28 Jordan F. Masakuna , Simukai W. Utete , Steve Kroon

Large language models (LLMs) have shown promising potential in scientific research, enabling tasks ranging from knowledge retrieval to property prediction. Existing science benchmarks mainly focus on perceptual or knowledge-based tasks,…

Machine learning has facilitated significant advancements across various robotics domains, including navigation, locomotion, and manipulation. Many such achievements have been driven by the extensive use of simulation as a critical tool for…

We present our general-purpose mobile manipulation system consisting of a custom robot platform and key algorithms spanning perception and planning. To extensively test the system in the wild and benchmark its performance, we choose a…

Pose estimation aims to accurately identify anatomical keypoints in humans and animals using monocular images, which is crucial for various applications such as human-machine interaction, embodied AI, and autonomous driving. While current…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Sihan Ma , Jing Zhang , Qiong Cao , Dacheng Tao

The growing ambition for space exploration demands robust autonomous systems that can operate in unstructured environments under extreme extraterrestrial conditions. The adoption of robot learning in this domain is severely hindered by the…

Robotics · Computer Science 2025-09-30 Andrej Orsula , Matthieu Geist , Miguel Olivares-Mendez , Carol Martinez

Cross-embodiment learning seeks to build generalist robots that operate across diverse morphologies, but differences in action spaces and kinematics hinder data sharing and policy transfer. This raises a central question: Is there any…

Robotics · Computer Science 2025-11-11 Zihao He , Bo Ai , Tongzhou Mu , Yulin Liu , Weikang Wan , Jiawei Fu , Yilun Du , Henrik I. Christensen , Hao Su

Evolutionary robot systems are usually affected by the properties of the environment indirectly through selection. In this paper, we present and investigate a system where the environment also has a direct effect: through regulation. We…

Robotics · Computer Science 2025-06-18 Karine Miras , Eliseo Ferrante , A. E. Eiben

Reliably ensuring Large Language Models (LLMs) follow complex instructions is a critical challenge, as existing benchmarks often fail to reflect real-world use or isolate compliance from task success. We introduce MOSAIC (MOdular Synthetic…

Artificial Intelligence · Computer Science 2026-01-27 Alberto Purpura , Li Wang , Sahil Badyal , Eugenio Beaufrand , Adam Faulkner

Robotic manipulation stands as a largely unsolved problem despite significant advances in robotics and machine learning in recent years. One of the key challenges in manipulation is the exploration of the dynamics of the environment when…

Robotics · Computer Science 2022-10-25 Tim Schneider , Boris Belousov , Georgia Chalvatzaki , Diego Romeres , Devesh K. Jha , Jan Peters