English
Related papers

Related papers: PushWorld: A benchmark for manipulation planning w…

200 papers

We are interested in pick-and-place style robot manipulation tasks in cluttered and confined 3D workspaces among movable objects that may be rearranged by the robot and may slide, tilt, lean or topple. A recently proposed algorithm, M4M,…

Robotics · Computer Science 2023-03-24 Dhruv Saxena , Maxim Likhachev

Spatial visualization is the mental ability to imagine, transform, and manipulate the spatial characteristics of objects and actions. This intelligence is a part of human cognition where actions and perception are connected on a mental…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Nilay Yilmaz , Maitreya Patel , Naga Sai Abhiram Kusumba , Yixuan He , Yezhou Yang

To realize effective large-scale, real-world robotic applications, we must evaluate how well our robot policies adapt to changes in environmental conditions. Unfortunately, a majority of studies evaluate robot performance in environments…

Robotics · Computer Science 2024-05-29 Wilbert Pumacay , Ishika Singh , Jiafei Duan , Ranjay Krishna , Jesse Thomason , Dieter Fox

Understanding why a spacecraft maneuvers -- rather than simply that it did -- is an increasingly important problem for space domain awareness as Earth orbits grow crowded and contested. Current analysis pipelines are built for detection:…

Computation and Language · Computer Science 2026-05-26 Hao Liu , Siyuan Yang , Qinglei Hu , Dongyu Li

Among existing online mobile-use benchmarks, AndroidWorld has emerged as the dominant benchmark due to its reproducible environment and deterministic evaluation; however, recent agents achieving over 90% success rates indicate its…

Computation and Language · Computer Science 2026-01-01 Quyu Kong , Xu Zhang , Zhenyu Yang , Nolan Gao , Chen Liu , Panrong Tong , Chenglin Cai , Hanzhang Zhou , Jianan Zhang , Liangyu Chen , Zhidan Liu , Steven Hoi , Yue Wang

Nonprehensile actions such as pushing are crucial for addressing multi-object rearrangement problems. Many traditional methods generate robot-centric actions, which differ from intuitive human strategies and are typically inefficient. To…

Robotics · Computer Science 2025-11-03 Kejia Ren , Gaotian Wang , Andrew S. Morgan , Lydia E. Kavraki , Kaiyu Hang

To control how a robot moves, motion planning algorithms must compute paths in high-dimensional state spaces while accounting for physical constraints related to motors and joints, generating smooth and stable motions, avoiding obstacles,…

Foundation models hold significant potential for enabling robots to perform long-horizon general manipulation tasks. However, the simplicity of tasks and the uniformity of environments in existing benchmarks restrict their effective…

Robotics · Computer Science 2025-04-04 Liming Zheng , Feng Yan , Fanfan Liu , Chengjian Feng , Zhuoliang Kang , Lin Ma

Success stories of applied machine learning can be traced back to the datasets and environments that were put forward as challenges for the community. The challenge that the community sets as a benchmark is usually the challenge that the…

Machine Learning · Computer Science 2020-12-16 Ashish Kumar , Toby Buckley , John B. Lanier , Qiaozhi Wang , Alicia Kavelaars , Ilya Kuzovkin

Evaluating the scientific discovery capabilities of large language model based agents, particularly how they cope with varying environmental complexity and utilize prior knowledge, requires specialized benchmarks currently lacking in the…

Machine Learning · Computer Science 2025-10-28 Yimeng Chen , Piotr Piȩkos , Mateusz Ostaszewski , Firas Laakom , Jürgen Schmidhuber

Spatial reasoning is central to navigation and robotics, yet measuring model capabilities on these tasks remains difficult. Existing benchmarks evaluate models in a one-shot setting, requiring full solution generation in a single response,…

Artificial Intelligence · Computer Science 2026-04-13 Lars Benedikt Kaesberg , Tianyu Yang , Niklas Bauer , Terry Ruas , Jan Philip Wahle , Bela Gipp

Balancing safety and efficiency when planning in crowded scenarios with uncertain dynamics is challenging where it is imperative to accomplish the robot's mission without incurring any safety violations. Typically, chance constraints are…

Robotics · Computer Science 2023-02-22 Khaled A. Mustafa , Oscar de Groot , Xinwei Wang , Jens Kober , Javier Alonso-Mora

Language-model agents are increasingly used as persistent coworkers that assist users across multiple working days. During such workflows, the surrounding environment may change independently of the agent: new emails arrive, calendar…

Manipulation in cluttered environments is challenging due to spatial dependencies among objects, where an improper manipulation order can cause collisions or blocked access. Existing approaches often overlook these spatial relationships,…

Robotics · Computer Science 2026-01-01 Yuxiang Yan , Zhiyuan Zhou , Xin Gao , Guanghao Li , Shenglin Li , Jiaqi Chen , Qunyan Pu , Jian Pu

The release of nuPlan marks a new era in vehicle motion planning research, offering the first large-scale real-world dataset and evaluation schemes requiring both precise short-term planning and long-horizon ego-forecasting. Existing…

Robotics · Computer Science 2023-11-03 Daniel Dauner , Marcel Hallgarten , Andreas Geiger , Kashyap Chitta

We present an algorithm that produces a plan for relocating obstacles in order to grasp a target in clutter by a robotic manipulator without collisions. We consider configurations where objects are densely populated in a constrained and…

Robotics · Computer Science 2019-02-20 Jinhwi Lee , Younggil Cho , Changjoo Nam , Jonghyeon Park , Changhwan Kim

We propose Text2Motion, a language-based planning framework enabling robots to solve sequential manipulation tasks that require long-horizon reasoning. Given a natural language instruction, our framework constructs both a task- and…

Robotics · Computer Science 2024-11-01 Kevin Lin , Christopher Agia , Toki Migimatsu , Marco Pavone , Jeannette Bohg

Physical reasoning is a core aspect of intelligence in animals and humans. A central question is what model should be used as a basis for reasoning. Existing work considered models ranging from intuitive physics and physical simulators to…

Robotics · Computer Science 2020-07-07 Marc Toussaint , Jung-Su Ha , Danny Driess

Graphical User Interface (GUI) automation holds significant promise for assisting users with complex tasks, thereby boosting human productivity. Existing works leveraging Large Language Model (LLM) or LLM-based AI agents have shown…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Difei Gao , Lei Ji , Zechen Bai , Mingyu Ouyang , Peiran Li , Dongxing Mao , Qinchen Wu , Weichen Zhang , Peiyi Wang , Xiangwu Guo , Hengxu Wang , Luowei Zhou , Mike Zheng Shou

Recent progress in robotic manipulation has dealt with the case of previously unknown objects in the context of relatively simple tasks, such as bin-picking. Existing methods for more constrained problems, however, such as deliberate…

Robotics · Computer Science 2020-06-30 Chaitanya Mitash , Rahul Shome , Bowen Wen , Abdeslam Boularias , Kostas Bekris