English
Related papers

Related papers: Split Deep Q-Learning for Robust Object Singulatio…

200 papers

Grasping objects in cluttered scenarios is a challenging task in robotics. Performing pre-grasp actions such as pushing and shifting to scatter objects is a way to reduce clutter. Based on deep reinforcement learning, we propose a…

Robotics · Computer Science 2021-07-07 Dafa Ren , Xiaoqiang Ren , Xiaofan Wang , S. Tejaswi Digumarti , Guodong Shi

Object transportation could be a challenging problem for a single robot due to the oversize and/or overweight issues. A multi-robot system can take the advantage of increased driving power and more flexible configuration to solve such a…

Robotics · Computer Science 2020-07-21 Lin Zhang , Hao Xiong , Ou Ma , Zhaokui Wang

We consider the problem of sorting a densely cluttered pile of unknown objects using a robot. This yet unsolved problem is relevant in the robotic waste sorting business. By extending previous active learning approaches to grasping, we show…

Robotics · Computer Science 2016-09-06 Janne V. Kujala , Tuomas J. Lukka , Harri Holopainen

The domain of robotics is challenging to apply deep reinforcement learning due to the need for large amounts of data and for ensuring safety during learning. Curriculum learning has shown good performance in terms of sample- efficient deep…

Robotics · Computer Science 2022-04-15 Anil Kurkcu , Cihan Acar , Domenico Campolo , Keng Peng Tee

In this work, we present a methodology that enables an agent to make efficient use of its exploratory actions by autonomously identifying possible objectives in its environment and learning them in parallel. The identification of objectives…

Artificial Intelligence · Computer Science 2019-01-11 Thommen George Karimpanal , Erik Wilhelm

We address the manipulation task of retrieving a target object from a cluttered shelf. When the target object is hidden, the robot must search through the clutter for retrieving it. Solving this task requires reasoning over the likely…

Robotics · Computer Science 2021-09-01 Wissam Bejjani , Wisdom C. Agboh , Mehmet R. Dogar , Matteo Leonetti

We study the problem of robotic stacking with objects of complex geometry. We propose a challenging and diverse set of such objects that was carefully designed to require strategies beyond a simple "pick-and-place" solution. Our method is a…

In warehouses, specialized agents need to navigate, avoid obstacles and maximize the use of space in the warehouse environment. Due to the unpredictability of these environments, reinforcement learning approaches can be applied to complete…

For a robotic grasping task in which diverse unseen target objects exist in a cluttered environment, some deep learning-based methods have achieved state-of-the-art results using visual input directly. In contrast, actor-critic deep…

Machine Learning · Computer Science 2020-02-28 Taewon Kim , Yeseong Park , Youngbin Park , Il Hong Suh

This work demonstrates how autonomously learning aspects of robotic operation from sparsely-labeled, real-world data of deployed, engineered solutions at industrial scale can provide with solutions that achieve improved performance.…

Dense collections of movable objects are common in everyday spaces-from cabinets in a home to shelves in a warehouse. Safely retracting objects from such collections is difficult for robots, yet people do it frequently, leveraging learned…

Robotics · Computer Science 2025-12-02 Dane Brouwer , Joshua Citron , Heather Nolte , Jeannette Bohg , Mark Cutkosky

Extrinsic dexterity leverages environmental contact to overcome the limitations of prehensile manipulation. However, achieving such dexterity in cluttered scenes remains challenging and underexplored, as it requires selectively exploiting…

This paper investigates decentralized shepherding in cluttered environments, where a limited number of herders must guide a larger group of non-cohesive, diffusive targets toward a goal region in the presence of static obstacles. A…

Systems and Control · Electrical Eng. & Systems 2025-11-27 Cristiana Punzo , Italo Napolitano , Cinzia Tomaselli , Mario di Bernardo

Rearranging objects on a tabletop surface by means of nonprehensile manipulation is a task which requires skillful interaction with the physical world. Usually, this is achieved by precisely modeling physical properties of the objects,…

Robotics · Computer Science 2018-09-21 Weihao Yuan , Johannes A. Stork , Danica Kragic , Michael Y. Wang , Kaiyu Hang

This study explores a pick-and-toss (PT) as an alternative to pick-and-place (PP), allowing a robot to extend its range and improve task efficiency. Although PT boosts efficiency in object arrangement, the placement environment critically…

Robotics · Computer Science 2024-11-08 Takuya Kiyokawa , Mahiro Muta , Weiwei Wan , Kensuke Harada

Developing personal robots that can perform a diverse range of manipulation tasks in unstructured environments necessitates solving several challenges for robotic grasping systems. We take a step towards this broader goal by presenting the…

This thesis presents novel algorithms to advance robotic object rearrangement, a critical task for autonomous systems in applications like warehouse automation and household assistance. Addressing challenges of high-dimensional planning,…

Robotics · Computer Science 2025-05-15 Baichuan Huang

Being able to reason in an environment with a large number of discrete actions is essential to bringing reinforcement learning to a larger class of problems. Recommender systems, industrial plants and language models are only some of the…

This paper presents a comparison between two well-known deep Reinforcement Learning (RL) algorithms: Deep Q-Learning (DQN) and Proximal Policy Optimization (PPO) in a simulated production system. We utilize a Petri Net (PN)-based simulation…

Artificial Intelligence · Computer Science 2023-06-05 Reuf Kozlica , Stefan Wegenkittl , Simon Hirländer

Robots find extensive applications in industry. In recent years, the influence of robots has also increased rapidly in domestic scenarios. The Q-learning algorithm aims to maximise the reward for reaching the goal. This paper proposes a…

Robotics · Computer Science 2024-09-04 Varun Prakash Rajamohan , Senthil Kumar Jagatheesaperumal