English
Related papers

Related papers: Online 3D Bin Packing Reinforcement Learning Solut…

200 papers

We study the problem of learning online packing skills for irregular 3D shapes, which is arguably the most challenging setting of bin packing problems. The goal is to consecutively move a sequence of 3D objects with arbitrary shapes into a…

Machine Learning · Computer Science 2023-06-05 Hang Zhao , Zherong Pan , Yang Yu , Kai Xu

The 3D bin packing problem, with its diverse industrial applications, has garnered significant research attention in recent years. Existing approaches typically model it as a discrete and static process, while real-world applications…

Robotics · Computer Science 2025-11-26 Lidi Zhang , Han Wu , Liyu Zhang , Ruofeng Liu , Haotian Wang , Chao Li , Desheng Zhang , Yunhuai Liu , Tian He

The three-dimensional bin packing problem (3D-BPP) plays an important role in city logistics and manufacturing environments, due to its direct relevance to operational cost. Most existing literature have investigated the conventional…

Computational Geometry · Computer Science 2022-07-01 Qiruyi Zuo , Xinglu Liu , Wai Kin Victor Chan

The Bin Packing Problem is a classic problem with wide industrial applicability. In fact, the efficient packing of items into bins is one of the toughest challenges in many logistic corporations and is a critical issue for reducing storage…

Artificial Intelligence · Computer Science 2024-02-16 Sebastián V. Romero , Eneko Osaba , Esther Villar-Rodriguez , Antón Asla

Intelligent manufacturing is becoming increasingly important due to the growing demand for maximizing productivity and flexibility while minimizing waste and lead times. This work investigates automated secondary robotic food packaging…

Robotic bin packing is widely deployed in warehouse automation, with current systems achieving robust performance through heuristic and learning-based strategies. These systems must balance compact placement with rapid execution, where…

Robotics · Computer Science 2026-03-10 Nikita Sarawgi , Omey M. Manyar , Fan Wang , Thinh H. Nguyen , Daniel Seita , Satyandra K. Gupta

Offline-to-Online Reinforcement Learning (O2O RL) faces a critical dilemma in balancing the use of a fixed offline dataset with newly collected online experiences. Standard methods, often relying on a fixed data-mixing ratio, struggle to…

Machine Learning · Computer Science 2026-04-09 Chihyeon Song , Jaewoo Lee , Jinkyoo Park

Physical feasibility in 3D bin packing is a key requirement in modern industrial logistics and robotic automation. With the growing adoption of industrial automation, online bin packing has gained increasing attention. However,…

The Bin Packing Problem is one of the most important optimization problems. In recent years, due to its NP-hard nature, several approximation algorithms have been presented. It is proved that the best algorithm for the Bin Packing Problem…

Data Structures and Algorithms · Computer Science 2015-08-07 Abdolahad Noori Zehmakan

Many combinatorial optimization problems such as the bin packing and multiple knapsack problems involve assigning a set of discrete objects to multiple containers. These problems can be used to model task and resource allocation problems in…

Artificial Intelligence · Computer Science 2011-10-12 A. S. Fukunaga , R. E. Korf

Recently experience replay is widely used in various deep reinforcement learning (RL) algorithms, in this paper we rethink the utility of experience replay. It introduces a new hyper-parameter, the memory buffer size, which needs carefully…

Machine Learning · Computer Science 2018-05-01 Shangtong Zhang , Richard S. Sutton

Reinforcement Learning (RL) has achieved significant success in application domains such as robotics, games and health care. However, training RL agents is very time consuming. Current implementations exhibit poor performance due to…

Machine Learning · Computer Science 2021-12-24 Chi Zhang , Sanmukh Rao Kuppannagari , Viktor K Prasanna

We present a novel learning framework to solve the transport-and-packing (TAP) problem in 3D. It constitutes a full solution pipeline from partial observations of input objects via RGBD sensing and recognition to final box placement, via…

Machine Learning · Computer Science 2023-11-17 Juzhan Xu , Minglun Gong , Hao Zhang , Hui Huang , Ruizhen Hu

We investigate a real-life air cargo loading problem which is a variant of the three-dimensional Variable Size Bin Packing Problem with special bin forms of cuboid and non-cuboid unit load devices (ULDs). Packing is constrained by…

Optimization and Control · Mathematics 2024-10-03 Katrin Heßler , Timo Hintsch , Lukas Wienkamp

Adversarial self-play in two-player games has delivered impressive results when used with reinforcement learning algorithms that combine deep neural networks and tree search. Algorithms like AlphaZero and Expert Iteration learn tabula-rasa,…

The Bin Packing Problem is one of the most important Combinatorial Optimization problems in optimization and has a lot of real-world applications. Many approximation algorithms have been presented for this problem because of its NP-hard…

Data Structures and Algorithms · Computer Science 2015-09-22 Abdolahad Noori Zehmakan , Mojtaba Eslahi

Reinforcement learning (RL) has been widely applied to game-playing and surpassed the best human-level performance in many domains, yet there are few use-cases in industrial or commercial settings. We introduce OR-Gym, an open-source…

Artificial Intelligence · Computer Science 2020-10-20 Christian D. Hubbs , Hector D. Perez , Owais Sarwar , Nikolaos V. Sahinidis , Ignacio E. Grossmann , John M. Wassick

This paper explores the application of Reinforcement Learning (RL) to the two-dimensional rectangular packing problem. We propose a reduced representation of the state and action spaces that allow us for high granularity. Leveraging UNet…

Machine Learning · Computer Science 2024-09-25 Waldemar Kołodziejczyk , Mariusz Kaleta

Although reinforcement learning (RL) is considered the gold standard for policy design, it may not always provide a robust solution in various scenarios. This can result in severe performance degradation when the environment is exposed to…

Machine Learning · Computer Science 2023-06-14 Juncheng Dong , Hao-Lun Hsu , Qitong Gao , Vahid Tarokh , Miroslav Pajic

Container stowage planning (CSPP) is a critical component of maritime transportation and terminal operations, directly affecting supply chain efficiency. Owing to its complexity, CSPP has traditionally relied on human expertise. While…

Artificial Intelligence · Computer Science 2025-10-06 Yunqi Huang , Nishith Chennakeshava , Alexis Carras , Vladislav Neverov , Wei Liu , Aske Plaat , Yingjie Fan