English
Related papers

Related papers: One4Many-StablePacker: An Efficient Deep Reinforce…

200 papers

Online 3-dimensional bin packing problem (O3D-BPP) is getting renewed prominence due to the industrial automation brought by Industry 4.0. However, due to limited attention in the past and its challenging nature, a good approximate…

Robotics · Computer Science 2021-11-02 Ankush Ojha , Marichi Agarwal , Aniruddha Singhal , Chayan Sarkar , Supratim Ghosh , Rajesh Sinha

Container stowage planning (CSPP) is a critical component of maritime transportation and terminal operations, directly affecting supply chain efficiency. Owing to its complexity, CSPP has traditionally relied on human expertise. While…

Artificial Intelligence · Computer Science 2025-10-06 Yunqi Huang , Nishith Chennakeshava , Alexis Carras , Vladislav Neverov , Wei Liu , Aske Plaat , Yingjie Fan

Reinforcement learning (RL) has shown promise in solving various combinatorial optimization problems. However, conventional RL faces challenges when dealing with complex, real-world constraints, especially when action space feasibility is…

Machine Learning · Computer Science 2025-08-12 Jaike van Twiller , Yossiri Adulyasak , Erick Delage , Djordje Grbic , Rune Møller Jensen

Robotic object packing has broad practical applications in the logistics and automation industry, often formulated by researchers as the online 3D Bin Packing Problem (3D-BPP). However, existing DRL-based methods primarily focus on…

Robotics · Computer Science 2024-12-25 Heng Xiong , Changrong Guo , Jian Peng , Kai Ding , Wenjie Chen , Xuchong Qiu , Long Bai , Jianfeng Xu

This paper presents a novel deep learning framework for solving multiple optimal stopping problems in high dimensions. While deep learning has recently shown promise for single stopping problems, the multiple exercise case involves complex…

Optimization and Control · Mathematics 2025-12-30 Mathieu Laurière , Mehdi Talbi

Training the deep convolutional neural network for computer vision problems is slow and inefficient, especially when it is large and distributed across multiple devices. The inefficiency is caused by the backpropagation algorithm's forward…

Machine Learning · Computer Science 2022-01-20 An Xu , Zhouyuan Huo , Heng Huang

The online 3D bin packing problem is important in logistics, warehousing and intelligent manufacturing, with solutions shifting to deep reinforcement learning (DRL) which faces challenges like low sample efficiency. This paper proposes a…

Robotics · Computer Science 2026-04-14 Jie Han , Tong Li , Qingyang Xu , Yong Song , Bao Pang , Xianfeng Yuan

We present new policy mirror descent (PMD) methods for solving reinforcement learning (RL) problems with either strongly convex or general convex regularizers. By exploring the structural properties of these overall highly nonconvex…

Machine Learning · Computer Science 2022-04-08 Guanghui Lan

Reinforcement learning with verifiable rewards has emerged as a promising paradigm for enhancing the reasoning capabilities of large language models particularly in mathematics. Current approaches in this domain present a clear trade-off:…

Computation and Language · Computer Science 2026-02-03 Batuhan K. Karaman , Aditya Rawal , Suhaila Shakiah , Mohammad Ghavamzadeh , Mingyi Hong , Arijit Biswas , Ruida Zhou

Robotic bin packing is widely deployed in warehouse automation, with current systems achieving robust performance through heuristic and learning-based strategies. These systems must balance compact placement with rapid execution, where…

Robotics · Computer Science 2026-03-10 Nikita Sarawgi , Omey M. Manyar , Fan Wang , Thinh H. Nguyen , Daniel Seita , Satyandra K. Gupta

Multi-objective Markov decision processes are a special kind of multi-objective optimization problem that involves sequential decision making while satisfying the Markov property of stochastic processes. Multi-objective reinforcement…

Machine Learning · Computer Science 2023-08-22 Sherif Abdelfattah , Kathryn Kasmarik , Jiankun Hu

The worldwide economy and environmental sustainability depend on eff icient and reliable supply chains, in which container shipping plays a crucial role as an environmentally friendly mode of transport. Liner shipping companies seek to…

Optimization and Control · Mathematics 2025-04-08 Jaike Van Twiller , Djordje Grbic , Rune Møller Jensen

Many combinatorial optimization problems such as the bin packing and multiple knapsack problems involve assigning a set of discrete objects to multiple containers. These problems can be used to model task and resource allocation problems in…

Artificial Intelligence · Computer Science 2011-10-12 A. S. Fukunaga , R. E. Korf

This paper presents an evaluation framework for assessing Large Language Models' (LLMs) capabilities in combinatorial optimization, specifically addressing the 2D bin-packing problem. We introduce a systematic methodology that combines LLMs…

Artificial Intelligence · Computer Science 2025-10-03 Syed Mahbubul Huq , Daniel Brito , Daniel Sikar , Chris Child , Tillman Weyde , Rajesh Mojumder

Recently, preference optimization methods such as DPO have significantly enhanced large language models (LLMs) in wide tasks including dialogue and question-answering. However, current methods fail to account for the varying difficulty…

Computation and Language · Computer Science 2024-12-31 Jingyuan Ma , Rui Li , Zheng Li , Lei Sha , Zhifang Sui

Current machine learning models for vision are often highly specialized and limited to a single modality and task. In contrast, recent large language models exhibit a wide range of capabilities, hinting at a possibility for similarly…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 David Mizrahi , Roman Bachmann , Oğuzhan Fatih Kar , Teresa Yeo , Mingfei Gao , Afshin Dehghan , Amir Zamir

We study the problem of learning online packing skills for irregular 3D shapes, which is arguably the most challenging setting of bin packing problems. The goal is to consecutively move a sequence of 3D objects with arbitrary shapes into a…

Machine Learning · Computer Science 2023-06-05 Hang Zhao , Zherong Pan , Yang Yu , Kai Xu

This paper proposes an off-policy risk-sensitive reinforcement learning based control framework for stabilization of a continuous-time nonlinear system that subjects to additive disturbances, input saturation, and state constraints. By…

Systems and Control · Electrical Eng. & Systems 2022-04-21 Cong Li , Qingchen Liu , Zhehua Zhou , Martin Buss , Fangzhou Liu

This work adopts the very successful distributional perspective on reinforcement learning and adapts it to the continuous control setting. We combine this within a distributed framework for off-policy learning in order to develop what we…

Learning-based quadruped controllers achieve impressive agility but typically lack formal safety guarantees under model uncertainty, perception noise, and unstructured contact conditions. We introduce SafeMind, a differentiable stochastic…

Robotics · Computer Science 2026-04-13 Zukun Zhang , Kai Shu , Mingqiao Mo