English
Related papers

Related papers: Research on reinforcement learning based warehouse…

200 papers

The Dijkstra algorithm is a classic path planning method, which in a discrete graph space, can start from a specified source node and find the shortest path between the source node and all other nodes in the graph. However, to the best of…

Robotics · Computer Science 2023-08-08 Jinyuan Liu , Minglei Fu , Wenan Zhang , Bo Chen , Ryhor Prakapovich , Uladzislau Sychou

The Autonomy of Unmanned Aerial Vehicles (UAVs) in indoor environments poses significant challenges due to the lack of reliable GPS signals in enclosed spaces such as warehouses, factories, and indoor facilities. Micro Aerial Vehicles…

Robotics · Computer Science 2025-04-09 Amit Kumar Singh , Prasanth Kumar Duba , P. Rajalakshmi

On-policy deep reinforcement learning algorithms have low data utilization and require significant experience for policy improvement. This paper proposes a proximal policy optimization algorithm with prioritized trajectory replay (PTR-PPO)…

Machine Learning · Computer Science 2021-12-09 Xingxing Liang , Yang Ma , Yanghe Feng , Zhong Liu

This paper presents a novel reinforcement learning (RL)-based planning scheme for optimized robotic management of biotic stresses in precision agriculture. The framework employs a hierarchical decision-making structure with conditional…

Traditional vehicle routing algorithms do not consider the changing nature of traffic. While implementations of Dijkstra's algorithm with varying weights exist, the weights are often changed after the outcome of algorithm is executed, which…

Optimization and Control · Mathematics 2022-05-31 Piyush Udhan , Akhilesh Ganeshkar , Poobigan Murugesan , Abhishek Raj Permani , Sameep Sanjeeva , Parth Deshpande

Proximal Policy Optimization (PPO) is a highly popular policy-based deep reinforcement learning (DRL) approach. However, we observe that the homogeneous exploration process in PPO could cause an unexpected stability issue in the training…

Machine Learning · Computer Science 2022-12-14 Qisheng Zhang , Zhen Guo , Audun Jøsang , Lance M. Kaplan , Feng Chen , Dong H. Jeong , Jin-Hee Cho

With the rapid growth of global e-commerce, the demand for automation in the logistics industry is increasing. This study focuses on automated picking systems in warehouses, utilizing deep learning and reinforcement learning technologies to…

Robotics · Computer Science 2026-02-10 Keqin Li , Jin Wang , Xubo Wu , Xirui Peng , Runmian Chang , Xiaoyu Deng , Yiwen Kang , Yue Yang , Fanghao Ni , Bo Hong

We present a novel algorithm for dynamic routing with dedicated path protection which, as the presented simulation results suggest, can be efficient and exact. We present the algorithm in the setting of optical networks, but it should be…

Networking and Internet Architecture · Computer Science 2021-09-22 Ireneusz Szcześniak , Ireneusz Olszewski , Bożena Woźna-Szcześniak

Proximal Policy Optimization (PPO) is widely regarded as one of the most successful deep reinforcement learning algorithms, known for its robustness and effectiveness across a range of problems. The PPO objective encourages the importance…

Machine Learning · Computer Science 2025-11-05 Gilad Karpel , Ruida Zhou , Shoham Sabach , Mohammad Ghavamzadeh

Proximal policy optimization (PPO) has yielded state-of-the-art results in policy search, a subfield of reinforcement learning, with one of its key points being the use of a surrogate objective function to restrict the step size at each…

Machine Learning · Computer Science 2020-12-07 Wangshu Zhu , Andre Rosendo

Pioneering companies such as Waymo have deployed robo-taxi services in several U.S. cities. These robo-taxis are electric vehicles, and their operations require the joint optimization of ride matching, vehicle repositioning, and charging…

Artificial Intelligence · Computer Science 2025-04-29 Jim Dai , Manxi Wu , Zhanhao Zhang

In this paper, we investigate the obstacle avoidance and navigation problem in the robotic control area. For solving such a problem, we propose revised Deep Deterministic Policy Gradient (DDPG) and Proximal Policy Optimization algorithms…

Robotics · Computer Science 2020-04-13 Daniel Zhang , Colleen P. Bailey

In many scientific and engineering problems, noise and nonlinearity are unavoidable, which could induce interesting mathematical problem such as transition phenomena. This paper focuses on efficiently discovering the most probable…

Optimization and Control · Mathematics 2023-06-08 Jin Guo , Ting Gao , Peng Zhang , Jiequn Han , Jinqiao Duan

Path planning is one of the most vital elements of mobile robotics, providing the agent with a collision-free route through the workspace. The global path plan can be calculated with a variety of informed search algorithms, most notably the…

Artificial Intelligence · Computer Science 2015-11-04 Alexander Lavin

Unmanned Aerial Vehicles (UAVs) are increasingly populating urban areas for delivery and surveillance purposes. In this work, we develop an optimal navigation strategy based on Deep Reinforcement Learning. The environment is represented by…

Artificial Intelligence · Computer Science 2025-10-30 Federica Tonti , Ricardo Vinuesa

Autonomous vehicle navigation in unstructured environments, such as forests and mountainous regions, presents significant challenges due to irregular terrain and complex road conditions. This work provides a comparative evaluation of…

Robotics · Computer Science 2025-07-09 Chang Liu , Zhexiong Xue , Tamas Sziranyi

Automation of logistic processes is essential to improve productivity and reduce costs. In this context, intelligent warehouses are becoming a key to logistic systems thanks to their ability of optimizing transportation tasks and,…

Proximal Policy Optimization (PPO) has been broadly applied to robotics learning, showcasing stable training performance. However, the fixed clipping bound setting may limit the performance of PPO. Specifically, there is no theoretical…

Machine Learning · Computer Science 2024-11-07 Ziqi Zhang , Jingzehua Xu , Zifeng Zhuang , Hongyin Zhang , Jinxin Liu , Donglin wang , Shuai Zhang

Proximal policy optimization(PPO) has been proposed as a first-order optimization method for reinforcement learning. We should notice that an exterior penalty method is used in it. Often, the minimizers of the exterior penalty functions…

Machine Learning · Computer Science 2018-12-18 Cheng Zeng , Hongming Zhang

Proximal policy optimization (PPO) is one of the most popular state-of-the-art on-policy algorithms that has become a standard baseline in modern reinforcement learning with applications in numerous fields. Though it delivers stable…

Machine Learning · Computer Science 2025-02-25 Qisai Liu , Zhanhong Jiang , Hsin-Jung Yang , Mahsa Khosravi , Joshua R. Waite , Soumik Sarkar