English
Related papers

Related papers: Robot Navigation in a Crowd by Integrating Deep Re…

200 papers

Autonomous navigation capabilities play a critical role in service robots operating in environments where human interactions are pivotal, due to the dynamic and unpredictable nature of these environments. However, the variability in human…

Robotics · Computer Science 2024-04-09 Mannan Saeed Muhammad , Estrella Montero

Navigating through dense human crowds remains a significant challenge for mobile robots. A key issue is the freezing robot problem, where the robot struggles to find safe motions and becomes stuck within the crowd. To address this, we…

Robotics · Computer Science 2026-03-03 Yufei Zhu , Shih-Min Yang , Martin Magnusson , Allan Wang

Aerial operation in turbulent environments is a challenging problem due to the chaotic behavior of the flow. This problem is made even more complex when a team of aerial robots is trying to achieve coordinated motion in turbulent wind…

Robotics · Computer Science 2023-06-09 Diego Patiño , Siddharth Mayya , Juan Calderon , Kostas Daniilidis , David Saldaña

Robot navigation in dense human crowds poses a significant challenge due to the complexity of human behavior in dynamic and obstacle-rich environments. In this work, we propose a dynamic weight adjustment scheme using a neural network to…

Robotics · Computer Science 2024-12-03 Muqing Cao , Xinhang Xu , Yizhuo Yang , Jianping Li , Tongxing Jin , Pengfei Wang , Tzu-Yi Hung , Guosheng Lin , Lihua Xie

This study proposes a novel approach for dynamic load balancing in Software-Defined Networks (SDNs) using a Transformer-based Deep Q-Network (DQN). Traditional load balancing mechanisms, such as Round Robin (RR) and Weighted Round Robin…

Autonomous navigation in crowded environments is an open problem with many applications, essential for the coexistence of robots and humans in the smart cities of the future. In recent years, deep reinforcement learning approaches have…

Robotics · Computer Science 2025-03-25 Diego Martinez-Baselga , Luis Riazuelo , Luis Montano

In order to solve the problem of frequent deceleration of unmanned vehicles when approaching obstacles, this article uses a Deep Q-Network (DQN) and its extension, the Double Deep Q-Network (DDQN), to develop a local navigation system that…

Robotics · Computer Science 2024-04-29 Hao Liu , Yi Shen , Wenjing Zhou , Yuelin Zou , Chang Zhou , Shuyao He

In recent years, the growing demand for more intelligent service robots is pushing the development of mobile robot navigation algorithms to allow safe and efficient operation in a dense crowd. Reinforcement learning (RL) approaches have…

Robotics · Computer Science 2024-10-28 Keyu Li , Ye Lu , Max Q. -H. Meng

Navigating robots safely and efficiently in crowded and complex environments remains a significant challenge. However, due to the dynamic and intricate nature of these settings, planning efficient and collision-free paths for robots to…

Robotics · Computer Science 2024-10-22 Zhuanglei Wen , Mingze Dong , Xiai Chen

Mobile robot navigation in dynamic environments with pedestrian traffic is a key challenge in the development of autonomous mobile service robots. Recently, deep reinforcement learning-based methods have been actively studied and have…

Robotics · Computer Science 2026-05-19 Kohei Matsumoto , Yuki Tomita , Yuki Hyodo , Ryo Kurazume

Forecasting human trajectories is critical for tasks such as robot crowd navigation and autonomous driving. Modeling social interactions is of great importance for accurate group-wise motion prediction. However, most existing methods do not…

Computer Vision and Pattern Recognition · Computer Science 2020-05-06 Yuying Chen , Congcong Liu , Bertram Shi , Ming Liu

Routing in multi-hop wireless networks is a complex problem, especially in heterogeneous networks where multiple wireless communication technologies coexist. Reinforcement learning (RL) methods, such as Q-learning, have been introduced for…

Signal Processing · Electrical Eng. & Systems 2025-08-21 Brian Kim , Justin H. Kong , Terrence J. Moore , Fikadu T. Dagefu

We study the problem of safe and intention-aware robot navigation in dense and interactive crowds. Most previous reinforcement learning (RL) based methods fail to consider different types of interactions among all agents or ignore the…

In high population cities, the gatherings of large crowds in public places and public areas accelerate or jeopardize people safety and transportation, which is a key challenge to the researchers. Although much research has been carried out…

Computer Vision and Pattern Recognition · Computer Science 2019-09-11 Muhammad Siraj

Both pedestrian and robot comfort are of the highest priority whenever a robot is placed in an environment containing human beings. In the case of pedestrian-unaware mobile robots this desire for safety leads to the freezing robot problem,…

Robotics · Computer Science 2022-06-03 Emily Pruc , Shlomo Zilberstein , Joydeep Biswas

With the increasing availability and affordability of personal robots, they will no longer be confined to large corporate warehouses or factories but will instead be expected to operate in less controlled environments alongside larger…

Robotics · Computer Science 2023-08-08 Rashmi Bhaskara , Maurice Chiu , Aniket Bera

Online ride-hailing services have become a prevalent transportation system across the world. In this paper, we study a challenging problem of how to direct vacant taxis around a city such that supplies and demands can be balanced in online…

Machine Learning · Computer Science 2022-12-13 Jiyao Li , Vicki H. Allan

Human-aware robot navigation promises a range of applications in which mobile robots bring versatile assistance to people in common human environments. While prior research has mostly focused on modeling pedestrians as independent,…

Robotics · Computer Science 2022-08-02 Kapil Katyal , Yuxiang Gao , Jared Markowitz , Sara Pohland , Corban Rivera , I-Jeng Wang , Chien-Ming Huang

Existing navigation policies for autonomous robots tend to focus on collision avoidance while ignoring human-robot interactions in social life. For instance, robots can pass along the corridor safer and easier if pedestrians notice them.…

Robotics · Computer Science 2022-03-31 Quecheng Qiu , Shunyi Yao , Jing Wang , Jun Ma , Guangda Chen , Jianmin Ji

Reinforcement learning (RL) enables an agent to learn from trial-and-error experiences toward achieving long-term goals; automated planning aims to compute plans for accomplishing tasks using action knowledge. Despite their shared goal of…

Robotics · Computer Science 2021-03-17 Yohei Hayamizu , Saeid Amiri , Kishan Chandan , Keiki Takadama , Shiqi Zhang