English
Related papers

Related papers: Dynamic Q-planning for Online UAV Path Planning in…

200 papers

In this paper, we propose a reinforcement learning-based algorithm for trajectory optimization for constrained dynamical systems. This problem is motivated by the fact that for most robotic systems, the dynamics may not always be known.…

Machine Learning · Statistics 2020-03-05 Kei Ota , Devesh K. Jha , Tomoaki Oiki , Mamoru Miura , Takashi Nammoto , Daniel Nikovski , Toshisada Mariyama

Unmanned Aerial Vehicles (UAVs) have been emerging as an effective solution for IoT data collection networks thanks to their outstanding flexibility, mobility, and low operation costs. However, due to the limited energy and uncertainty from…

Networking and Internet Architecture · Computer Science 2021-06-22 Nam H. Chu , Dinh Thai Hoang , Diep N. Nguyen , Nguyen Van Huynh , Eryk Dutkiewicz

Unmanned aerial vehicles (UAVs) are recognized as promising technologies for area coverage due to the flexibility and adaptability. However, the ability of a single UAV is limited, and as for the large-scale three-dimensional (3D) scenario,…

Signal Processing · Electrical Eng. & Systems 2023-09-22 Jia He , Ziye Jia , Chao Dong , Junyu Liu , Qihui Wu , Jingxian Liu

Decision making for autonomous driving in urban environments is challenging due to the complexity of the road structure and the uncertainty in the behavior of diverse road users. Traditional methods consist of manually designed rules as the…

Neural and Evolutionary Computing · Computer Science 2020-10-27 Niranjan Deshpande , Dominique Vaufreydaz , Anne Spalanzani

Autonomous robots are often employed for data collection due to their efficiency and low labour costs. A key task in robotic data acquisition is planning paths through an initially unknown environment to collect observations given…

Robotics · Computer Science 2024-07-08 Apoorva Vashisth , Julius Rückin , Federico Magistri , Cyrill Stachniss , Marija Popović

Q-learning methods are widely used in robot path planning but often face challenges of inefficient search and slow convergence. We propose an Improved Q-learning (IQL) framework that enhances standard Q-learning in two significant ways.…

Robotics · Computer Science 2025-01-10 Wei Liu , Ruiyang Wang , Haonan Wang , Guangwei Liu

This research presents an online path planner for Unmanned Aerial Vehicles (UAVs) that can handle dynamic obstacles and UAV motion constraints, including maximum curvature and desired orientations. Our proposed planner uses a NURBS path…

Reinforcement learning continuously optimizes decision-making based on real-time feedback reward signals through continuous interaction with the environment, demonstrating strong adaptive and self-learning capabilities. In recent years, it…

Robotics · Computer Science 2024-08-15 Zixiang Wang , Hao Yan , Yining Wang , Zhengjia Xu , Zhuoyue Wang , Zhizhong Wu

Safe and efficient autonomous driving maneuvers in an interactive and complex environment can be considerably challenging due to the unpredictable actions of other surrounding agents that may be cooperative or adversarial in their…

Robotics · Computer Science 2019-01-28 Pin Wang , Ching-Yao Chan , Hanhan Li

Unmanned aerial vehicles (UAVs) technique has been recognized as a promising solution in future wireless connectivity from the sky, and UAV navigation is one of the most significant open research problems, which has attracted wide interest…

Signal Processing · Electrical Eng. & Systems 2019-11-28 Hongji Huang , Yuchun Yang , Hong Wang , Zhiguo Ding , Hikmet Sari , Fumiyuki Adachi

In this paper, we propose a novel Reinforcement Learning approach for solving the Active Information Acquisition problem, which requires an agent to choose a sequence of actions in order to acquire information about a process of interest…

Machine Learning · Computer Science 2019-10-25 Heejin Jeong , Brent Schlotfeldt , Hamed Hassani , Manfred Morari , Daniel D. Lee , George J. Pappas

In this study, reinforcement learning was applied to learning two-dimensional path planning including obstacle avoidance by unmanned aerial vehicle (UAV) in an indoor environment. The task assigned to the UAV was to reach the goal position…

Robotics · Computer Science 2022-12-13 Jongmin Park , Sooyoung Jang , Younghoon Shin

The unmanned aerial vehicle (UAV)-enabled communication technology is regarded as an efficient and effective solution for some special application scenarios where existing terrestrial infrastructures are overloaded to provide reliable…

Networking and Internet Architecture · Computer Science 2022-09-20 Jinjing Wang , Xindi Wang

Surveillance and exploration of large environments is a tedious task. In spaces with limited environmental cues, random-like search is an effective approach as it allows the robot to perform online coverage of environments using simple…

Robotics · Computer Science 2022-11-15 Karan Sridharan , Patrick McNamee , Zahra Nili Ahmadabadi , Jeffrey Hudack

We address the problem of offline learning a policy that avoids undesirable demonstrations. Unlike conventional offline imitation learning approaches that aim to imitate expert or near-optimal demonstrations, our setting involves avoiding…

Machine Learning · Computer Science 2024-10-14 Huy Hoang , Tien Mai , Pradeep Varakantham

Sequential decision tasks with incomplete information are characterized by the exploration problem; namely the trade-off between further exploration for learning more about the environment and immediate exploitation of the accrued…

Artificial Intelligence · Computer Science 2013-02-21 Grigoris I. Karakoulas

A risk-averse preview-based $Q$-learning planner is presented for navigation of autonomous vehicles. To this end, the multi-lane road ahead of a vehicle is represented by a finite-state non-stationary Markov decision process (MDP). A risk…

Systems and Control · Electrical Eng. & Systems 2022-10-19 Majid Mazouchi , Subramanya Nageshrao , Hamidreza Modares

Reinforcement Learning algorithms have recently been proposed to learn time-sequential control policies in the field of autonomous driving. Direct applications of Reinforcement Learning algorithms with discrete action space will yield…

Machine Learning · Computer Science 2019-12-03 Pin Wang , Hanhan Li , Ching-Yao Chan

Unmanned Aerial vehicles (UAVs) are widely used as network processors in mobile networks, but more recently, UAVs have been used in Mobile Edge Computing as mobile servers. However, there are significant challenges to use UAVs in complex…

Multiagent Systems · Computer Science 2021-05-20 Huan Chang , Yicheng Chen , Baochang Zhang , David Doermann

Safe autonomous navigation is an essential and challenging problem for robots operating in highly unstructured or completely unknown environments. Under these conditions, not only robotic systems must deal with limited localisation…

Robotics · Computer Science 2020-05-27 Èric Pairet , Juan David Hernández , Marc Carreras , Yvan Petillot , Morteza Lahijanian