English
Related papers

Related papers: Equivariant Reinforcement Learning Frameworks for …

200 papers

Obstacle avoidance for unmanned aerial vehicles like quadrotors is a popular research topic. Most existing research focuses only on static environments, and obstacle avoidance in environments with multiple dynamic obstacles remains…

Robotics · Computer Science 2025-03-19 Xiyu Fan , Minghao Lu , Bowen Xu , Peng Lu

In recent years, unmanned aerial vehicle (UAV) related technology has expanded knowledge in the area, bringing to light new problems and challenges that require solutions. Furthermore, because the technology allows processes usually carried…

Artificial Intelligence · Computer Science 2022-12-08 Cristian Millán-Arias , Ruben Contreras , Francisco Cruz , Bruno Fernandes

Contrastive Reinforcement Learning (CRL) provides a promising framework for extracting useful structured representations from unlabeled interactions. By pulling together state-action pairs and their corresponding future states, while…

Robotics · Computer Science 2025-07-23 Arsh Tangri , Nichols Crawford Taylor , Haojie Huang , Robert Platt

Flying quadrotors in tight formations is a challenging problem. It is known that in the near-field airflow of a quadrotor, the aerodynamic effects induced by the propellers are complex and difficult to characterize. Although machine…

Robotics · Computer Science 2024-10-15 Kong Yao Chee , Pei-An Hsieh , George J. Pappas , M. Ani Hsieh

Agile flight for the quadrotor cable-suspended payload system is a formidable challenge due to its underactuated, highly nonlinear, and hybrid dynamics. Traditional optimization-based methods often struggle with high computational costs and…

Robotics · Computer Science 2026-01-30 Dongcheng Cao , Jin Zhou , Xian Wang , Shuo Li

Co-simulation is a critical approach for the design and analysis of complex cyber-physical systems. It will enhance development efficiency and reduce costs. This paper presents a co-simulation framework integrating ROS 2 and MATLAB/Simulink…

Systems and Control · Electrical Eng. & Systems 2025-11-07 Hangyu Teng

Recently, needs for unmanned aerial vehicles (UAVs) that are attachable to the wall have been highlighted. As one of the ways to address the need, researches on various tilting multirotors that can increase maneuverability has been…

Robotics · Computer Science 2021-08-13 Hyungyu Lee , Myeongwoo Jeong , Chanyoung Kim , Hyungtae Lim , Changgue Park , Sungwon Hwang , Hyun Myung

In this paper, we study a joint detection, mapping and navigation problem for a single unmanned aerial vehicle (UAV) equipped with a low complexity radar and flying in an unknown environment. The goal is to optimize its trajectory with the…

Robotics · Computer Science 2020-07-23 Anna Guerra , Francesco Guidi , Davide Dardari , Petar M. Djuric

The paper presents an approach for learning antenna Radiation Patterns (RPs) of a pair of heterogeneous quadrotor Uncrewed Aerial Vehicles (UAVs) by calibration flight data. RPs are modeled either as a Spherical Harmonics series or as a…

Robotics · Computer Science 2026-04-06 Martin Zoula , Daniel Bonilla Licea , Jan Faigl , Václav Navrátil , Martin Saska

Unmanned Aerial Vehicles (UAVs) increasingly enhance the Quality of Service (QoS) in wireless networks due to their flexibility and cost-effectiveness. However, optimizing UAV placement in dynamic, obstacle-prone environments remains a…

Networking and Internet Architecture · Computer Science 2026-01-30 Kamran Shafafi , Manuel Ricardo , Rui Campos

Executing precise and agile flight maneuvers is critical for quadrotors in various applications. Traditional quadrotor control approaches are limited by their reliance on flat trajectories or time-consuming optimization, which restricts…

Robotics · Computer Science 2025-05-23 Jiayu Chen , Chao Yu , Yuqing Xie , Feng Gao , Yinuo Chen , Shu'ang Yu , Wenhao Tang , Shilong Ji , Mo Mu , Yi Wu , Huazhong Yang , Yu Wang

Deploying robot learning methods to aerial robots in unstructured environments remains both challenging and promising. While recent advances in deep reinforcement learning (DRL) have enabled end-to-end flight control, the field still lacks…

Robotics · Computer Science 2025-12-10 Kangyao Huang , Hao Wang , Jingyu Chen , Jintao Chen , Yu Luo , Di Guo , Xiangkui Zhang , Xiangyang Ji , Huaping Liu

Equipping quadruped robots with manipulators provides unique loco-manipulation capabilities, enabling diverse practical applications. This integration creates a more complex system that has increased difficulties in modeling and control.…

Robotics · Computer Science 2025-07-08 Dianyong Hou , Chengrui Zhu , Zhen Zhang , Zhibin Li , Chuang Guo , Yong Liu

Unmanned combat air vehicle (UCAV) combat is a challenging scenario with continuous action space. In this paper, we propose a general hierarchical framework to resolve the within-vision-range (WVR) air-to-air combat problem under 6…

Artificial Intelligence · Computer Science 2024-09-21 Jiajun Chai , Wenzhang Chen , Yuanheng Zhu , Zong-xin Yao , Dongbin Zhao

Recently, reinforcement learning (RL) has been extensively studied and achieved promising results in a wide range of control tasks. Meanwhile, autonomous underwater vehicle (AUV) is an important tool for executing complex and challenging…

Robotics · Computer Science 2019-11-28 Yachu Hsu , Hui Wu , Keyou You , Shiji Song

A reinforcement learning (RL) based methodology is proposed and implemented for online fine-tuning of PID controller gains, thus, improving quadrotor effective and accurate trajectory tracking. The RL agent is first trained offline on a…

Systems and Control · Electrical Eng. & Systems 2025-02-10 Serhat Sönmez , Luca Montecchio , Simone Martini , Matthew J. Rutherford , Alessandro Rizzo , Margareta Stefanovic , Kimon P. Valavanis

This article presents a digital twin (DT)-enhanced reinforcement learning (RL) framework aimed at optimizing performance and reliability in network resource management, since the traditional RL methods face several unified challenges when…

Systems and Control · Electrical Eng. & Systems 2024-06-18 Nan Cheng , Xiucheng Wang , Zan Li , Zhisheng Yin , Tom Luan , Xuemin Shen

The rapid development of unmanned aerial vehicles (UAV) puts forward a higher requirement for autonomous obstacle avoidance. Due to the limited payload and power supply, small UAVs such as quadrotors usually carry simple sensors and…

Systems and Control · Electrical Eng. & Systems 2020-03-03 Jiajun Ou , Xiao Guo , Ming Zhu , Wenjie Lou

In this paper, we present a novel developmental reinforcement learning-based controller for a quadcopter with thrust vectoring capabilities. This multirotor UAV design has tilt-enabled rotors. It utilizes the rotor force magnitude and…

Robotics · Computer Science 2020-07-16 Aditya M. Deshpande , Rumit Kumar , Ali A. Minai , Manish Kumar

Humans are remarkably data-efficient when adapting to new unseen conditions, like driving a new car. In contrast, modern robotic control systems, like neural network policies trained using Reinforcement Learning (RL), are highly specialized…

Robotics · Computer Science 2026-04-07 Jonas Eschmann , Dario Albani , Giuseppe Loianno