English
Related papers

Related papers: UAVGENT: A Language-Guided Distributed Control Fra…

200 papers

Recently, there has been increasing interest in transparency and interpretability in Deep Reinforcement Learning (DRL) systems. Verbal explanations, as the most natural way of communication in our daily life, deserve more attention, since…

Artificial Intelligence · Computer Science 2020-12-25 Xinzhi Wang , Huao Li , Hui Zhang , Michael Lewis , Katia Sycara

A core challenge in AI-guided autonomy is enabling agents to navigate realistically and effectively in previously unseen environments based on natural language commands. We propose UAV-VLN, a novel end-to-end Vision-Language Navigation…

Robotics · Computer Science 2025-10-01 Pranav Saxena , Nishant Raghuvanshi , Neena Goveas

Currently, unmanned aerial vehicles, such as drones, are becoming a part of our lives and reaching out to many areas of society, including the industrialized world. A common alternative to control the movements and actions of the drone is…

Robotics · Computer Science 2020-09-22 Ruben Contreras , Angel Ayala , Francisco Cruz

This study introduces intelligent frameworks that use Large Language Models (LLMs) to improve task scheduling for construction robots. The LLM is fed with key data about the desired task, such as agent action abilities, and the desired end…

Robotics · Computer Science 2026-05-18 Swayamjit Saha , Subhabrata Das , Haonan Duan , Xiao-Yang Liu

Unmanned Aerial Vehicles (UAVs) are evolving into language-interactive platforms, enabling more intuitive forms of human-drone interaction. While prior works have primarily focused on high-level planning and long-horizon navigation, we…

Robotics · Computer Science 2025-05-27 Xiangyu Wang , Donglin Yang , Yue Liao , Wenhao Zheng , wenjun wu , Bin Dai , Hongsheng Li , Si Liu

Coordination in multi-agent systems is challenging for agile robots such as unmanned aerial vehicles (UAVs), where relative agent positions frequently change due to unconstrained movement. The problem is exacerbated through the individual…

Robotics · Computer Science 2021-07-22 Mirco Theile , Jonathan Ponniah , Or Dantsker , Marco Caccamo

With the rapid development of drone technology, the application of multi-drones is becoming increasingly widespread in various fields. However, the task planning technology for multi-drones still faces challenges such as the complexity of…

Robotics · Computer Science 2024-06-04 Yaohua Liu

While autonomous multi-robots can achieve safe and coordinated navigation, they often struggle to adapt to unforeseen conditions and to capture operator-driven objectives in unstructured environments. We present a Virtual Reality (VR)-based…

Coordinating heterogeneous robot teams from free-form natural-language instructions is hard. Language-only planners struggle with long-horizon coordination and hallucination, while purely formal methods require closed-world models. We…

Large Language Models (LLMs) are increasingly used as high level controllers for autonomous Unmanned Aerial Vehicle (UAV) missions. However, existing evaluations rarely assess whether such agents remain safe, protocol compliant, and…

Systems and Control · Electrical Eng. & Systems 2026-01-08 Mohamed Amine Ferrag , Abderrahmane Lakas , Merouane Debbah

Real-time multi-robot coordination in hazardous and adversarial environments requires fast, reliable adaptation to dynamic threats. While Large Language Models (LLMs) offer strong high-level reasoning capabilities, the lack of safety…

Robotics · Computer Science 2025-11-19 Yuwei Wu , Yuezhan Tao , Peihan Li , Guangyao Shi , Gaurav S. Sukhatme , Vijay Kumar , Lifeng Zhou

Uncrewed aerial vehicles (UAVs) are increasingly deployed in complex networked environments, yet the joint optimization of multi-UAV motion control and connectivity remains a fundamental challenge. In this paper, we study a multi-UAV system…

Artificial Intelligence · Computer Science 2026-05-13 Zijiang Yan , Hao Zhou , Wael Jaafar , Jianhua Pei , Ping Wang , Halim Yanikomeroglu , Hina Tabassum

This paper introduces a high-performance artificial intelligence operating system tailored for low-altitude aviation, designed to address key challenges such as real-time task execution, computational efficiency, and seamless modular…

Machine Learning · Computer Science 2025-01-07 Minzhe Tan , Xinlin Fan , Jian He , Yi Hou , Zhan Liu , Yaopeng Jiang , Y. M. Jiang

Layered control architectures have been a standard paradigm for efficiently managing complex constrained systems. A typical architecture consists of: i) a higher layer, where a low-frequency planner controls a simple model of the system,…

Systems and Control · Electrical Eng. & Systems 2025-04-15 Charis Stamouli , Anastasios Tsiamis , Manfred Morari , George J. Pappas

Existing LLM-enabled multi-agent frameworks are predominantly limited to digital or simulated environments and confined to narrowly focused knowledge domain, constraining their applicability to complex engineering tasks that require the…

System prompts provide a lightweight yet powerful mechanism for conditioning large language models (LLMs) at inference time. While prior work has focused on English-only settings, real-world deployments benefit from having a single prompt…

Computation and Language · Computer Science 2025-12-03 Lechen Zhang , Yusheng Zhou , Tolga Ergen , Lajanugen Logeswaran , Moontae Lee , David Jurgens

With the rapid advance of sophisticated control algorithms, the capabilities of drones to stabilise, fly and manoeuvre autonomously have dramatically improved, enabling us to pay greater attention to entire missions and the interaction of a…

Recent works have shown how the reasoning capabilities of Large Language Models (LLMs) can be applied to domains beyond natural language processing, such as planning and interaction for robots. These embodied problems require an agent to…

This paper presents a novel approach employing prescribed performance control to address the distributed fault-tolerant formation control problem in a heterogeneous UAV-UGV cooperative system under a directed interaction topology and…

Systems and Control · Electrical Eng. & Systems 2025-04-11 Yongkang Zhang , Bin Jiang , Yajie Ma

With the rapid advancement of Large Language Models (LLMs), their capabilities in various automation domains, particularly Unmanned Aerial Vehicle (UAV) operations, have garnered increasing attention. Current research remains predominantly…