English
Related papers

Related papers: FlockGPT: Guiding UAV Flocking with Linguistic Orc…

200 papers

We propose a novel human-swarm interaction system, allowing the user to directly control a swarm of drones in a complex environment through trajectory drawing with a hand gesture interface based on the DNN-based gesture recognition. The…

With the rapid development of drone technology, the application of multi-drones is becoming increasingly widespread in various fields. However, the task planning technology for multi-drones still faces challenges such as the complexity of…

Robotics · Computer Science 2024-06-04 Yaohua Liu

The distributed flocking control of collective aerial vehicles has extraordinary advantages in scalability and reliability, \emph{etc.} However, it is still challenging to design a reliable, efficient, and responsive flocking algorithm. In…

Multiagent Systems · Computer Science 2023-06-07 Guobin Zhu , Shanwei Fan , Qingrui Zhang

Attaining a high degree of user controllability in visual generation often requires intricate, fine-grained inputs like layouts. However, such inputs impose a substantial burden on users when compared to simple text inputs. To address the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Weixi Feng , Wanrong Zhu , Tsu-jui Fu , Varun Jampani , Arjun Akula , Xuehai He , Sugato Basu , Xin Eric Wang , William Yang Wang

AI tasks encompass a wide range of domains and fields. While numerous AI models have been designed for specific tasks and applications, they often require considerable human efforts in finding the right model architecture, optimization…

Computation and Language · Computer Science 2023-05-05 Shujian Zhang , Chengyue Gong , Lemeng Wu , Xingchao Liu , Mingyuan Zhou

The use of natural language interfaces (NLIs) to create charts is becoming increasingly popular due to the intuitiveness of natural language interactions. One key challenge in this approach is to accurately capture user intents and…

Human-Computer Interaction · Computer Science 2025-01-22 Yuan Tian , Weiwei Cui , Dazhen Deng , Xinjing Yi , Yurun Yang , Haidong Zhang , Yingcai Wu

The autonomous formation flight of fixed-wing drones is hard when the coordination requires the actuation over their speeds since they are critically bounded and aircraft are mostly designed to fly at a nominal airspeed. This paper proposes…

Robotics · Computer Science 2025-07-23 Yang Xu , Jesús Bautista , José Hinojosa , Héctor García de Marina

The rapid advancement of Large Language Models (LLMs) has revolutionized various sectors by automating routine tasks, marking a step toward the realization of Artificial General Intelligence (AGI). However, they still struggle to…

Machine Learning · Computer Science 2024-02-21 Zihao Tang , Zheqi Lv , Shengyu Zhang , Fei Wu , Kun Kuang

Swarms of Unmanned Aerial Vehicles (UAV) have demonstrated enormous potential in many industrial and commercial applications. However, before deploying UAVs in the real world, it is essential to ensure they can operate safely in complex…

Robotics · Computer Science 2024-12-11 Longhao Yan , Jingyuan Zhou , Kaidi Yang

Maintaining the formation of complex structures with multiple UAVs and achieving complex trajectories remains a major challenge. This work presents an algorithm for implementing the flocking behavior of UAVs based on the concept of Virtual…

Swarm robotics plays a crucial role in enabling autonomous operations in dynamic and unpredictable environments. However, a major challenge remains ensuring safe and efficient navigation in environments filled with both dynamic alive (e.g.,…

We study language-in-the-loop control for multi-drone systems that execute evolving, high-level missions while retaining formal robustness guarantees at the physical layer. We propose a three-layer architecture in which (i) a human operator…

Robotics · Computer Science 2026-02-17 Ziyi Zhang , Xiyu Deng , Guannan Qu , Yorie Nakahira

Large Language Models (LLMs) have advanced rapidly in recent years, demonstrating strong capabilities in problem comprehension and reasoning. Inspired by these developments, researchers have begun exploring the use of LLMs as decentralized…

Robotics · Computer Science 2025-05-13 Peihan Li , Lifeng Zhou

Recent work in training large language models (LLMs) to follow natural language instructions has opened up exciting opportunities for natural language interface design. Building on the prior success of LLMs in the realm of computer-assisted…

Computation and Language · Computer Science 2022-10-26 Tuhin Chakrabarty , Vishakh Padmakumar , He He

The vision-based relative localization can provide effective feedback for the cooperation of aerial swarm and has been widely investigated in previous works. However, the limited field of view (FOV) inherently restricts its performance. To…

Robotics · Computer Science 2021-11-16 Peihan Zhang , Gang Chen , Yuzhu Li , Wei Dong

In this letter, we present a distributed algorithm for flocking in complex environments that operates at constant altitude, without explicit communication, no a priori information about the environment, and by using only on-board sensing…

Robotics · Computer Science 2026-03-02 Manuel Boldrer , Vit Kratky , Viktor Walter , Martin Saska

Unmanned Aerial Vehicle (UAV) swarms offer versatile applications in logistics, agriculture, and surveillance, yet controlling them requires expert knowledge for safety and feasibility. Traditional static methods limit adaptability, while…

Robotics · Computer Science 2026-02-03 Aditya Shibu , Marah Saleh , Mohamed Al-Musleh , Nidhal Abdulaziz

The integration of human-intuitive interactions into autonomous systems has been limited. Traditional Natural Language Processing (NLP) systems struggle with context and intent understanding, severely restricting human-robot interaction.…

Robotics · Computer Science 2025-04-29 Amogh Joshi , Sourav Sanyal , Kaushik Roy

Large language models (LLMs) are establishing new paradigms for engineering applications by enabling natural language control of complex computational workflows. This paper introduces FeaGPT, the first framework to achieve complete…

Software Engineering · Computer Science 2025-10-28 Yupeng Qi , Ran Xu , Xu Chu

This paper proposes a novel swarm-based control algorithm for exploration and coverage of unknown environments, while maintaining a formation that permits short-range communication. The algorithm combines two elements: swarm rules for…

Robotics · Computer Science 2022-01-26 Vu Phi Tran , Matthew A. Garratt , Kathryn Kasmarik , Sreenatha G. Anavatti