English
Related papers

Related papers: LLM-Driven Self-Refinement for Embodied Drone Task…

200 papers

This paper proposes Drone Squadron Optimization, a new self-adaptive metaheuristic for global numerical optimization which is updated online by a hyper-heuristic. DSO is an artifact-inspired technique, as opposed to many algorithms used…

Optimization and Control · Mathematics 2017-03-16 Vinícius Veloso de Melo , Wolfgang Banzhaf

Improving the reasoning capabilities of embodied agents is crucial for robots to complete complex human instructions in long-view manipulation tasks successfully. Despite the success of large language models and vision language models based…

Artificial Intelligence · Computer Science 2025-10-23 Jinrui Liu , Bingyan Nie , Boyu Li , Yaran Chen , Yuze Wang , Shunsen He , Haoran Li

Replicating human-level intelligence in the execution of embodied tasks remains challenging due to the unconstrained nature of real-world environments. Novel use of large language models (LLMs) for task planning seeks to address the…

Deploying robot learning methods to aerial robots in unstructured environments remains both challenging and promising. While recent advances in deep reinforcement learning (DRL) have enabled end-to-end flight control, the field still lacks…

Robotics · Computer Science 2025-12-10 Kangyao Huang , Hao Wang , Jingyu Chen , Jintao Chen , Yu Luo , Di Guo , Xiangkui Zhang , Xiangyang Ji , Huaping Liu

Drones equipped with overhead manipulators offer unique capabilities for inspection, maintenance, and contact-based interaction. However, the motion of the drone and its manipulator is tightly linked, and even small attitude changes caused…

Robotics · Computer Science 2026-03-30 Hazim Alzorgan , Sayed Pedram Haeri Boroujeni , Abolfazl Razi

Large language models (LLMs) have achieved remarkable progress in reasoning tasks, yet the optimal integration of Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL) remains a fundamental challenge. Through comprehensive analysis…

Computation and Language · Computer Science 2025-06-25 Yuqian Fu , Tinghong Chen , Jiajun Chai , Xihuai Wang , Songjun Tu , Guojun Yin , Wei Lin , Qichao Zhang , Yuanheng Zhu , Dongbin Zhao

Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks, yet they face significant challenges in embodied task planning scenarios that require continuous environmental understanding and action generation.…

Computation and Language · Computer Science 2025-07-01 Zhaoye Fei , Li Ji , Siyin Wang , Junhao Shi , Jingjing Gong , Xipeng Qiu

Deep reinforcement learning (DRL) shows promising potential for autonomous driving decision-making. However, DRL demands extensive computational resources to achieve a qualified policy in complex driving scenarios due to its low learning…

Robotics · Computer Science 2024-12-25 Hao Pang , Zhenpo Wang , Guoqiang Li

With the rapid development of drone technology, the application of multi-drones is becoming increasingly widespread in various fields. However, the task planning technology for multi-drones still faces challenges such as the complexity of…

Robotics · Computer Science 2024-06-04 Yaohua Liu

Reinforcement learning (RL) has been recognized as a powerful tool for robot control tasks. RL typically employs reward functions to define task objectives and guide agent learning. However, since the reward function serves the dual purpose…

Machine Learning · Computer Science 2025-12-10 Zhao Yu , Xiuping Wu , Liangjun Ke

With the rapid advancement of large language models (LLMs) technologies, their application in the domain of autonomous driving has become increasingly widespread. However, existing methods suffer from unstructured reasoning, poor…

Artificial Intelligence · Computer Science 2026-01-09 Chang Zhao , Zheming Yang , Yunqing Hu , Qi Guo , Zijian Wang , Pengcheng Li , Wen Ji

We explore the effectiveness of an LLM-guided query refinement paradigm for extending the usability of embedding models to challenging zero-shot search and classification tasks. Our approach refines the embedding representation of a user…

Computation and Language · Computer Science 2026-05-13 Ariel Gera , Shir Ashury-Tahan , Gal Bloch , Ohad Eytan , Assaf Toledo

Vision-language models (VLMs) have achieved remarkable success in scene understanding and perception tasks, enabling robots to plan and execute actions adaptively in dynamic environments. However, most multimodal large language models lack…

Robotics · Computer Science 2025-02-14 Guoqin Tang , Qingxuan Jia , Zeyuan Huang , Gang Chen , Ning Ji , Zhipeng Yao

The integration of Large Language Models (LLMs) into robotic control, including drones, has the potential to revolutionize autonomous systems. Research studies have demonstrated that LLMs can be leveraged to support robotic operations.…

Robotics · Computer Science 2025-04-09 Wenhao Wang , Yanyan Li , Long Jiao , Jiawei Yuan

Remote state estimation of large-scale distributed dynamic processes plays an important role in Industry 4.0 applications. In this paper, by leveraging the theoretical results of structural properties of optimal scheduling policies, we…

Information Theory · Computer Science 2024-10-28 Jiazheng Chen , Wanchun Liu , Daniel E. Quevedo , Yonghui Li , Branka Vucetic

In the endeavor to make autonomous robots take actions, task planning is a major challenge that requires translating high-level task descriptions to long-horizon action sequences. Despite recent advances in language model agents, they…

Robotics · Computer Science 2025-06-19 Jinghan Li , Zhicheng Sun , Yadong Mu

In this study, we present a novel paradigm for industrial robotic embodied agents, encapsulating an 'agent as cerebrum, controller as cerebellum' architecture. Our approach harnesses the power of Large Multimodal Models (LMMs) within an…

Robotics · Computer Science 2023-11-28 Haoran Zhao , Fengxing Pan , Huqiuyue Ping , Yaoming Zhou

Deep reinforcement learning (DRL) has achieved groundbreaking successes in a wide variety of robotic applications. A natural consequence is the adoption of this paradigm for safety-critical tasks, where human safety and expensive hardware…

Robotics · Computer Science 2022-06-22 Davide Corsi , Raz Yerushalmi , Guy Amir , Alessandro Farinelli , David Harel , Guy Katz

In this paper, a deep reinforcement learning (DRL) method is proposed to address the problem of UAV navigation in an unknown environment. However, DRL algorithms are limited by the data efficiency problem as they typically require a huge…

Robotics · Computer Science 2020-08-07 Lei He , Nabil Aouf , James F. Whidborne , Bifeng Song

Embodied task planning demands vision-language models to generate action sequences that are both visually grounded and causally coherent over time. However, existing training paradigms face a critical trade-off: joint end-to-end training…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Yuyuan Yang , Junkun Hong , Hongrong Wang , Honghao Cai , Xunpeng Ren , Ge Wang , Mingcong Lei , Shenhao Yan , Jiahao Yang , Chengsi Yao , Xi Li , Yiming Zhao , Yatong Han , Jinke Ren