English
Related papers

Related papers: Scalable Multi-Robot Collaboration with Large Lang…

200 papers

Despite their powerful semantic understanding and code generation capabilities, Large Language Models (LLMs) still face challenges when dealing with complex tasks. Multi agent strategy generation and motion control are highly complex…

Robotics · Computer Science 2024-02-19 Zhirong Luan , Yujun Lai , Rundong Huang , Yan Yan , Jingwei Wang , Jizhou Lu , Badong Chen

This paper presents a novel design of a multi-agent system framework that applies large language models (LLMs) to automate the parametrization of simulation models in digital twins. This framework features specialized LLM agents tasked with…

Artificial Intelligence · Computer Science 2024-07-23 Yuchen Xia , Daniel Dittler , Nasser Jazdi , Haonan Chen , Michael Weyrich

We investigate the use of Large Language Models (LLMs) to equip neural robotic agents with human-like social and cognitive competencies, for the purpose of open-ended human-robot conversation and collaboration. We introduce a modular and…

Robotics · Computer Science 2024-09-30 Philipp Allgeuer , Hassan Ali , Stefan Wermter

Adaptive collaboration is critical to a team of autonomous robots to perform complicated navigation tasks in large-scale unknown environments. An effective collaboration strategy should be determined and adapted according to each robot's…

Robotics · Computer Science 2025-05-21 Abhinav Rajvanshi , Pritish Sahu , Tixiao Shan , Karan Sikka , Han-Pang Chiu

Online coordination of multi-robot systems in open and unknown environments faces significant challenges, particularly when semantic features detected during operation dynamically trigger new tasks. Recent large language model (LLMs)-based…

Robotics · Computer Science 2025-08-21 Yuxiao Zhu , Junfeng Chen , Xintong Zhang , Meng Guo , Zhongkui Li

Flocking is a behavior where multiple agents in a system attempt to stay close to each other while avoiding collision and maintaining a desired formation. This is observed in the natural world and has applications in robotics, including…

Artificial Intelligence · Computer Science 2024-12-18 Peihan Li , Vishnu Menon , Bhavanaraj Gudiguntla , Daniel Ting , Lifeng Zhou

In recent developments within the research community, the integration of Large Language Models (LLMs) in creating fully autonomous agents has garnered significant interest. Despite this, LLM-based agents frequently demonstrate notable…

Computation and Language · Computer Science 2024-02-21 Xueyang Feng , Zhi-Yuan Chen , Yujia Qin , Yankai Lin , Xu Chen , Zhiyuan Liu , Ji-Rong Wen

Routing problems are common in mobile robotics, encompassing tasks such as inspection, surveillance, and coverage. Depending on the objective and constraints, these problems often reduce to variants of the Traveling Salesman Problem (TSP),…

Computation and Language · Computer Science 2024-08-08 Zhehui Huang , Guangyao Shi , Gaurav S. Sukhatme

Large Language Models (LLMs) have emerged as integral tools for reasoning, planning, and decision-making, drawing upon their extensive world knowledge and proficiency in language-related tasks. LLMs thus hold tremendous potential for…

Artificial Intelligence · Computer Science 2024-05-24 Xudong Guo , Kaixuan Huang , Jiale Liu , Wenhui Fan , Natalia Vélez , Qingyun Wu , Huazheng Wang , Thomas L. Griffiths , Mengdi Wang

Large language models (LLMs) are transforming society, powering applications from smartphone assistants to autonomous driving. Yet cloud-based LLM services alone cannot serve a growing class of applications, including those operating under…

Signal Processing · Electrical Eng. & Systems 2026-05-12 Liangqi Yuan , Wenzhi Fang , Shiqiang Wang , H. Vincent Poor , Christopher G. Brinton

Coordinating heterogeneous robot teams from free-form natural-language instructions is hard. Language-only planners struggle with long-horizon coordination and hallucination, while purely formal methods require closed-world models. We…

With recent advances in Large Language Models (LLMs), Agentic AI has become phenomenal in real-world applications, moving toward multiple LLM-based agents to perceive, learn, reason, and act collaboratively. These LLM-based Multi-Agent…

Artificial Intelligence · Computer Science 2025-01-14 Khanh-Tung Tran , Dung Dao , Minh-Duong Nguyen , Quoc-Viet Pham , Barry O'Sullivan , Hoang D. Nguyen

This paper introduces a new hybrid framework that combines Reinforcement Learning (RL) and Large Language Models (LLMs) to improve robotic manipulation tasks. By utilizing RL for accurate low-level control and LLMs for high level task…

Robotics · Computer Science 2026-04-01 Md Saad , Sajjad Hussain , Mohd Suhaib

Large language models (LLMs) have demonstrated strong performance in sentence-level machine translation, but scaling to document-level translation remains challenging, particularly in modeling long-range dependencies and discourse phenomena…

Computation and Language · Computer Science 2025-08-29 Miguel Moura Ramos , Patrick Fernandes , Sweta Agrawal , André F. T. Martins

Coordinating heterogeneous robot fleets to achieve multiple goals is challenging in multi-robot systems. We introduce an open-source and extensible framework for centralized multi-robot task planning and scheduling that leverages LLMs to…

Robotics · Computer Science 2025-10-14 Rohan Gupta , Trevor Asbery , Zain Merchant , Abrar Anwar , Jesse Thomason

Autonomous control systems face significant challenges in performing complex tasks in the presence of latent risks. To address this, we propose an integrated framework that combines Large Language Models (LLMs), numerical optimization, and…

Systems and Control · Electrical Eng. & Systems 2025-05-08 Xiyu Deng , Quan Khanh Luu , Anh Van Ho , Yorie Nakahira

Tool learning empowers large language models (LLMs) as agents to use external tools and extend their utility. Existing methods employ one single LLM-based agent to iteratively select and execute tools, thereafter incorporating execution…

Computation and Language · Computer Science 2024-06-25 Zhengliang Shi , Shen Gao , Xiuyi Chen , Yue Feng , Lingyong Yan , Haibo Shi , Dawei Yin , Pengjie Ren , Suzan Verberne , Zhaochun Ren

Effective human-robot collaboration requires robot to adopt their roles and levels of support based on human needs, task requirements, and complexity. Traditional human-robot teaming often relies on a pre-determined robot communication…

Human-Computer Interaction · Computer Science 2025-02-12 Shipeng Liu , FNU Shrutika , Boshen Zhang , Zhehui Huang , Gaurav Sukhatme , Feifei Qian

Large Language Models (LLMs) and Vision Language Models (VLMs) have become popular tools for embodied high-level planning. However, their deployment in black-box settings often leads to unpredictable or costly errors. To harness their…

Robotics · Computer Science 2026-04-28 Hao Wang , Sathwik Karnik , Bea Lim , Somil Bansal

Developing intelligent agents for long-term cooperation in dynamic open-world scenarios is a major challenge in multi-agent systems. Traditional Multi-agent Reinforcement Learning (MARL) frameworks like centralized training decentralized…

Artificial Intelligence · Computer Science 2025-02-11 Hanqing Yang , Jingdi Chen , Marie Siew , Tania Lorido-Botran , Carlee Joe-Wong