English
Related papers

Related papers: Advancing Multi-Robot Networks via MLLM-Driven Sen…

200 papers

Multi-robot systems hold significant promise for social environments such as homes and hospitals, yet existing multi-robot works treat robots as functionally identical, overlooking how robots individual identity shape user perception and…

Robotics · Computer Science 2026-04-15 Shaid Hasan , Breenice Lee , Sujan Sarker , Tariq Iqbal

Rapid advancements in artificial intelligence (AI) have enabled robots to performcomplex tasks autonomously with increasing precision. However, multi-robot systems (MRSs) face challenges in generalization, heterogeneity, and safety,…

Robotics · Computer Science 2025-05-05 Zhaoxing Li , Wenbo Wu , Yue Wang , Yanran Xu , William Hunt , Sebastian Stein

Multimodal large language models (MLLMs) have shown strong potential for autonomous driving, yet existing benchmarks remain largely ego-centric and therefore cannot systematically assess model performance in infrastructure-centric and…

Robotics · Computer Science 2026-04-06 Junwei You , Pei Li , Zhuoyu Jiang , Weizhe Tang , Zilin Huang , Rui Gan , Jiaxi Liu , Yan Zhao , Sikai Chen , Bin Ran

The Multi-Modal Large Language Model (MLLM) refers to an extension of the Large Language Model (LLM) equipped with the capability to receive and infer multi-modal data. Spatial awareness stands as one of the crucial abilities of MLLM,…

Artificial Intelligence · Computer Science 2023-11-02 Yongqiang Zhao , Zhenyu Li , Zhi Jin , Feng Zhang , Haiyan Zhao , Chengfeng Dou , Zhengwei Tao , Xinhai Xu , Donghong Liu

Recent advancements in large language models (LLMs) have shown significant promise in various domains, especially robotics. However, most prior LLM-based work in robotic applications either directly predicts waypoints or applies LLMs within…

Robotics · Computer Science 2025-10-01 Yue Meng , Fei Chen , Yongchao Chen , Chuchu Fan

To enable non-experts to specify long-horizon, multi-robot collaborative tasks, language models are increasingly used to translate natural language commands into formal specifications. However, because translation can occur in multiple…

Robotics · Computer Science 2024-12-06 Shaojun Xu , Xusheng Luo , Yutong Huang , Letian Leng , Ruixuan Liu , Changliu Liu

Vision-Language Models (VLMs) demonstrate remarkable potential in robotic manipulation, yet challenges persist in executing complex fine manipulation tasks with high speed and precision. While excelling at high-level planning, existing VLM…

Robotics · Computer Science 2025-03-10 Qingxuan Jia , Guoqin Tang , Zeyuan Huang , Zixuan Hao , Ning Ji , Shihang , Yin , Gang Chen

Robot swarms promise scalable assistance in complex and hazardous environments. Task planning lies at the core of human-swarm collaboration, translating the operator's intent into coordinated swarm actions and helping determine when…

Robotics · Computer Science 2026-05-11 Junfeng Chen , Yuxiao Zhu , An Zhuo , Xintong Zhang , Shuo Zhang , Guanghui Wen , Xiwang Dong , Meng Guo , Zhongkui Li

Unlocking spatial reasoning in Multimodal Large Language Models (MLLMs) is crucial for enabling intelligent interaction with 3D environments. While prior efforts often rely on explicit 3D inputs or specialized model architectures, we ask:…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Fangrui Zhu , Hanhui Wang , Yiming Xie , Jing Gu , Tianye Ding , Jianwei Yang , Huaizu Jiang

This search introduces the Multimodal Socialized Learning Framework (M-S2L), designed to foster emergent social intelligence in AI agents by integrating Multimodal Large Language Models (M-LLMs) with social learning mechanisms. The…

Multiagent Systems · Computer Science 2025-11-12 Sureyya Akin , Shruti T. Tiwari , Ram Bhattacharya , Sagar A. Raman , Kiran Mohanty , Sita Krishnan

Large Language Models (LLMs) have advanced rapidly in recent years, demonstrating strong capabilities in problem comprehension and reasoning. Inspired by these developments, researchers have begun exploring the use of LLMs as decentralized…

Robotics · Computer Science 2025-05-13 Peihan Li , Lifeng Zhou

Deep learning architectures with powerful reasoning capabilities have driven significant advancements in autonomous driving technology. Large language models (LLMs) applied in this field can describe driving scenes and behaviors with a…

Artificial Intelligence · Computer Science 2024-10-01 Yizhou Huang , Yihua Cheng , Kezhi Wang

Multilingual large language models (LLMs) possess impressive multilingual understanding and generation capabilities. However, their performance and cross-lingual alignment often lag for non-dominant languages. A common solution is to…

Computation and Language · Computer Science 2025-09-30 Mengyu Bu , Shaolei Zhang , Zhongjun He , Hua Wu , Yang Feng

The increasing proliferation of IoT devices and AI applications has created a demand for scalable and efficient computing solutions, particularly for applications requiring real-time processing. The compute continuum integrates edge and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-14 Negin Akbari , John Grundy , Aamir Cheema , Adel N. Toosi

In Multi-Agent Systems (MAS), agents are designed with social capabilities, allowing them to understand and reason about social concepts such as norms when interacting with others (e.g., inter-robot interactions). In Normative MAS (NorMAS),…

Multiagent Systems · Computer Science 2026-03-05 Oishik Chowdhury , Anushka Debnath , Bastin Tony Roy Savarimuthu

Heterogeneous multirobot systems show great potential in complex tasks requiring coordinated hybrid cooperation. However, existing methods that rely on static or task-specific models often lack generalizability across diverse tasks and…

Robotics · Computer Science 2025-10-28 Haokun Liu , Zhaoqi Ma , Yunong Li , Junichiro Sugihara , Yicheng Chen , Jinjie Li , Moju Zhao

With the rapid advancement of artificial intelligence and robotics, the integration of Large Language Models (LLMs) with 3D vision is emerging as a transformative approach to enhancing robotic sensing technologies. This convergence enables…

Robotics · Computer Science 2025-11-19 Vinit Mehta , Charu Sharma , Karthick Thiyagarajan

AI agents powered by large language models (LLMs) have shown strong capabilities in problem solving. Through combining many intelligent agents, multi-agent collaboration has emerged as a promising approach to tackle complex, multi-faceted…

Computation and Language · Computer Science 2024-12-10 Raphael Shu , Nilaksh Das , Michelle Yuan , Monica Sunkara , Yi Zhang

People increasingly use multiple Multimodal Large Language Models (MLLMs) concurrently, selecting each based on its perceived strengths. This cross-platform practice creates coordination challenges: adapting prompts to different interfaces,…

Human-Computer Interaction · Computer Science 2026-03-30 Seunghwa Pyo , Donggun Lee , Jungwoo Rhee , Soobin Park , Youn-kyung Lim

For human cognitive process, spatial reasoning and perception are closely entangled, yet the nature of this interplay remains underexplored in the evaluation of multimodal large language models (MLLMs). While recent MLLM advancements show…

Computation and Language · Computer Science 2025-08-28 Chengzu Li , Wenshan Wu , Huanyu Zhang , Qingtao Li , Zeyu Gao , Yan Xia , José Hernández-Orallo , Ivan Vulić , Furu Wei