English
Related papers

Related papers: Building Cooperative Embodied Agents Modularly wit…

200 papers

With recent advances in Large Language Models (LLMs), Agentic AI has become phenomenal in real-world applications, moving toward multiple LLM-based agents to perceive, learn, reason, and act collaboratively. These LLM-based Multi-Agent…

Artificial Intelligence · Computer Science 2025-01-14 Khanh-Tung Tran , Dung Dao , Minh-Duong Nguyen , Quoc-Viet Pham , Barry O'Sullivan , Hoang D. Nguyen

Leveraging massive knowledge from large language models (LLMs), recent machine learning models show notable successes in general-purpose task solving in diverse domains such as computer vision and robotics. However, several significant…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Jiangyong Huang , Silong Yong , Xiaojian Ma , Xiongkun Linghu , Puhao Li , Yan Wang , Qing Li , Song-Chun Zhu , Baoxiong Jia , Siyuan Huang

In this paper, we present a novel framework for enhancing the capabilities of large language models (LLMs) by leveraging the power of multi-agent systems. Our framework introduces a collaborative environment where multiple intelligent agent…

Artificial Intelligence · Computer Science 2023-06-07 Yashar Talebirad , Amirhossein Nadiri

Large language models (LLMs) have demonstrated impressive performance in understanding language and executing complex reasoning tasks. However, LLMs with long context windows have been notorious for their expensive training costs and high…

Computation and Language · Computer Science 2024-03-14 Jun Zhao , Can Zu , Hao Xu , Yi Lu , Wei He , Yiwen Ding , Tao Gui , Qi Zhang , Xuanjing Huang

The increase in available computing power and the Deep Learning revolution have allowed the exploration of new topics and frontiers in Artificial Intelligence research. A new field called Embodied Artificial Intelligence, which places at…

Robotics · Computer Science 2025-05-05 Roberto Bigazzi

Embodiment in conversational agents (CAs) refers to the physical or visual representation of these agents, which can significantly influence user perception and interaction. Limited work has been done examining the effect of embodiment on…

Human-Computer Interaction · Computer Science 2025-06-04 Kyra Wang , Boon-Kiat Quek , Jessica Goh , Dorien Herremans

We examine the capability of Multimodal Large Language Models (MLLMs) to tackle diverse domains that extend beyond the traditional language and vision tasks these models are typically trained on. Specifically, our focus lies in areas such…

Machine Learning · Computer Science 2024-12-12 Andrew Szot , Bogdan Mazoure , Omar Attia , Aleksei Timofeev , Harsh Agrawal , Devon Hjelm , Zhe Gan , Zsolt Kira , Alexander Toshev

As autonomous agents become more prevalent, understanding their collective behaviour in strategic interactions is crucial. This study investigates the emergent cooperative tendencies of systems of Large Language Model (LLM) agents in a…

Multiagent Systems · Computer Science 2025-01-28 Richard Willis , Yali Du , Joel Z Leibo , Michael Luck

This paper introduces the concept of coexistence for embodied artificial agents and argues that it is a prerequisite for long-term, in-the-wild interaction with humans. Contemporary embodied artificial agents excel in static, predefined…

Machine Learning · Computer Science 2025-06-03 Hannah Kuehn , Joseph La Delfa , Miguel Vasco , Danica Kragic , Iolanda Leite

Large Language Models (LLMs) are increasingly being used as autonomous agents capable of performing complicated tasks. However, they lack the ability to perform reliable long-horizon planning on their own. This paper bridges this gap by…

Artificial Intelligence · Computer Science 2025-09-17 Yarin Benyamin , Argaman Mordoch , Shahaf S. Shperberg , Roni Stern

Human cognitive development is shaped not only by individual effort but by structured social interaction, where role-based exchanges such as those between a tutor and a learner, enable solutions that neither could achieve alone. Inspired by…

Artificial Intelligence · Computer Science 2026-04-13 Nurullah Eymen Özdemir , Erhan Oztop

Atomic commits, which address a single development concern, are a best practice in software development. In practice, however, developers often produce tangled commits that mix unrelated changes, complicating code review and maintenance.…

Artificial Intelligence · Computer Science 2025-11-06 Bo Hou , Xin Tan , Kai Zheng , Fang Liu , Yinghao Zhu , Li Zhang

Large language model (LLM) agents increasingly coordinate in multi-agent systems, yet we lack an understanding of where and why cooperation failures may arise. In many real-world coordination problems, from knowledge sharing in…

Multiagent Systems · Computer Science 2026-04-10 Advait Yadav , Sid Black , Oliver Sourbut

Large Language Model (LLM) agents trained with reinforcement learning (RL) show great promise for solving complex, multi-step tasks. However, their performance is often crippled by "Context Explosion", where the accumulation of long text…

Computation and Language · Computer Science 2025-12-16 Xuanzhang Liu , Jianglun Feng , Zhuoran Zhuang , Junzhe Zhao , Maofei Que , Jieting Li , Dianlei Wang , Hao Tong , Ye Chen , Pan Li

Collaborative perception empowers autonomous agents to share complementary information and overcome perception limitations. While early fusion offers more perceptual complementarity and is inherently robust to model heterogeneity, its high…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yushan Han , Hui Zhang , Qiming Xia , Yi Jin , Yidong Li

Large language models excel at a wide range of complex tasks. However, enabling general inference in the real world, e.g., for robotics problems, raises the challenge of grounding. We propose embodied language models to directly incorporate…

Effective collaboration in multi-agent systems requires communicating goals and intentions between agents. Current agent frameworks often suffer from dependencies on single-agent execution and lack robust inter-module communication,…

Computation and Language · Computer Science 2024-07-18 Xihe Qiu , Haoyu Wang , Xiaoyu Tan , Chao Qu , Yujie Xiong , Yuan Cheng , Yinghui Xu , Wei Chu , Yuan Qi

Language and embodied perspective taking are essential for human collaboration, yet few computational models address both simultaneously. This work investigates the PerspAct system [1], which integrates the ReAct (Reason and Act) paradigm…

Computation and Language · Computer Science 2025-09-16 Sabrina Patania , Luca Annese , Anna Lambiase , Anita Pellegrini , Tom Foulsham , Azzurra Ruggeri , Silvia Rossi , Silvia Serino , Dimitri Ognibene

Agents powered by large language models (LLMs) have demonstrated strong planning and decision-making capabilities in complex embodied environments. However, such agents often suffer from inefficiencies in multi-turn interactions, frequently…

Computation and Language · Computer Science 2025-09-23 Qingyu Lu , Liang Ding , Siyi Cao , Xuebo Liu , Kanjian Zhang , Jinxia Zhang , Dacheng Tao

Recent works have shown how the reasoning capabilities of Large Language Models (LLMs) can be applied to domains beyond natural language processing, such as planning and interaction for robots. These embodied problems require an agent to…