English
Related papers

Related papers: CoEnv: Driving Embodied Multi-Agent Collaboration …

200 papers

Embodied Artificial Intelligence (Embodied AI) integrates perception, cognition, planning, and interaction into agents that operate in open-world, safety-critical environments. As these systems gain autonomy and enter domains such as…

Artificial Intelligence (AI) agents capable of autonomous learning and independent decision-making hold great promise for addressing complex challenges across various critical infrastructure domains, including transportation, energy…

Multiagent Systems · Computer Science 2025-07-02 Hepeng Li , Yuhong Liu , Jun Yan , Jie Gao , Xiaoou Yang

As AI agents increasingly operate in open, real-world environments, they require a deep synergy of multimodal perception, tool invocation with multi-hop reasoning, and dynamic interaction with users. However, existing benchmarks fail to…

Artificial Intelligence · Computer Science 2026-05-28 Yunqi Liu , Tong Niu , Zitong Wang , Zhenlong Dai , Yuqi Qing , Weiqiang Wang , Jian Liu

This paper introduces EmbodiedAgent, a hierarchical framework for heterogeneous multi-robot control. EmbodiedAgent addresses critical limitations of hallucination in impractical tasks. Our approach integrates a next-action prediction…

Robotics · Computer Science 2025-08-18 Hanwen Wan , Yifei Chen , Yixuan Deng , Zeyu Wei , Dongrui Li , Zexin Lin , Donghao Wu , Jiu Cheng , Xiaoqiang Ji

In orchestrated multi-agent systems, humans often struggle to manage plans due to their complexity and limited transparency. Existing approaches rely on outcome-level supervision, where users verify only final outputs without visibility…

Multiagent Systems · Computer Science 2026-05-25 Zeyu He , Hannah Kim , Dan Zhang , Estevam Hruschka

We study the task of embodied visual active learning, where an agent is set to explore a 3d environment with the goal to acquire visual scene understanding by actively selecting views for which to request annotation. While accurate on some…

Computer Vision and Pattern Recognition · Computer Science 2020-12-18 David Nilsson , Aleksis Pirinen , Erik Gärtner , Cristian Sminchisescu

Multi-agent applications have recently gained significant popularity. In many computer vision tasks, a network of agents, such as a team of robots with cameras, could work collaboratively to perceive the environment for efficient and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Shuyue Lan , Zhilu Wang , Ermin Wei , Amit K. Roy-Chowdhury , Qi Zhu

Audio-visual navigation of an agent towards locating an audio goal is a challenging task especially when the audio is sporadic or the environment is noisy. In this paper, we present CAVEN, a Conversation-based Audio-Visual Embodied…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Xiulong Liu , Sudipta Paul , Moitreya Chatterjee , Anoop Cherian

The field of Embodied AI is witnessing a rapid evolution toward general-purpose robotic systems, fueled by high-fidelity simulation and large-scale data collection. However, this scaling capability remains severely bottlenecked by a…

Artificial Intelligence · Computer Science 2026-01-30 Zixing Lei , Genjia Liu , Yuanshuo Zhang , Qipeng Liu , Chuan Wen , Shanghang Zhang , Wenzhao Lian , Siheng Chen

Embodied agents are evolving from passive reasoning systems into active executors that interact with tools, robots, and physical environments. Once granted execution authority, the central challenge becomes how to keep actions governable at…

Robotics · Computer Science 2026-05-22 Xue Qin , Simin Luan , John See , Cong Yang , Zhijun Li

We argue that multi-agent test-time evolution is not single-agent evolution replicated N times. A single-agent learner can only evolve its own context and memory. A multi-agent system additionally evolves who collaborates, how they…

Artificial Intelligence · Computer Science 2026-05-13 Yaolun Zhang , Tianyi Xu , Shengyu Dai , Zhenwen Shao , Qingyun Wu , Huazheng Wang

Collaborative planning under operational constraints is an essential capability for heterogeneous robot teams tackling complex large-scale real-world tasks. Unmanned Aerial Vehicles (UAVs) offer rapid environmental coverage, but flight time…

Robotics · Computer Science 2026-03-10 Zihao Deng , Qianhuang Li , Peng Gao , Maggie Wigness , John Rogers , Donghyun Kim , Hao Zhang

Public participation has become increasingly important in collaborative urban design; yet, existing processes often face challenges in achieving efficient and scalable citizen engagement. To address this gap, this study explores how large…

Human-Computer Interaction · Computer Science 2026-03-18 Zhaoxi Zhang , Ruolin Wu , Feiyang Ren , Sridevi Turaga , Tamir Mendel

Predicting future sensory states is crucial for learning agents such as robots, drones, and autonomous vehicles. In this paper, we couple multiple sensory modalities with exploratory actions and propose a predictive neural network…

Robotics · Computer Science 2021-09-17 Xiaohui Chen , Ramtin Hosseini , Karen Panetta , Jivko Sinapov

The rapid proliferation of large language model (LLM)-based agentic systems raises critical concerns regarding digital sovereignty, environmental sustainability, regulatory compliance, and ethical alignment. Whilst existing frameworks…

Embodied AI research is increasingly moving beyond single-task, single-environment policy learning toward multi-task, multi-scene, and multi-model settings. This shift substantially increases the engineering overhead and development time…

Robotics · Computer Science 2026-04-16 Xueyang Zhou , Yihan Sun , Xijie Gong , Guiyao Tie , Pan Zhou , Lichao Sun , Yongchao Chen

Blue-collar work is often highly collaborative, embodied, and situated in shared physical environments, yet most research on collaborative AI has focused on white-collar work. This position paper explores how the embodied nature of AI…

Human-Computer Interaction · Computer Science 2026-02-13 Kaisa Vaananen , Niels van Berkel , Donald McMillan , Thomas Olsson

Embodied artificial intelligence emphasizes the role of an agent's body in generating human-like behaviors. The recent efforts on EmbodiedAI pay a lot of attention to building up machine learning models to possess perceiving, planning, and…

Artificial Intelligence · Computer Science 2024-10-15 Chen Gao , Baining Zhao , Weichen Zhang , Jinzhu Mao , Jun Zhang , Zhiheng Zheng , Fanhang Man , Jianjie Fang , Zile Zhou , Jinqiang Cui , Xinlei Chen , Yong Li

Co-designing autonomous robotic agents involves simultaneously optimizing the controller and physical design of the agent. Its inherent bi-level optimization formulation necessitates an outer loop design optimization driven by an inner loop…

Robotics · Computer Science 2024-10-17 Kishan R. Nagiredla , Buddhika L. Semage , Arun Kumar A. , Thommen G. Karimpanal , Santu Rana

The rapid adoption of AI coding agents has produced a dominant workflow pattern -- often called "vibe coding" -- that prioritizes speed of implementation over deliberate preparation. We argue that this approach creates a systematic…

Software Engineering · Computer Science 2026-05-08 Andrew Zigler