English
Related papers

Related papers: CoEnv: Driving Embodied Multi-Agent Collaboration …

200 papers

As artificial intelligence (AI) rapidly advances, especially in multimodal large language models (MLLMs), research focus is shifting from single-modality text processing to the more complex domains of multimodal and embodied AI. Embodied…

While LLM-based agents excel at planning and executing long action sequences, their execution often remains inconsistent across trials, limiting reliability. Consolidating agent consistency requires distilling trial-error trajectories into…

Machine Learning · Computer Science 2026-05-12 Zihan Huang , Junda Wu , Tong Yu , Qianqi Yan , Rohan Surana , Uttaran Bhattacharya , Lina Yao , Xin Eric Wang , Julian McAuley

At present, Connected Autonomous Vehicles (CAVs) have begun to open road testing around the world, but their safety and efficiency performance in complex scenarios is still not satisfactory. Cooperative driving leverages the connectivity…

Robotics · Computer Science 2025-09-22 Shiyu Fang , Jiaqi Liu , Mingyu Ding , Yiming Cui , Chen Lv , Peng Hang , Jian Sun

The development of embodied agents that can communicate with humans in natural language has gained increasing interest over the last years, as it facilitates the diffusion of robotic platforms in human-populated environments. As a step…

Robotics · Computer Science 2024-04-16 Roberto Bigazzi , Marcella Cornia , Silvia Cascianelli , Lorenzo Baraldi , Rita Cucchiara

Training capable Large Language Model (LLM) agents is critically bottlenecked by the high cost and static nature of real-world interaction data. We address this by introducing GenEnv, a framework that establishes a difficulty-aligned…

Computation and Language · Computer Science 2025-12-24 Jiacheng Guo , Ling Yang , Peter Chen , Qixin Xiao , Yinjie Wang , Xinzhe Juan , Jiahao Qiu , Ke Shen , Mengdi Wang

Deep research has revolutionized data analysis, yet data scientists still devote substantial time to manually crafting visualizations, highlighting the need for robust automation from natural language queries. However, current systems…

Artificial Intelligence · Computer Science 2025-10-06 Zichen Chen , Jiefeng Chen , Sercan Ö. Arik , Misha Sra , Tomas Pfister , Jinsung Yoon

World models simulate environmental dynamics to enable agents to plan and reason about future states. While existing approaches have primarily focused on visual observations, real-world perception inherently involves multiple sensory…

Multimedia · Computer Science 2026-03-11 Jiahua Wang , Leqi Zheng , Jialong Wu , Yaoxin Mao

Progress in Embodied AI has made it possible for end-to-end-trained agents to navigate in photo-realistic environments with high-level reasoning and zero-shot or language-conditioned behavior, but benchmarks are still dominated by…

Collaborative perception allows agents to enhance their perceptual capabilities by exchanging intermediate features. Existing methods typically organize these intermediate features as 2D bird's-eye-view (BEV) representations, which discard…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Yang Li , Quan Yuan , Guiyang Luo , Xiaoyuan Fu , Rui Pan , Yujia Yang , Congzhang Shao , Yuewen Liu , Jinglin Li

Large language model (LLM) agents show promise in automating machine learning (ML) engineering. However, existing agents typically operate in isolation on a given research problem, without engaging with the broader research community, where…

Artificial Intelligence · Computer Science 2026-03-02 Sijie Li , Weiwei Sun , Shanda Li , Ameet Talwalkar , Yiming Yang

In this study, we present a novel paradigm for industrial robotic embodied agents, encapsulating an 'agent as cerebrum, controller as cerebellum' architecture. Our approach harnesses the power of Large Multimodal Models (LMMs) within an…

Robotics · Computer Science 2023-11-28 Haoran Zhao , Fengxing Pan , Huqiuyue Ping , Yaoming Zhou

Automatic service composition in mobile and pervasive computing faces many challenges due to the complex and highly dynamic nature of the environment. Common approaches consider service composition as a decision problem whose solution is…

Software Engineering · Computer Science 2019-08-07 Oscar J. Romero

The implementation of Urban Air Mobility represents a complex challenge in aviation due to the high degree of innovation required across various domains to realize it. From the use of advanced aircraft powered by novel technologies, the…

Traditional methods plan feasible paths for multiple agents in the stochastic environment. However, the methods' iterations with the changes in the environment result in computation complexities, especially for the decentralized agents…

Robotics · Computer Science 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen , Jinhu Lü

Embodied Planning is dedicated to the goal of creating agents capable of executing long-horizon tasks in complex physical worlds. However, existing embodied planning benchmarks frequently feature short-horizon tasks and coarse-grained…

Robotics · Computer Science 2025-08-06 Muzhen Cai , Xiubo Chen , Yining An , Jiaxin Zhang , Xuesong Wang , Wang Xu , Weinan Zhang , Ting Liu

This paper addresses the problem of collaboratively satisfying long-term spatial constraints in multi-agent systems. Each agent is subject to spatial constraints, expressed as inequalities, which may depend on the positions of other agents…

Systems and Control · Electrical Eng. & Systems 2026-03-23 Farhad Mehdifar , Mani H. Dhullipalla , Charalampos P. Bechlioulis , Dimos V. Dimarogonas

While multimodal large language models (MLLMs) have made groundbreaking progress in embodied intelligence, they still face significant challenges in spatial reasoning for complex long-horizon tasks. To address this gap, we propose…

Motion capture has become increasingly important, not only in computer animation but also in emerging fields like the virtual reality, bioinformatics, and humanoid training. Capturing outdoor environments offers extended horizon scenes but…

Robotics · Computer Science 2024-12-31 Aditya Rauniyar , Micah Corah , Sebastian Scherer

Cooperative perception has attracted wide attention given its capability to leverage shared information across connected automated vehicles (CAVs) and smart infrastructures to address sensing occlusion and range limitation issues. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Zonglin Meng , Yun Zhang , Zhaoliang Zheng , Zhihao Zhao , Jiaqi Ma

The integration of unmanned platforms equipped with advanced sensors promises to enhance situational awareness and mitigate the "fog of war" in military operations. However, managing the vast influx of data from these platforms poses a…

Multiagent Systems · Computer Science 2024-11-11 Indranil Sur , Aswin Raghavan , Abrar Rahman , James Z Hare , Daniel Cassenti , Carl Busart