中文
相关论文

相关论文: OWMM-Agent: Open World Mobile Manipulation With Mu…

200 篇论文

Multi-modal AI systems will likely become a ubiquitous presence in our everyday lives. A promising approach to making these systems more interactive is to embody them as agents within physical and virtual environments. At present, systems…

Multi-Modal Large Language Models (MLLMs), despite being successful, exhibit limited generality and often fall short when compared to specialized models. Recently, LLM-based agents have been developed to address these challenges by…

计算与语言 · 计算机科学 2024-10-08 Binxu Li , Tiankai Yan , Yuanting Pan , Jie Luo , Ruiyang Ji , Jiayuan Ding , Zhe Xu , Shilong Liu , Haoyu Dong , Zihao Lin , Yixin Wang

Multimodal Large Language Models (MLLMs) have significantly advanced GUI agents, yet long-horizon automation remains constrained by two critical bottlenecks: context overload from raw sequential trajectory dependence and architectural…

人工智能 · 计算机科学 2026-04-15 Weihua Cheng , Junming Liu , Yifei Sun , Botian Shi , Yirong Chen , Ding Wang

Vehicle motion planning is an essential component of autonomous driving technology. Current rule-based vehicle motion planning methods perform satisfactorily in common scenarios but struggle to generalize to long-tailed situations.…

Autonomous agents that accomplish complex computer tasks with minimal human interventions have the potential to transform human-computer interaction, significantly enhancing accessibility and productivity. However, existing benchmarks…

While Vision-Language-Action (VLA) models have demonstrated impressive capabilities in robotic manipulation, their performance in complex reasoning and long-horizon task planning is limited by data scarcity and model capacity. To address…

机器人学 · 计算机科学 2025-10-15 Yi Yang , Kefan Gu , Yuqing Wen , Hebei Li , Yucheng Zhao , Tiancai Wang , Xudong Liu

Real-world manipulation problems in heavy clutter require robots to reason about potential contacts with objects in the environment. We focus on pick-and-place style tasks to retrieve a target object from a shelf where some `movable'…

机器人学 · 计算机科学 2023-03-24 Dhruv Mauria Saxena , Maxim Likhachev

The integration of Large Language Models (LLMs) with microscopic traffic simulation offers a promising path toward autonomous urban planning and intelligent transportation analysis. However, existing monolithic agent architectures often…

多智能体系统 · 计算机科学 2026-05-28 Shuyang Li , Ruimin Ke

As cities evolve toward more complex and multimodal transportation systems, the need for human-centered multi-agent simulation tools has never been more urgent. Yet most existing platforms remain limited - they often separate different…

多智能体系统 · 计算机科学 2025-07-16 Shiva Azimi , Arash Tavakoli

Multi-agent frameworks powered by large language models (LLMs) have demonstrated great success in automated planning and task execution. However, the effective adjustment of agentic workflows during execution has not been well studied. An…

人工智能 · 计算机科学 2025-02-25 Boye Niu , Yiliao Song , Kai Lian , Yifan Shen , Yu Yao , Kun Zhang , Tongliang Liu

Research interest in autonomous agents is on the rise as an emerging topic. The notable achievements of Large Language Models (LLMs) have demonstrated the considerable potential to attain human-like intelligence in autonomous agents.…

多智能体系统 · 计算机科学 2025-01-30 Hung Du , Srikanth Thudumu , Rajesh Vasa , Kon Mouzakis

Building agents with adaptive behavior in cooperative tasks stands as a paramount goal in the realm of multi-agent systems. Current approaches to developing cooperative agents rely primarily on learning-based methods, whose policy…

Large language models (LLMs) as autonomous agents offer a novel avenue for tackling real-world challenges through a knowledge-driven manner. These LLM-enhanced methodologies excel in generalization and interpretability. However, the…

人工智能 · 计算机科学 2024-07-22 Kemou Jiang , Xuan Cai , Zhiyong Cui , Aoyong Li , Yilong Ren , Haiyang Yu , Hao Yang , Daocheng Fu , Licheng Wen , Pinlong Cai

Recent breakthroughs in autonomous driving have been propelled by advances in robust world modeling, fundamentally transforming how vehicles interpret dynamic scenes and execute safe decision-making. World models have emerged as a linchpin…

机器人学 · 计算机科学 2025-09-11 Tuo Feng , Wenguan Wang , Yi Yang

Recent advancements in multimodal large language models (MLLMs) have shown exceptional potential in enabling mobile-using agents to autonomously execute human instructions. However, fully automated agents often try to execute tasks even…

计算与语言 · 计算机科学 2026-05-28 Zheng Wu , Pengzhou Cheng , Zongru Wu , Yuan Guo , Tianjie Ju , Aston Zhang , Gongshen Liu , Zhuosheng Zhang

Understanding and replicating human mobility requires not only spatial-temporal accuracy but also an awareness of the cognitive hierarchy underlying real-world travel decisions. Traditional agent-based or deep learning models can reproduce…

多智能体系统 · 计算机科学 2025-10-30 Qiumeng Li , Chunhou Ji , Xinyue Liu

The efficiency and accuracy of mapping are crucial in a large scene and long-term AR applications. Multi-agent cooperative SLAM is the precondition of multi-user AR interaction. The cooperation of multiple smart phones has the potential to…

机器人学 · 计算机科学 2021-06-24 Jialing Liu , Ruyu Liu , Kaiqi Chen , Jianhua Zhang , Dongyan Guo

This paper explores the application of Vision-Language Models (VLMs) as operator agents in the space domain, focusing on both software and hardware operational paradigms. Building on advances in Large Language Models (LLMs) and their…

Autonomous agent frameworks still struggle to reconcile long-term experiential learning with real-time, context-sensitive decision-making. In practice, this gap appears as static cognition, rigid workflow dependence, and inefficient context…

人工智能 · 计算机科学 2026-03-11 Xiaoxing Wang , Ning Liao , Shikun Wei , Chen Tang , Feiyu Xiong

Task planning for robotic manipulation with large language models (LLMs) is an emerging area. Prior approaches rely on specialized models, fine tuning, or prompt tuning, and often operate in an open loop manner without robust environmental…