中文
相关论文

相关论文: Global Commander and Local Operative: A Dual-Agent…

200 篇论文

This paper focuses on embodied task planning, where an agent acquires visual observations from the environment and executes atomic actions to accomplish a given task. Although recent Vision-Language Models (VLMs) have achieved impressive…

机器人学 · 计算机科学 2026-04-10 Peiran Xu , Jiaqi Zheng , Yadong Mu

Vision-Language-Action (VLA) models have emerged as a promising paradigm for building embodied agents that ground perception and language into action. However, most existing approaches rely on direct action prediction, lacking the ability…

机器人学 · 计算机科学 2026-04-21 Runze Li , Hongyin Zhang , Junxi Jin , Qixin Zeng , Zifeng Zhuang , Yiqi Tang , Shangke Lyu , Donglin Wang

Learning to navigate in a visual environment following natural-language instructions is a challenging task, because the multimodal inputs to the agent are highly variable, and the training data on a new task is often limited. In this paper,…

计算机视觉与模式识别 · 计算机科学 2020-04-07 Weituo Hao , Chunyuan Li , Xiujun Li , Lawrence Carin , Jianfeng Gao

Visual navigation in robotics traditionally relies on globally-consistent 3D maps or learned controllers, which can be computationally expensive and difficult to generalize across diverse environments. In this work, we present a novel…

机器人学 · 计算机科学 2025-09-11 Stefan Podgorski , Sourav Garg , Mehdi Hosseinzadeh , Lachlan Mares , Feras Dayoub , Ian Reid

Graphical user interfaces (GUIs) are the primary medium for human-computer interaction, yet automating GUI interactions remains challenging due to the complexity of visual elements, dynamic environments, and the need for multi-step…

Deep reinforcement learning (RL) has been successfully applied to a variety of game-like environments. However, the application of deep RL to visual navigation with realistic environments is a challenging task. We propose a novel learning…

机器人学 · 计算机科学 2019-11-12 Jonáš Kulhánek , Erik Derner , Tim de Bruin , Robert Babuška

Long-horizon search agents must manage a rapidly growing working context as they reason, call tools, and observe information. Naively accumulating all intermediate content can overwhelm the agent, increasing costs and the risk of errors. We…

人工智能 · 计算机科学 2026-05-07 Yijun Lu , Rui Ye , Yuwen Du , Jiajun Wang , Songhua Liu , Siheng Chen

MLLM-based GUI agents have demonstrated strong capabilities in complex user interface interaction tasks. However, long-horizon scenarios remain challenging, as these agents are burdened with tasks beyond their intrinsic capabilities,…

机器学习 · 计算机科学 2026-04-16 Zhengxi Lu , Fei Tang , Guangyi Liu , Kaitao Song , Xu Tan , Jin Ma , Wenqi Zhang , Weiming Lu , Jun Xiao , Yueting Zhuang , Yongliang Shen

Geospatial reasoning is essential for real-world applications such as urban analytics, transportation planning, and disaster response. However, existing LLM-based agents often fail at genuine geospatial computation, relying instead on web…

人工智能 · 计算机科学 2026-01-26 Riyang Bao , Cheng Yang , Dazhou Yu , Zhexiang Tang , Gengchen Mai , Liang Zhao

Autonomous agents have recently achieved remarkable progress across diverse domains, yet most evaluations focus on short-horizon, fully observable tasks. In contrast, many critical real-world tasks, such as large-scale software development,…

Recent advances in large vision-language models (VLMs) and large language models (LLMs) have enabled zero-shot approaches to visual language navigation (VLN), where an agent follows natural language instructions using only ego perception…

机器人学 · 计算机科学 2026-03-03 Chaoran Xiong , Litao Wei , Xinhao Hu , Kehui Ma , Ziyi Xia , Zixin Jiang , Zhen Sun , Ling Pei

The rapid development of mobile GUI agents has stimulated growing research interest in long-horizon task automation. However, building agents for these tasks faces a critical bottleneck: the reliance on ever-expanding interaction history…

人工智能 · 计算机科学 2026-05-11 Shizuo Tian , Hao Wen , Yuxuan Chen , Jiacheng Liu , Shanhui Zhao , Guohong Liu , Ju Ren , Yunxin Liu , Yuanchun Li

Generative Engine Optimization (GEO) is rapidly reshaping digital marketing paradigms in the era of Large Language Models (LLMs). However, current GEO strategies predominantly rely on Retrieval-Augmented Generation (RAG), which inherently…

人工智能 · 计算机科学 2026-04-07 XinYu Zhao , ChengYou Li , XiangBao Meng , Kai Zhang , XiaoDong Liu

Complex, non-linear tasks challenge LLM-enhanced multi-agent systems (MAS) due to partial observability and suboptimal coordination. We propose Orchestrator, a novel MAS framework that leverages attention-inspired self-emergent coordination…

多智能体系统 · 计算机科学 2025-09-09 Lukas Beckenbauer , Johannes-Lucas Loewe , Ge Zheng , Alexandra Brintrup

Vision-and-Language Navigation (VLN) requires agents to navigate photo-realistic environments following natural language instructions. Current methods predominantly rely on imitation learning, which suffers from limited generalization and…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Jiangyang Li , Cong Wan , SongLin Dong , Chenhao Ding , Qiang Wang , Zhiheng Ma , Yihong Gong

Vision-and-Language Navigation (VLN) poses significant challenges for agents to interpret natural language instructions and navigate complex 3D environments. While recent progress has been driven by large-scale pre-training and data…

人工智能 · 计算机科学 2026-05-14 Tianyi Ma , Yue Zhang , Zehao Wang , Parisa Kordjamshidi

Agentic artificial intelligence (AI) is an AI paradigm that can perceive the environment, reason over observations, and execute actions to achieve specific goals. Task-oriented communication supports agentic AI by transmitting only the…

图像与视频处理 · 电气工程与系统科学 2026-02-16 Sin-Yu Huang , Lele Wang , Vincent W. S. Wong

Computer-use agents operate over long horizons under noisy perception, multi-window contexts, evolving environment states. Existing approaches, from RL-based planners to trajectory retrieval, often drift from user intent and repeatedly…

人工智能 · 计算机科学 2026-03-02 Seoyoung Lee , Seobin Yoon , Seongbeen Lee , Yoojung Chun , Dayoung Park , Doyeon Kim , Joo Yong Sim

World models learned from high-dimensional visual observations allow agents to make decisions and plan directly in latent space, avoiding pixel-level reconstruction. However, recent latent predictive architectures (JEPAs), including the…

机器学习 · 计算机科学 2026-02-25 Leonardo F. Toso , Davit Shadunts , Yunyang Lu , Nihal Sharma , Donglin Zhan , Nam H. Nguyen , James Anderson

Object Goal Navigation-requiring an agent to locate a specific object in an unseen environment-remains a core challenge in embodied AI. Although recent progress in Vision-Language Model (VLM)-based agents has demonstrated promising…

计算机视觉与模式识别 · 计算机科学 2025-07-22 Dujun Nie , Xianda Guo , Yiqun Duan , Ruijun Zhang , Long Chen