English
Related papers

Related papers: Environment Maps: Structured Environmental Represe…

200 papers

Agents that are aware of the separation between themselves and their environments can leverage this understanding to form effective representations of visual input. We propose an approach for learning such structured representations for RL…

Machine Learning · Computer Science 2023-09-06 Kevin Gmelin , Shikhar Bahl , Russell Mendonca , Deepak Pathak

Vision-and-Language Navigation in Continuous Environments (VLN-CE) is a navigation task that requires an agent to follow a language instruction in a realistic environment. The understanding of environments is a crucial part of the VLN-CE…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Ting Wang , Zongkai Wu , Feiyu Yao , Donglin Wang

As LLMs are increasingly deployed as agents, reliable assessment of their agentic capabilities has become essential. However, reported benchmark scores often jointly reflect model capability and the implementation choices each benchmark is…

Artificial Intelligence · Computer Science 2026-05-28 Pengyu Zhu , Lijun Li , Yaxing Lyu , Qianxin Luo , Jingyi Yang , Yi Liu , Tingfeng Hui , Xinyu Yuan , Li Sun , Sen Su , Jing Shao

Large Language Models (LLM) have emerged as a tool for robots to generate task plans using common sense reasoning. For the LLM to generate actionable plans, scene context must be provided, often through a map. Recent works have shifted from…

Robotics · Computer Science 2024-09-25 Mike Zhang , Kaixian Qu , Vaishakh Patil , Cesar Cadena , Marco Hutter

This survey investigates foundational technologies essential for developing effective Large Language Model (LLM)-based multi-agent systems. Aiming to answer how best to optimize these systems for collaborative, dynamic environments, we…

Multiagent Systems · Computer Science 2025-04-04 R. M. Aratchige , W. M. K. S. Ilmini

The ability of artificial intelligence agents to make optimal decisions and generalise them to different domains and tasks is compromised in complex scenarios. One way to address this issue has focused on learning efficient representations…

Artificial Intelligence · Computer Science 2026-03-20 Corina Catarau-Cotutiu , Esther Mondragon , Eduardo Alonso

Recently, large language models (LLMs) have demonstrated remarkable problem-solving capabilities by autonomously integrating with external tools for collaborative reasoning. However, due to the inherently complex and diverse nature of…

Artificial Intelligence · Computer Science 2025-11-03 Mengjie Deng , Guanting Dong , Zhicheng Dou

Current LLM agents typically lack instance-level context, which comprises concrete facts such as environment structure, system configurations, and local mechanics. Consequently, existing methods are forced to intertwine exploration with…

Computation and Language · Computer Science 2026-01-14 Kuntai Cai , Juncheng Liu , Xianglin Yang , Zhaojie Niu , Xiaokui Xiao , Xing Chen

Large language models (LLMs) have demonstrated remarkable capabilities across a range of text-generation tasks. However, LLMs still struggle with problems requiring multi-step decision-making and environmental feedback, such as online…

Artificial Intelligence · Computer Science 2025-02-18 Zhenfang Chen , Delin Chen , Rui Sun , Wenjun Liu , Chuang Gan

In this paper, we consider the problem of building learning agents that can efficiently learn to navigate in constrained environments. The main goal is to design agents that can efficiently learn to understand and generalize to different…

Machine Learning · Computer Science 2020-03-04 Kei Ota , Yoko Sasaki , Devesh K. Jha , Yusuke Yoshiyasu , Asako Kanezaki

Large Language Models (LLMs) represent a landmark achievement in Artificial Intelligence (AI), demonstrating unprecedented proficiency in procedural tasks such as text generation, code completion, and conversational coherence. These…

Artificial Intelligence · Computer Science 2025-05-07 Schaun Wheeler , Olivier Jeunen

In recent years, Large Language Models (LLMs) have demonstrated significant improvements across a variety of tasks, one of which is the long-context capability. The key to improving long-context performance lies in effective data…

Computation and Language · Computer Science 2024-10-03 Keer Lu , Xiaonan Nie , Zheng Liang , Da Pan , Shusen Zhang , Keshi Zhao , Weipeng Chen , Zenan Zhou , Guosheng Dong , Bin Cui , Wentao Zhang

The advancement of large language model (LLM) based agents has shifted AI evaluation from single-turn response assessment to multi-step task completion in interactive environments. We present an empirical study evaluating frontier AI models…

Artificial Intelligence · Computer Science 2026-01-15 Logan Ritchie , Sushant Mehta , Nick Heiner , Mason Yu , Edwin Chen

Large language model (LLM) agents have demonstrated remarkable capabilities in complex decision-making and tool-use tasks, yet their ability to generalize across varying environments remains a under-examined concern. Current evaluation…

Artificial Intelligence · Computer Science 2026-01-15 Siyuan Liu , Hongbang Yuan , Xinze Li , Ziyue Zhu , Yixin Cao , Yu-Gang Jiang

The advent of generalist Large Language Models (LLMs) and Large Vision Models (VLMs) have streamlined the construction of semantically enriched maps that can enable robots to ground high-level reasoning and planning into their…

Robotics · Computer Science 2024-11-06 Emilio Olivastri , Jonathan Francis , Alberto Pretto , Niko Sünderhauf , Krishan Rana

Programming robot behavior in a complex world faces challenges on multiple levels, from dextrous low-level skills to high-level planning and reasoning. Recent pre-trained Large Language Models (LLMs) have shown remarkable reasoning ability…

Robotics · Computer Science 2023-10-12 Xufeng Zhao , Mengdi Li , Cornelius Weber , Muhammad Burhan Hafez , Stefan Wermter

In this paper, we propose a novel approach for agent motion prediction in cluttered environments. One of the main challenges in predicting agent motion is accounting for location and context-specific information. Our main contribution is…

Robotics · Computer Science 2020-07-08 Igor Gilitschenski , Guy Rosman , Arjun Gupta , Sertac Karaman , Daniela Rus

Large language model (LLM) agents have shown impressive reasoning capabilities in interactive decision-making tasks. These agents interact with environment through intermediate interfaces, such as predefined action spaces and interaction…

Artificial Intelligence · Computer Science 2025-05-28 Kaiming Liu , Xuanyu Lei , Ziyue Wang , Peng Li , Yang Liu

LLMs are increasingly used to support qualitative research, yet existing systems produce outputs that vary widely--from trace-faithful summaries to theory-mediated explanations and system models. To make these differences explicit, we…

Computation and Language · Computer Science 2026-01-21 Xinyu Pi , Qisen Yang , Chuong Nguyen , Hua Shen

Large language model (LLM) agents have shown increasing promise for collaborative task completion. However, existing multi-agent frameworks often rely on static workflows, fixed roles, and limited inter-agent communication, reducing their…

Multiagent Systems · Computer Science 2026-02-13 Chengxuan Xia , Qianye Wu , Sixuan Tian , Yilun Hao