English
Related papers

Related papers: Luban: Building Open-Ended Creative Agents via Aut…

200 papers

Embodied AI requires agents to understand goals, plan actions, and execute tasks in simulated environments. We present a comprehensive evaluation of Large Language Models (LLMs) on the VirtualHome benchmark using the Embodied Agent…

Artificial Intelligence · Computer Science 2026-02-04 Jiaqi Xu , Tao Huang , Kai Zhang

Leveraging large language models (LLMs), autonomous agents have significantly improved, gaining the ability to handle a variety of tasks. In open-ended settings, optimizing collaboration for efficiency and effectiveness demands flexible…

Artificial Intelligence · Computer Science 2024-09-17 Jiaqi Chen , Yuxian Jiang , Jiachen Lu , Li Zhang

A fundamental limitation of current LLM-based AI agents is their inability to build differentiated trust among each other at the onset of an agent-to-agent dialogue. However, autonomous and interoperable trust establishment becomes…

Cryptography and Security · Computer Science 2026-05-28 Sandro Rodriguez Garzon , Awid Vaziry , Enis Mert Kuzu , Dennis Enrique Gehrmann , Buse Varkan , Alexander Gaballa , Axel Küpper

Large Multimodal Models (LMMs) have ushered in a new era in artificial intelligence, merging capabilities in both language and vision to form highly capable Visual Foundation Agents. These agents are postulated to excel across a myriad of…

Robotic agents that operate autonomously in the real world need to continuously explore their environment and learn from the data collected, with minimal human supervision. While it is possible to build agents that can learn in such a…

Robotics · Computer Science 2023-02-14 Russell Mendonca , Shikhar Bahl , Deepak Pathak

The increase in available computing power and the Deep Learning revolution have allowed the exploration of new topics and frontiers in Artificial Intelligence research. A new field called Embodied Artificial Intelligence, which places at…

Robotics · Computer Science 2025-05-05 Roberto Bigazzi

In recent years, as machine learning, particularly for vision and language understanding, has been improved, research in embedded AI has also evolved. VOYAGER is a well-known LLM-based embodied AI that enables autonomous exploration in the…

Artificial Intelligence · Computer Science 2024-06-05 Wakana Haijima , Kou Nakakubo , Masahiro Suzuki , Yutaka Matsuo

Numerous software analysis tools exist today, yet applying them to diverse open-source projects remains challenging due to environment setup, dependency resolution, and tool configuration. LLM-based agents offer a potential solution, yet no…

Software Engineering · Computer Science 2026-04-20 Islem Bouzenia , Cristian Cadar , Michael Pradel

It is a long-lasting goal to design a generalist-embodied agent that can follow diverse instructions in human-like ways. However, existing approaches often fail to steadily follow instructions due to difficulties in understanding abstract…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Enshen Zhou , Yiran Qin , Zhenfei Yin , Yuzhou Huang , Ruimao Zhang , Lu Sheng , Yu Qiao , Jing Shao

Embodied agents designed to assist users with tasks must engage in natural language interactions, interpret instructions, execute actions, and communicate effectively to resolve issues. However, collecting large-scale, diverse datasets of…

Computation and Language · Computer Science 2024-11-01 Daniel Philipov , Vardhan Dongre , Gokhan Tur , Dilek Hakkani-Tür

Minecraft's complexity and diversity as an open world make it a perfect environment to test if agents can learn, adapt, and tackle a variety of unscripted tasks. However, the development and validation of novel agents in this setting…

Artificial Intelligence · Computer Science 2025-05-30 Shaofei Cai , Zhancun Mu , Kaichen He , Bowei Zhang , Xinyue Zheng , Anji Liu , Yitao Liang

Architecture views are essential for software architecture documentation, yet their manual creation is labor intensive and often leads to outdated artifacts. As systems grow in complexity, the automated generation of views from source code…

Software Engineering · Computer Science 2026-03-24 Miryala Sathvika , Rudra Dhar , Karthik Vaidhyanathan

LLM agents now perform strongly in software engineering, deep research, GUI automation, and various other applications, while recent agent scaffolds and models are increasingly integrating these capabilities into unified systems. Yet, most…

Large Language Models are increasingly proposed as cognitive components for robotic systems, yet their opaque decision processes make it difficult to explain success or failure in closed-loop embodied tasks. Following an empirical AI…

Artificial Intelligence · Computer Science 2026-05-20 Oussama Zenkri , Oliver Brock

Recent LLM agents have made great use of chain of thought reasoning and function calling. As their capabilities grow, an important question arises: can this software represent not only a smart problem-solving tool, but an entity in its own…

Artificial Intelligence · Computer Science 2025-10-17 Asen Nachkov , Xi Wang , Luc Van Gool

Recently, LLM agents have made rapid progress in improving their programming capabilities. However, existing benchmarks lack the ability to automatically evaluate from users' perspective, and also lack the explainability of the results of…

Software Engineering · Computer Science 2025-06-03 Kaiyuan Liu , Youcheng Pan , Yang Xiang , Daojing He , Jing Li , Yexing Du , Tianrun Gao

Reinforcement learning has enabled agents to solve challenging tasks in unknown environments. However, manually crafting reward functions can be time consuming, expensive, and error prone to human error. Competing objectives have been…

Machine Learning · Computer Science 2021-02-11 Brendon Matusch , Jimmy Ba , Danijar Hafner

Long-horizon embodied intelligence requires agents to improve through interaction, not merely to execute plans generated from static goals. A central challenge is therefore to transform past executions into knowledge that can shape future…

Artificial Intelligence · Computer Science 2026-05-12 Zhengwei Xie , Zhisheng Chen , Ziyan Weng , Jinhan Li , Chenglong Li , Zikai Xiao , Jingwei Song , Jinhao Jing , Vireo Zhang , Kun Wang

With the rapid advancement of Large Language Models (LLMs), LLM-based autonomous agents have shown the potential to function as digital employees, such as digital analysts, teachers, and programmers. In this paper, we develop an…

The core challenge in automotive exterior design is balancing subjective aesthetics with objective aerodynamic performance while dramatically accelerating the development cycle. To address this, we propose a novel, LLM-driven multi-agent…

Computational Engineering, Finance, and Science · Computer Science 2025-08-06 Xinyu Jin , Shengmao Yan , Qingtao Wang , Shisong Deng , Yanzhen Jiang , Shuangyao Zhao