English
Related papers

Related papers: Craftium: Bridging Flexibility and Efficiency for …

200 papers

While Vision-Language Models (VLMs) hold promise for tasks requiring extensive collaboration, traditional multi-agent simulators have facilitated rich explorations of an interactive artificial society that reflects collective behavior.…

Computation and Language · Computer Science 2024-05-24 Xianhao Yu , Jiaqi Fu , Renjia Deng , Wenjuan Han

Complex scheduling problems require a large amount computation power and innovative solution methods. The objective of this paper is the conception and implementation of a multi-agent system that is applicable in various problem domains.…

Multiagent Systems · Computer Science 2020-04-21 Peter Hillmann , Tobias Uhlig , Gabi Dreo Rodosek , Oliver Rose

Autonomous agents have made great strides in specialist domains like Atari games and Go. However, they typically learn tabula rasa in isolated environments with limited and manually conceived objectives, thus failing to generalize across a…

Machine Learning · Computer Science 2022-11-23 Linxi Fan , Guanzhi Wang , Yunfan Jiang , Ajay Mandlekar , Yuncong Yang , Haoyi Zhu , Andrew Tang , De-An Huang , Yuke Zhu , Anima Anandkumar

We study building embodied agents for open-ended creative tasks. While existing methods build instruction-following agents that can perform diverse open-ended tasks, none of them demonstrates creativity -- the ability to give novel and…

Artificial Intelligence · Computer Science 2025-12-29 Penglin Cai , Chi Zhang , Yuhui Fu , Haoqi Yuan , Zongqing Lu

Minecraft's complexity and diversity as an open world make it a perfect environment to test if agents can learn, adapt, and tackle a variety of unscripted tasks. However, the development and validation of novel agents in this setting…

Artificial Intelligence · Computer Science 2025-05-30 Shaofei Cai , Zhancun Mu , Kaichen He , Bowei Zhang , Xinyue Zheng , Anji Liu , Yitao Liang

Collaboration is a cornerstone of society. In the real world, human teammates make use of multi-sensory data to tackle challenging tasks in ever-changing environments. It is essential for embodied agents collaborating in visually-rich…

Artificial Intelligence · Computer Science 2024-12-09 Qian Long , Zhi Li , Ran Gong , Ying Nian Wu , Demetri Terzopoulos , Xiaofeng Gao

Spatial intelligence is foundational to AI systems that interact with the physical world, particularly in 3D scene generation and spatial comprehension. Current methodologies for 3D scene generation often rely heavily on predefined…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Libin Liu , Shen Chen , Sen Jia , Jingzhe Shi , Zhongyu Jiang , Can Jin , Wu Zongkai , Jenq-Neng Hwang , Lei Li

Educational simulations have long been recognized as powerful tools for enhancing learning outcomes, yet their creation has traditionally required substantial resources and technical expertise. This paper introduces MicroSims a novel…

Artificial Intelligence · Computer Science 2025-11-26 Valerie Lockhart , Dan McCreary , Troy A. Peterson

City-scale 3D generation is of great importance for the development of embodied intelligence and world models. Existing methods, however, face significant challenges regarding quality, fidelity, and scalability in 3D world generation. Thus,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Shengyuan Wang , Zhiheng Zheng , Yu Shang , Lixuan He , Yangcheng Yu , Fan Hangyu , Jie Feng , Qingmin Liao , Yong Li

Autonomous Graphical User Interface (GUI) agents powered by Multimodal Large Language Models (MLLMs) enable digital automation on end-user devices. While scaling both parameters and data has yielded substantial gains, advanced methods still…

Artificial Intelligence · Computer Science 2026-04-16 Ziwei Wang , Junjie Zheng , Leyang Yang , Sheng Zhou , Xiaoxuan Tang , Zhouhua Fang , Zhiwei Liu , Dajun Chen , Yong Li , Jiajun Bu

Intelligent agents gather information and perceive semantics within the environments before taking on given tasks. The agents store the collected information in the form of environment models that compactly represent the surrounding…

Computer Vision and Pattern Recognition · Computer Science 2019-08-15 Ue-Hwan Kim , Jin-Man Park , Taek-Jin Song , Jong-Hwan Kim

AI agents are emerging as a practical way to run multi-step scientific workflows that interleave reasoning with tool use and verification, pointing to a shift from isolated AI-assisted steps toward \emph{agentic science at scale}. This…

In recent years, individual-based/agent-based modeling has been applied to study a wide range of applications, ranging from engineering problems to phenomena in sociology, economics and biology. Simulating such agent-based models over…

Numerical Analysis · Mathematics 2014-04-30 Ping Liu , Giovanni Samaey , C. William Gear , Ioannis G. Kevrekidis

Cloud-based software systems are increasingly becoming complex and operating in highly dynamic environments. Self-adaptivity and self-awareness have recently emerged to cope with such level of dynamicity and scalability. Meanwhile,…

Software Engineering · Computer Science 2019-12-12 Maria Salama , Rami Bahsoon , Rajkumar Buyya

GUI agents that interact with graphical interfaces on behalf of users represent a promising direction for practical AI assistants. However, training such agents is hindered by the scarcity of suitable environments. We present InfiniteWeb, a…

Computation and Language · Computer Science 2026-01-09 Ziyun Zhang , Zezhou Wang , Xiaoyi Zhang , Zongyu Guo , Jiahao Li , Bin Li , Yan Lu

Constructing a diverse repertoire of manipulation skills in a scalable fashion remains an unsolved challenge in robotics. One way to address this challenge is with unstructured human play, where humans operate freely in an environment to…

Robotics · Computer Science 2022-10-24 Suneel Belkhale , Dorsa Sadigh

Leveraging large language models (LLMs), autonomous agents have significantly improved, gaining the ability to handle a variety of tasks. In open-ended settings, optimizing collaboration for efficiency and effectiveness demands flexible…

Artificial Intelligence · Computer Science 2024-09-17 Jiaqi Chen , Yuxian Jiang , Jiachen Lu , Li Zhang

Modern agents built on frontier language models often cannot adapt their weights. What, then, remains trainable? We argue it is the agent's \emph{workspace}, the structured external substrate it reads, writes, and tests; we call its…

Artificial Intelligence · Computer Science 2026-05-12 Elad Sarafian , Gal Kaplun , Ron Banner , Daniel Soudry , Boris Ginsburg

Real-world data collection for embodied agents remains costly and unsafe, calling for scalable, realistic, and simulator-ready 3D environments. However, existing scene-generation systems often rely on rule-based or task-specific pipelines,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Hongchi Xia , Xuan Li , Zhaoshuo Li , Qianli Ma , Jiashu Xu , Ming-Yu Liu , Yin Cui , Tsung-Yi Lin , Wei-Chiu Ma , Shenlong Wang , Shuran Song , Fangyin Wei

Claw-style environments support multi-step workflows over local files, tools, and persistent workspace states. However, scalable development around these environments remains constrained by the absence of a systematic framework, especially…

Computation and Language · Computer Science 2026-05-19 Fei Bai , Huatong Song , Shuang Sun , Daixuan Cheng , Yike Yang , Chuan Hao , Renyuan Li , Feng Chang , Yuan Wei , Ran Tao , Bryan Dai , Jian Yang , Wayne Xin Zhao , Ji-Rong Wen