English
Related papers

Related papers: Evaluating Environments Using Exploratory Agents

200 papers

Analyzing interaction data provides an opportunity to learn about users, uncover their underlying goals, and create intelligent visualization systems. The first step for intelligent response in visualizations is to enable computers to infer…

Human-Computer Interaction · Computer Science 2020-10-19 Shayan Monadjemi , Roman Garnett , Alvitta Ottley

Expressing confidence is challenging for embodied agents navigating dynamic multimodal environments, where uncertainty arises from both perception and decision-making processes. We present the first work investigating embodied confidence…

Artificial Intelligence · Computer Science 2025-03-14 Tianjiao Yu , Vedant Shah , Muntasir Wahed , Kiet A. Nguyen , Adheesh Juvekar , Tal August , Ismini Lourentzou

The rapid development of large language and multimodal models has sparked significant interest in using proprietary models, such as GPT-4o, to develop autonomous agents capable of handling real-world scenarios like web navigation. Although…

Computation and Language · Computer Science 2024-10-28 Hongliang He , Wenlin Yao , Kaixin Ma , Wenhao Yu , Hongming Zhang , Tianqing Fang , Zhenzhong Lan , Dong Yu

Generating a game is not the same as making one that can be played. Despite advances in code generation, existing approaches treat game generation as one-shot translation from prompt to artifact, leaving interaction-level failures…

Software Engineering · Computer Science 2026-05-28 Yixu Huang , Bo Li , Na Li , Zhe Wang , Kaijie Chen , Haonan Ge , Qingyi Si , Yuanzhe Shen , Ruihan Yang , Guangjing Wang , Hongcheng Guo

In many real-world scenarios where extrinsic rewards to the agent are extremely sparse, curiosity has emerged as a useful concept providing intrinsic rewards that enable the agent to explore its environment and acquire information to…

Machine Learning · Computer Science 2021-04-27 Jivat Neet Kaur , Yiding Jiang , Paul Pu Liang

Procedural Content Generation via Reinforcement Learning (PCGRL) offers a method for training controllable level designer agents without the need for human datasets, using metrics that serve as proxies for level quality as rewards. Existing…

Artificial Intelligence · Computer Science 2025-10-07 Sam Earle , Zehua Jiang , Eugene Vinitsky , Julian Togelius

Immersive rooms are increasingly popular augmented reality systems that support multi-agent interactions within a virtual world. However, despite extensive content creation and technological developments, insights about perceptually-driven…

Human-Computer Interaction · Computer Science 2025-12-22 Jerry M. Huang , Stefan T. Radev

Escape rooms present a unique cognitive challenge that demands exploration-driven planning: with the sole instruction to 'escape the room', players must actively search their environment, collecting information, and finding solutions…

Artificial Intelligence · Computer Science 2025-05-28 Seungwon Lim , Sungwoong Kim , Jihwan Yu , Sungjae Lee , Jiwan Chung , Youngjae Yu

Real-world requests to AI agents are fundamentally underspecified. Natural human communication relies on shared context and unstated constraints that speakers expect listeners to infer. Current agentic benchmarks test explicit…

Artificial Intelligence · Computer Science 2026-02-25 Ved Sirdeshmukh , Marc Wetter

Exploration is a difficult challenge in reinforcement learning and even recent state-of-the art curiosity-based methods rely on the simple epsilon-greedy strategy to generate novelty. We argue that pure random walks do not succeed to…

Machine Learning · Computer Science 2018-07-06 Fabio Pardo , Vitaly Levdik , Petar Kormushev

One aspect of intelligence is the ability to restructure your own environment so that the world you live in becomes more beneficial to you. In this paper we investigate how the information-theoretic measure of agent empowerment can provide…

Artificial Intelligence · Computer Science 2014-06-09 Christoph Salge , Cornelius Glackin , Daniel Polani

Results from a triple-blind mixed-method user study into the effectiveness of mixed-initiative tools for the procedural generation of game levels are presented. A tool which generates levels using interactive evolutionary optimisation was…

Neural and Evolutionary Computing · Computer Science 2021-06-03 Sean P. Walton , Alma A. M. Rahat , James Stovold

Creatures in the real world constantly encounter new and diverse challenges they have never seen before. They will often need to adapt to some of these tasks and solve them in order to survive. This almost endless world of novel challenges…

Neural and Evolutionary Computing · Computer Science 2023-05-03 Emma Stensby Norstein , Kai Olav Ellefsen , Kyrre Glette

The emergence of complex life on Earth is often attributed to the arms race that ensued from a huge number of organisms all competing for finite resources. We present an artificial intelligence research environment, inspired by the human…

Multiagent Systems · Computer Science 2019-03-05 Joseph Suarez , Yilun Du , Phillip Isola , Igor Mordatch

Embodied agents operating in human spaces must be able to master how their environment works: what objects can the agent use, and how can it use them? We introduce a reinforcement learning approach for exploration for interaction, whereby…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Tushar Nagarajan , Kristen Grauman

Games are often designed to shape player behavior in a desired way; however, it can be unclear how design decisions affect the space of behaviors in a game. Designers usually explore this space through human playtesting, which can be…

Artificial Intelligence · Computer Science 2019-08-06 Alexander Zook , Brent Harrison , Mark O. Riedl

Understanding the evolution of human social systems requires flexible formalisms for the emergence of institutions. Although game theory is normally used to model interactions individually, larger spaces of games can be helpful for modeling…

Physics and Society · Physics 2021-08-12 Seth Frey , Curtis Atkisson

Multi-modal AI systems will likely become a ubiquitous presence in our everyday lives. A promising approach to making these systems more interactive is to embody them as agents within physical and virtual environments. At present, systems…

Deep reinforcement learning (DRL) has effectively enhanced gameplay experiences and game design across various game genres. However, few studies on fighting game agents have focused explicitly on enhancing player enjoyment, a critical…

Artificial Intelligence · Computer Science 2025-04-11 Shouren Wang , Zehua Jiang , Fernando Sliva , Sam Earle , Julian Togelius

Developing autonomous agents that quickly explore an environment and adapt their behavior online is a canonical challenge in robotics and machine learning. While humans are able to achieve such fast online exploration and adaptation, often…

Machine Learning · Computer Science 2025-07-15 Andrew Wagenmaker , Zhiyuan Zhou , Sergey Levine