English
Related papers

Related papers: Benchmarking the Spectrum of Agent Capabilities

200 papers

Deep Reinforcement Learning has been shown to be very successful in complex games, e.g. Atari or Go. These games have clearly defined rules, and hence allow simulation. In many practical applications, however, interactions with the…

Machine Learning · Computer Science 2019-02-12 Andreas Merentitis , Kashif Rasul , Roland Vollgraf , Abdul-Saboor Sheikh , Urs Bergmann

The rapid evolution of Multi-modal Large Language Models (MLLMs) has advanced workflow automation; however, existing research mainly targets performance upper bounds in static environments, overlooking robustness for stochastic real-world…

Artificial Intelligence · Computer Science 2026-01-14 Daocheng Fu , Jianbiao Mei , Rong Wu , Xuemeng Yang , Jia Xu , Ding Wang , Pinlong Cai , Yong Liu , Licheng Wen , Botian Shi

Open-world survival games pose significant challenges for AI algorithms due to their multi-tasking, deep exploration, and goal prioritization requirements. Despite reinforcement learning (RL) being popular for solving games, its high sample…

Artificial Intelligence · Computer Science 2023-12-13 Yue Wu , Shrimai Prabhumoye , So Yeon Min , Yonatan Bisk , Ruslan Salakhutdinov , Amos Azaria , Tom Mitchell , Yuanzhi Li

The game industry is challenged to cope with increasing growth in demand and game complexity while maintaining acceptable quality standards for released games. Classic approaches solely depending on human efforts for quality assurance and…

Artificial Intelligence · Computer Science 2023-11-14 Sherif Abdelfattah , Adrian Brown , Pushi Zhang

Computer games are very challenging to handle for traditional automated testing algorithms. In this paper we will look at intelligent agents as a solution. Agents are suitable for testing games, since they are reactive and able to reason…

The emergence of complex life on Earth is often attributed to the arms race that ensued from a huge number of organisms all competing for finite resources. We present an artificial intelligence research environment, inspired by the human…

Multiagent Systems · Computer Science 2019-03-05 Joseph Suarez , Yilun Du , Phillip Isola , Igor Mordatch

Recent advances in artificial intelligence have been driven by the presence of increasingly realistic and complex simulated environments. However, many of the existing environments provide either unrealistic visuals, inaccurate physics, low…

Recent advances in artificial intelligence have been strongly driven by the use of game environments for training and evaluating agents. Games are often accessible and versatile, with well-defined state-transitions and goals allowing for…

Machine Learning · Computer Science 2019-09-19 Benjamin Beyret , José Hernández-Orallo , Lucy Cheke , Marta Halina , Murray Shanahan , Matthew Crosby

The real world unfolds along a single set of physics laws, yet human intelligence demonstrates a remarkable capacity to generalize experiences from this singular physical existence into a multiverse of games, each governed by entirely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Kuan Zhang , Dongchen Liu , Qiyue Zhao , Tianyu Xin , Yue Su , Haisheng Wang , Han Yin , Hongbo Ma , Peize Li , Tianjun Gu , Xiangnan Wu , Xinran Zhang , Yongxuan Li , Zirong Chen , Yiming Li

World models learn general knowledge from videos and simulate experience for training behaviors in imagination, offering a path towards intelligent agents. However, previous world models have been unable to accurately predict object…

Artificial Intelligence · Computer Science 2025-09-30 Danijar Hafner , Wilson Yan , Timothy Lillicrap

Unlike traditional automation tools or static LLM-based systems, agents combine decision-making and tool utilization to accomplish complex tasks, showing great potential in software engineering. However, existing studies largely focus on…

Software Engineering · Computer Science 2025-11-04 Zhuowen Yin , Cuifeng Gao , Chunsong Fan , Wenzhang Yang , Yinxing Xue , Lijun Zhang

We develop a general problem setting for training and testing the ability of agents to gather information efficiently. Specifically, we present a collection of tasks in which success requires searching through a partially-observed…

Machine Learning · Computer Science 2016-12-09 Philip Bachman , Alessandro Sordoni , Adam Trischler

There is a growing interest in Multi-Agent Reinforcement Learning (MARL) as the first steps towards building general intelligent agents that learn to make low and high-level decisions in non-stationary complex environments in the presence…

Artificial Intelligence · Computer Science 2020-01-01 Marco Jerome Gasparrini , Ricard Solé , Martí Sánchez-Fibla

In the last decade quantum machine learning has provided fascinating and fundamental improvements to supervised, unsupervised and reinforcement learning. In reinforcement learning, a so-called agent is challenged to solve a task given by…

Quantum Physics · Physics 2022-04-13 Arne Hamann , Sabine Wölk

In the pursuit of artificial general intelligence, our most significant measurement of progress is an agent's ability to achieve goals in a wide range of environments. Existing platforms for constructing such environments are typically…

What drives an agent to explore the world while also maintaining control over the environment? From a child at play to scientists in the lab, intelligent agents must balance curiosity (the drive to seek knowledge) with competence (the drive…

Artificial Intelligence · Computer Science 2025-07-14 Fryderyk Mantiuk , Hanqi Zhou , Charley M. Wu

Autonomous agents operating within real-world environments often rely on automated planners to ascertain optimal actions towards desired goals or the optimization of a specified objective function. Integral to these agents are common…

Artificial Intelligence · Computer Science 2025-02-18 James Chao , Wiktor Piotrowski , Roni Stern , Héctor Ortiz-Peña , Mitch Manzanares , Shiwali Mohan , Douglas S. Lange

Collaborative multi-agent exploration of unknown environments is crucial for search and rescue operations. Effective real-world deployment must address challenges such as limited inter-agent communication and static and dynamic obstacles.…

Robotics · Computer Science 2024-12-31 Gabriele Calzolari , Vidya Sumathy , Christoforos Kanellakis , George Nikolakopoulos

Complex systems show how surprising and beautiful phenomena can emerge from structures or agents following simple rules. With the recent success of deep reinforcement learning (RL), a natural path forward would be to use the capabilities of…

Multiagent Systems · Computer Science 2021-11-30 Ted Fujimoto

Reinforcement Learning agents are expected to eventually perform well. Typically, this takes the form of a guarantee about the asymptotic behavior of an algorithm given some assumptions about the environment. We present an algorithm for a…

Machine Learning · Computer Science 2020-04-02 Michael K. Cohen , Elliot Catt , Marcus Hutter