English
Related papers

Related papers: Carle's Game: An Open-Ended Challenge in Explorato…

200 papers

In open-world environments like Minecraft, existing agents face challenges in continuously learning structured knowledge, particularly causality. These challenges stem from the opacity inherent in black-box models and an excessive reliance…

Artificial Intelligence · Computer Science 2024-10-30 Shu Yu , Chaochao Lu

A cellular game is a dynamical system in which cells, placed in some discrete structure, are regarded as playing a game with their immediate neighbors. Individual strategies may be either deterministic or stochastic. Strategy success is…

adap-org · Physics 2008-02-03 Lenore Levine

Layered Cellular Automata (LCA) extends the concept of traditional cellular automata (CA) to model complex systems and phenomena. In LCA, each cell's next state is determined by the interaction of two layers of computation, allowing for…

Cellular Automata and Lattice Gases · Physics 2023-08-15 Abhishek Dalai

Autonomous artificial agents must be able to learn behaviors in complex environments without humans to design tasks and rewards. Designing these functions for each environment is not feasible, thus, motivating the development of intrinsic…

Machine Learning · Computer Science 2025-02-20 Alana Santana , Paula P. Costa , Esther L. Colombini

This project explores speculative evolution through a 3D implementation of Conway's Game of Life, using procedural simulation to generate unfamiliar extraterrestrial organic forms. By applying a volumetric optimized workflow, the raw…

Cellular Automata and Lattice Gases · Physics 2025-05-06 Amir Hossein Khazaei

We present a new Life-like cellular automaton (CA) capable of logic universality -- the X-rule. The CA is 2D, binary, with a Moore neighborhood and $\lambda$ parameter similar to the game-of-Life, but is not based on birth/survival and is…

Cellular Automata and Lattice Gases · Physics 2017-09-11 José Manuel Gómez Soto , Andrew Wuensche

The advancement of general-purpose intelligent agents is intrinsically linked to the environments in which they are trained. While scaling models and datasets has yielded remarkable capabilities, scaling the complexity, diversity, and…

Machine Learning · Computer Science 2025-11-05 Brennen Hill

This paper introduces a novel combination of scheduling control on a flexible robot manufacturing cell with curiosity based reinforcement learning. Reinforcement learning has proved to be highly successful in solving tasks like robotics and…

Robotics · Computer Science 2020-11-18 Mohammed Sharafath Abdul Hameed , Md Muzahid Khan , Andreas Schwung

As highly automated driving is transitioning from single-vehicle closed-access testing to commercial deployments of public ride-hailing in selected areas (e.g., Waymo), automated driving and connected cooperative intelligent transport…

Hardware Architecture · Computer Science 2026-02-11 Jean-Pierre Busch , Lukas Ostendorf , Guido Linden , Lennart Reiher , Till Beemelmanns , Bastian Lampe , Timo Woopen , Lutz Eckstein

This work introduces interactive traffic scenarios in the CARLA simulator, which are based on real-world traffic. We concentrate on tactical tasks lasting several seconds, which are especially challenging for current control methods. The…

Despite recent successes of reinforcement learning (RL), it remains a challenge for agents to transfer learned skills to related environments. To facilitate research addressing this problem, we propose CausalWorld, a benchmark for causal…

It has been a long-standing dream to design artificial agents that explore their environment efficiently via intrinsic motivation, similar to how children perform curious free play. Despite recent advances in intrinsically motivated…

Machine Learning · Computer Science 2022-11-29 Cansu Sancaktar , Sebastian Blaes , Georg Martius

The donation game is a well-established framework for studying the emergence and evolution of cooperation in multi-agent systems. The cooperative behavior can be influenced by the environmental noise in partially observable settings and by…

Multiagent Systems · Computer Science 2025-07-17 Marcin Kowalik , Przemysław Stokłosa , Mateusz Grabowski , Janusz Starzyk , Paweł Raif

Sparse reward environments pose significant challenges in reinforcement learning, especially within multi-agent systems (MAS) where feedback is delayed and shared across agents, leading to suboptimal learning. We propose Collaborative…

Artificial Intelligence · Computer Science 2025-05-14 Yufei Lin , Chengwei Ye , Huanzhen Zhang , Kangsheng Wang , Linuo Xu , Shuyan Liu , Zeyu Zhang

Simulation offers advantages throughout the development process of automated driving functions, both in research and product development. Common open-source simulators like CARLA are extensively used in training, evaluation, and…

Robotics · Computer Science 2025-12-10 Nils Gehrke , David Brecht , Dominik Kulmer , Dheer Patel , Frank Diermeyer

Existing reinforcement learning environment libraries use monolithic environment classes, provide shallow methods for altering agent observation and action spaces, and/or are tied to a specific simulation environment. The Core Reinforcement…

The emergence of complex life on Earth is often attributed to the arms race that ensued from a huge number of organisms all competing for finite resources. We present an artificial intelligence research environment, inspired by the human…

Multiagent Systems · Computer Science 2019-03-05 Joseph Suarez , Yilun Du , Phillip Isola , Igor Mordatch

Complex environments and tasks pose a difficult problem for holistic end-to-end learning approaches. Decomposition of an environment into interacting controllable and non-controllable objects allows supervised learning for non-controllable…

Machine Learning · Computer Science 2019-01-30 Andrew Melnik , Sascha Fleer , Malte Schilling , Helge Ritter

The Game of Life (GoL), one well known 2D cellular automaton, does not typically ensure interesting long-term phenotypic dynamics. Therefore, while being Turing complete, GoL cannot be said to be open-ended. In this work, we extend GoL with…

Cellular Automata and Lattice Gases · Physics 2024-06-21 Aarati Shrestha , Felix Reimers , Sanyam Jain , Paolo Baldini , Michele Braccini , Andrea Roli , Stefano Nichele

In reinforcement learning (RL) research, simulations enable benchmarks between algorithms, as well as prototyping and hyper-parameter tuning of agents. In order to promote RL both in research and real-world applications, frameworks are…

Robotics · Computer Science 2022-12-05 Christian Bitter , Timo Thun , Tobias Meisen