English
Related papers

Related papers: Detecting and Adapting to Novelty in Games

200 papers

We study reinforcement learning (RL) for text-based games, which are interactive simulations in the context of natural language. While different methods have been developed to represent the environment information and language actions,…

Machine Learning · Computer Science 2020-12-29 Yunqiu Xu , Meng Fang , Ling Chen , Yali Du , Joey Tianyi Zhou , Chengqi Zhang

Reinforcement learning (RL) is successful at learning to play games where the entire environment is visible. However, RL approaches are challenged in complex games like Starcraft II and in real-world environments where the entire…

Machine Learning · Computer Science 2021-08-13 Elizabeth Gilmour , Noah Plotkin , Leslie Smith

This abstract proposes an approach towards goal-oriented modeling of the detection and modeling complex social phenomena in multiparty discourse in an online political strategy game. We developed a two-tier approach that first encodes…

Computation and Language · Computer Science 2022-01-05 Hansin Ahuja , Lynnette Hui Xian Ng , Kokil Jaidka

We propose RAPid-Learn: Learning to Recover and Plan Again, a hybrid planning and learning method, to tackle the problem of adapting to sudden and unexpected changes in an agent's environment (i.e., novelties). RAPid-Learn is designed to…

Artificial Intelligence · Computer Science 2022-06-28 Shivam Goel , Yash Shukla , Vasanth Sarathy , Matthias Scheutz , Jivko Sinapov

Unambiguous identification of the rewards driving behaviours of entities operating in complex open-ended real-world environments is difficult, partly because goals and associated behaviours emerge endogenously and are dynamically updated as…

Machine Learning · Computer Science 2024-05-03 Richard M. Bailey

Current works in human emotion recognition follow the traditional closed learning approach governed by rigid rules without any consideration of novelty. Classification models are trained on some collected datasets and expected to have the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Mijanur Palash , Bharat Bhargava

Regardless of past learning, an agent in an open world will face unfamiliar events outside of prior experience, existing models, or policies. Further, the agent will sometimes lack relevant knowledge and/or sufficient time to assess the…

Artificial Intelligence · Computer Science 2025-06-17 Robert E. Wray , Steven J. Jones , John E. Laird

Two key challenges within Reinforcement Learning involve improving (a) agent learning within environments with sparse extrinsic rewards and (b) the explainability of agent actions. We describe a curious subgoal focused agent to address both…

Machine Learning · Computer Science 2021-04-20 Connor van Rossum , Candice Feinberg , Adam Abu Shumays , Kyle Baxter , Benedek Bartha

Infants are experts at playing, with an amazing ability to generate novel structured behaviors in unstructured environments that lack clear extrinsic reward signals. We seek to mathematically formalize these abilities using a neural network…

Machine Learning · Computer Science 2018-11-01 Nick Haber , Damian Mrowca , Li Fei-Fei , Daniel L. K. Yamins

Global games form a subclass of games with incomplete information where a set of agents decide actions against a regime with an underlying fundamental $\theta$ representing its power. Each agent has access to an independent noisy…

Social and Information Networks · Computer Science 2017-10-31 Hessam Mahdavifar , Ahmad Beirami , Behrouz Touri , Jeff S. Shamma

Playing text-based games requires skills in processing natural language and sequential decision making. Achieving human-level performance on text-based games remains an open challenge, and prior research has largely relied on hand-crafted…

The next generation of autonomous agents must not only learn efficiently but also act reliably and adapt their behavior in open worlds. Standard approaches typically assume fixed tasks and environments with little or no novelty, which…

Machine Learning · Computer Science 2026-03-02 Florent Delgrange

Though deep reinforcement learning agents have achieved unprecedented success in recent years, their learned policies can be brittle, failing to generalize to even slight modifications of their environments or unfamiliar situations. The…

Artificial Intelligence · Computer Science 2021-12-13 Yiheng Xie , Mingxuan Li , Shangqun Yu , Michael Littman

Reinforcement learning (RL) algorithms update an agent's parameters according to one of several possible rules, discovered manually through years of research. Automating the discovery of update rules from data could lead to more efficient…

Machine Learning · Computer Science 2021-01-06 Junhyuk Oh , Matteo Hessel , Wojciech M. Czarnecki , Zhongwen Xu , Hado van Hasselt , Satinder Singh , David Silver

We describe GNOME (Generating Novelty in Open-world Multi-agent Environments), an experimental platform that is designed to test the effectiveness of multi-agent AI systems when faced with \emph{novelty}. GNOME separates the development of…

Artificial Intelligence · Computer Science 2025-07-08 Mayank Kejriwal , Shilpa Thomas

Autonomous robots need to be able to adapt to unforeseen situations and to acquire new skills through trial and error. Reinforcement learning in principle offers a suitable methodological framework for this kind of autonomous learning.…

Robotics · Computer Science 2016-08-02 Nikolas J. Hemion

This paper studies two important signal processing aspects of equilibrium behavior in non-cooperative games arising in social networks, namely, reinforcement learning and detection of equilibrium play. The first part of the paper presents a…

Computer Science and Game Theory · Computer Science 2015-01-07 Omid Namvar Gharehshiran , William Hoiles , Vikram Krishnamurthy

Real-world autonomous decision-making systems, from robots to recommendation engines, must operate in environments that change over time. While deep reinforcement learning (RL) has shown an impressive ability to learn optimal policies in…

Machine Learning · Computer Science 2025-05-16 Jonathan Clifford Balloch

Text-based games (TBGs) have become a popular proving ground for the demonstration of learning-based agents that make decisions in quasi real-world settings. The crux of the problem for a reinforcement learning agent in such TBGs is…

Machine Learning · Computer Science 2021-06-16 Keerthiram Murugesan , Subhajit Chaudhury , Kartik Talamadupula

Open ad hoc teamwork is the problem of training a single agent to efficiently collaborate with an unknown group of teammates whose composition may change over time. A variable team composition creates challenges for the agent, such as the…

Multiagent Systems · Computer Science 2023-10-31 Arrasy Rahman , Ignacio Carlucho , Niklas Höpner , Stefano V. Albrecht