English
Related papers

Related papers: Mastering 2048 with Delayed Temporal Coherence Lea…

200 papers

In a Stackelberg game, a leader commits to a randomized strategy, and a follower chooses their best strategy in response. We consider an extension of a standard Stackelberg game, called a discrete-time dynamic Stackelberg game, that has an…

Computer Science and Game Theory · Computer Science 2022-02-11 Niklas Lauffer , Mahsa Ghasemi , Abolfazl Hashemi , Yagiz Savas , Ufuk Topcu

Temporal difference learning (TD) is a simple iterative algorithm used to estimate the value function corresponding to a given policy in a Markov decision process. Although TD is one of the most widely used algorithms in reinforcement…

Machine Learning · Computer Science 2018-11-07 Jalaj Bhandari , Daniel Russo , Raghav Singal

In reinforcement learning, agents often learn policies for specific tasks without the ability to generalize this knowledge to related tasks. This paper introduces an algorithm that attempts to address this limitation by decomposing neural…

Machine Learning · Computer Science 2024-10-16 Mahdi Alikhasi , Levi H. S. Lelis

N-tuple networks have been successfully used as position evaluation functions for board games such as Othello or Connect Four. The effectiveness of such networks depends on their architecture, which is determined by the placement of…

Neural and Evolutionary Computing · Computer Science 2014-12-10 Wojciech Jaśkowski

This paper presents a constrained policy gradient algorithm. We introduce constraints for safe learning with the following steps. First, learning is slowed down (lazy learning) so that the episodic policy change can be computed with the…

Machine Learning · Computer Science 2022-01-24 Balázs Varga , Balázs Kulcsár , Morteza Haghir Chehreghani

Questions remain on the robustness of data-driven learning methods when crossing the gap from simulation to reality. We utilize weight anchoring, a method known from continual learning, to cultivate and fixate desired behavior in Neural…

Machine Learning · Computer Science 2023-04-21 Steffen Gracla , Edgar Beck , Carsten Bockelmann , Armin Dekorsy

The 2048 game involves tiles labeled with powers of two that can be merged to form bigger powers of two; variants of the same puzzle involve similar merges of other tile values. We analyze the maximum score achievable in these games by…

Discrete Mathematics · Computer Science 2018-04-23 David Eppstein

Temporal difference (TD) learning algorithms with neural network function parameterization have well-established empirical success in many practical large-scale reinforcement learning tasks. However, theoretical understanding of these…

Machine Learning · Computer Science 2024-05-08 Zhifa Ke , Zaiwen Wen , Junyu Zhang

We consider the Reinforcement Learning problem of controlling an unknown dynamical system to maximise the long-term average reward along a single trajectory. Most of the literature considers system interactions that occur in discrete time…

Artificial Intelligence · Computer Science 2023-09-07 Lorenzo Croissant , Marc Abeille , Bruno Bouchard

We propose a framework that can incrementally expand the explanatory temporal logic rule set to explain the occurrence of temporal events. Leveraging the temporal point process modeling and learning framework, the rule content and weights…

Machine Learning · Computer Science 2023-08-14 Chao Yang , Lu Wang , Kun Gao , Shuang Li

The development of biologically-plausible learning algorithms is important for understanding learning in the brain, but most of them fail to scale-up to real-world tasks, limiting their potential as explanations for learning by real brains.…

Neural and Evolutionary Computing · Computer Science 2022-02-01 Maxence Ernoult , Fabrice Normandin , Abhinav Moudgil , Sean Spinney , Eugene Belilovsky , Irina Rish , Blake Richards , Yoshua Bengio

We study a multi-agent reinforcement learning dynamics, and analyze its asymptotic behavior in infinite-horizon discounted Markov potential games. We focus on the independent and decentralized setting, where players do not know the game…

Machine Learning · Computer Science 2025-04-02 Chinmay Maheshwari , Manxi Wu , Druv Pai , Shankar Sastry

Training deep neural networks at the edge on light computational devices, embedded systems and robotic platforms is nowadays very challenging. Continual learning techniques, where complex models are incrementally trained on small batches of…

Machine Learning · Computer Science 2020-03-05 Lorenzo Pellegrini , Gabriele Graffieti , Vincenzo Lomonaco , Davide Maltoni

In this work, we develop a reinforcement learning protocol for a multiagent coordination task in a discrete state and action space: an iterated prisoner's dilemma game extended into a team based, winner-take all tournament, which forces the…

Computer Science and Game Theory · Computer Science 2018-06-18 Aaron Goodman

We theoretically analyze the popular mobile app game `2048' for the first time in $n$-dimensional space. We show that one can reach the maximum value $2^{n_1n_2+1}$ and $2^{\left({\prod_{i=1}^{d} n_i}\right)+1}$ for the two dimensional…

Discrete Mathematics · Computer Science 2019-08-27 Madhuparna Das , Goutam Paul

Despite the notable success of deep neural networks (DNNs) in solving complex tasks, the training process still remains considerable challenges. A primary obstacle is the substantial time required for training, particularly as high…

Machine Learning · Computer Science 2025-09-09 Viet Hoang Pham , Hyo-Sung Ahn

We consider the problem of learning stable matchings with unknown preferences in a decentralized and uncoordinated manner, where "decentralized" means that players make decisions individually without the influence of a central platform, and…

Computer Science and Game Theory · Computer Science 2024-08-16 S. Rasoul Etesami , R. Srikant

Integral to recent successes in deep reinforcement learning has been a class of temporal difference methods that use infrequently updated target values for policy evaluation in a Markov Decision Process. Yet a complete theoretical…

Machine Learning · Computer Science 2023-08-15 Mattie Fellows , Matthew J. A. Smith , Shimon Whiteson

We study policy evaluation problems in multi-task reinforcement learning (RL) under a low-rank representation setting. In this setting, we are given $N$ learning tasks where the corresponding value function of these tasks lie in an…

Machine Learning · Computer Science 2025-03-05 Yitao Bai , Sihan Zeng , Justin Romberg , Thinh T. Doan

We propose a novel training algorithm for reinforcement learning which combines the strength of deep Q-learning with a constrained optimization approach to tighten optimality and encourage faster reward propagation. Our novel technique…

Machine Learning · Computer Science 2016-11-08 Frank S. He , Yang Liu , Alexander G. Schwing , Jian Peng