English
Related papers

Related papers: Learning classifier systems with memory condition …

200 papers

Policy-gradient methods have received increased attention recently as a mechanism for learning to act in partially observable environments. They have shown promise for problems admitting memoryless policies but have been less successful…

Machine Learning · Computer Science 2025-12-08 Douglas Aberdeen , Jonathan Baxter

In the reinforcement learning literature, there are many algorithms developed for either Contextual Bandit (CB) or Markov Decision Processes (MDP) environments. However, when deploying reinforcement learning algorithms in the real world,…

Machine Learning · Computer Science 2022-08-02 Kelly W. Zhang , Omer Gottesman , Finale Doshi-Velez

In the sequential decision making setting, an agent aims to achieve systematic generalization over a large, possibly infinite, set of environments. Such environments are modeled as discrete Markov decision processes with both states and…

Machine Learning · Computer Science 2023-03-31 Mirco Mutti , Riccardo De Santi , Emanuele Rossi , Juan Felipe Calderon , Michael Bronstein , Marcello Restelli

Recent research in Cooperative Coevolution~(CC) have achieved promising progress in solving large-scale global optimization problems. However, existing CC paradigms have a primary limitation in that they require deep expertise for selecting…

Machine Learning · Computer Science 2025-04-25 Hongshu Guo , Wenjie Qiu , Zeyuan Ma , Xinglin Zhang , Jun Zhang , Yue-Jiao Gong

Policy learning for partially observed control tasks requires policies that can remember salient information from past observations. In this paper, we present a method for learning policies with internal memory for high-dimensional,…

Machine Learning · Computer Science 2015-09-24 Marvin Zhang , Zoe McCarthy , Chelsea Finn , Sergey Levine , Pieter Abbeel

Continual learning for reinforcement learning agents remains a significant challenge, particularly in preserving and leveraging existing information without an external signal to indicate changes in tasks or environments. In this study, we…

Machine Learning · Computer Science 2025-05-15 Zeki Doruk Erden , Donia Gasmi , Boi Faltings

Continuous-time Markov decision processes are an important class of models in a wide range of applications, ranging from cyber-physical systems to synthetic biology. A central problem is how to devise a policy to control the system in order…

Systems and Control · Computer Science 2016-06-01 Ezio Bartocci , Luca Bortolussi , Tomǎš Brázdil , Dimitrios Milios , Guido Sanguinetti

In practical applications, we can rarely assume full observability of a system's environment, despite such knowledge being important for determining a reactive control system's precise interaction with its environment. Therefore, we propose…

Machine Learning · Computer Science 2022-06-24 Edi Muskardin , Martin Tappler , Bernhard K. Aichernig , Ingo Pill

We study consistency of learning algorithms for a multi-class performance metric that is a non-decomposable function of the confusion matrix of a classifier and cannot be expressed as a sum of losses on individual data points; examples of…

Machine Learning · Computer Science 2015-01-05 Harish G. Ramaswamy , Harikrishna Narasimhan , Shivani Agarwal

As control engineering methods are applied to increasingly complex systems, data-driven approaches for system identification appear as a promising alternative to physics-based modeling. While the Bayesian approaches prevalent for…

Systems and Control · Electrical Eng. & Systems 2024-08-07 Robert Lefringhausen , Supitsana Srithasan , Armin Lederer , Sandra Hirche

Despite remarkable successes achieved by modern neural networks in a wide range of applications, these networks perform best in domain-specific stationary environments where they are trained only once on large-scale controlled data…

Neural and Evolutionary Computing · Computer Science 2019-04-23 Pouya Bashivan , Martin Schrimpf , Robert Ajemian , Irina Rish , Matthew Riemer , Yuhai Tu

Interest in reinforcement learning (RL) has recently surged due to the application of deep learning techniques, but these connectionist approaches are opaque compared with symbolic systems. Learning Classifier Systems (LCSs) are…

Machine Learning · Computer Science 2023-05-18 Jordan T. Bishop , Marcus Gallagher , Will N. Browne

Reinforcement learning (RL) is a central problem in artificial intelligence. This problem consists of defining artificial agents that can learn optimal behaviour by interacting with an environment -- where the optimal behaviour is defined…

Autoencoders are data-specific compression algorithms learned automatically from examples. The predominant approach has been to construct single large global models that cover the domain. However, training and evaluating models of…

Neural and Evolutionary Computing · Computer Science 2022-12-05 Richard J. Preen , Stewart W. Wilson , Larry Bull

Understanding how external stimuli are encoded in distributed neural activity is of significant interest in clinical and basic neuroscience. To address this need, it is essential to develop analytical tools capable of handling limited data…

Machine Learning · Computer Science 2024-09-11 Navid Ziaei , Reza Saadatifard , Ali Yousefi , Behzad Nazari , Sydney S. Cash , Angelique C. Paulk

Several works in computer vision have demonstrated the effectiveness of active learning for adapting the recognition model when new unlabeled data becomes available. Most of these works consider that labels obtained from the annotator are…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Sudipta Paul , Shivkumar Chandrasekaran , B. S. Manjunath , Amit K. Roy-Chowdhury

Machine learning systems are often used in settings where individuals adapt their features to obtain a desired outcome. In such settings, strategic behavior leads to a sharp loss in model performance in deployment. In this work, we aim to…

Machine Learning · Computer Science 2021-06-11 Yatong Chen , Jialu Wang , Yang Liu

Planning plays an important role in the broad class of decision theory. Planning has drawn much attention in recent work in the robotics and sequential decision making areas. Recently, Reinforcement Learning (RL), as an agent-environment…

Artificial Intelligence · Computer Science 2016-08-18 Kamyar Azizzadenesheli , Alessandro Lazaric , Animashree Anandkumar

In this paper, we are interested in optimal decisions in a partially observable Markov universe. Our viewpoint departs from the dynamic programming viewpoint: we are directly approximating an optimal strategic tree depending on the…

General Mathematics · Mathematics 2007-05-23 Frederic Dambreville

Partially observable Markov decision processes (POMDPs) are widely used in probabilistic planning problems in which an agent interacts with an environment using noisy and imprecise sensors. We study a setting in which the sensors are only…

Artificial Intelligence · Computer Science 2017-10-03 Krishnendu Chatterjee , Martin Chmelik , Ufuk Topcu