English
Related papers

Related papers: Unveiling Options with Neural Decomposition

200 papers

Policy gradient methods are powerful reinforcement learning algorithms and have been demonstrated to solve many complex tasks. However, these methods are also data-inefficient, afflicted with high variance gradient estimates, and frequently…

Machine Learning · Computer Science 2019-05-15 Andreas Doerr , Michael Volpp , Marc Toussaint , Sebastian Trimpe , Christian Daniel

Maneuver decision-making can be regarded as a Markov decision process and can be address by reinforcement learning. However, original reinforcement learning algorithms can hardly solve the maneuvering decision-making problem. One reason is…

Artificial Intelligence · Computer Science 2023-09-19 Zhang Hong-Peng

Many machine learning strategies designed to automate mathematical tasks leverage neural networks to search large combinatorial spaces of mathematical symbols. In contrast to traditional evolutionary approaches, using a neural network at…

In this paper we propose several novel distributed gradient-based temporal difference algorithms for multi-agent off-policy learning of linear approximation of the value function in Markov decision processes with strict information…

Machine Learning · Computer Science 2021-04-20 Milos S. Stankovic , Marko Beko , Srdjan S. Stankovic

Interpretability has become an important issue in the machine learning field, along with the success of layered neural networks in various practical tasks. Since a trained layered neural network consists of a complex nonlinear relationship…

Machine Learning · Statistics 2018-05-22 Chihiro Watanabe , Kaoru Hiramatsu , Kunio Kashino

Markov decision processes (MDPs) describe sequential decision-making processes; MDP policies return for every state in that process an advised action. Classical algorithms can efficiently compute policies that are optimal with respect to,…

Logic in Computer Science · Computer Science 2025-05-23 Roman Andriushchenko , Milan Češka , Sebastian Junges , Filip Macák

Enabling autonomous robots to interact in unstructured environments with dynamic objects requires manipulation capabilities that can deal with clutter, changes, and objects' variability. This paper presents a comparison of different…

Robotics · Computer Science 2019-02-01 Michel Breyer , Fadri Furrer , Tonci Novkovic , Roland Siegwart , Juan Nieto

Recently proposed budding tree is a decision tree algorithm in which every node is part internal node and part leaf. This allows representing every decision tree in a continuous parameter space, and therefore a budding tree can be jointly…

Machine Learning · Computer Science 2014-12-22 Ozan İrsoy , Ethem Alpaydın

Reinforcement learning has shown promise in learning policies that can solve complex problems. However, manually specifying a good reward function can be difficult, especially for intricate tasks. Inverse reinforcement learning offers a…

Machine Learning · Computer Science 2017-11-28 Peter Henderson , Wei-Di Chang , Pierre-Luc Bacon , David Meger , Joelle Pineau , Doina Precup

Multi-objective Markov decision processes are sequential decision-making problems that involve multiple conflicting reward functions that cannot be optimized simultaneously without a compromise. This type of problems cannot be solved by a…

Machine Learning · Computer Science 2023-08-22 Sherif Abdelfattah , Kathryn Merrick , Jiankun Hu

In this paper we present a novel method for learning hierarchical representations of Markov decision processes. Our method works by partitioning the state space into subsets, and defines subtasks for performing transitions between the…

Machine Learning · Computer Science 2021-12-21 Lorenzo Steccanella , Simone Totaro , Anders Jonsson

Discovering useful temporal abstractions, in the form of options, is widely thought to be key to applying reinforcement learning and planning to increasingly complex domains. Building on the empirical success of the Expert Iteration…

Artificial Intelligence · Computer Science 2023-12-27 Kenny Young , Richard S. Sutton

We propose a framework that can incrementally expand the explanatory temporal logic rule set to explain the occurrence of temporal events. Leveraging the temporal point process modeling and learning framework, the rule content and weights…

Machine Learning · Computer Science 2023-08-14 Chao Yang , Lu Wang , Kun Gao , Shuang Li

We select policies for large Markov Decision Processes (MDPs) with compact first-order representations. We find policies that generalize well as the number of objects in the domain grows, potentially without bound. Existing…

Artificial Intelligence · Computer Science 2013-01-07 Sung Wook Yoon , Alan Fern , Robert Givan

Policy learning for partially observed control tasks requires policies that can remember salient information from past observations. In this paper, we present a method for learning policies with internal memory for high-dimensional,…

Machine Learning · Computer Science 2015-09-24 Marvin Zhang , Zoe McCarthy , Chelsea Finn , Sergey Levine , Pieter Abbeel

Tensor decomposition methods are widely used for model compression and fast inference in convolutional neural networks (CNNs). Although many decompositions are conceivable, only CP decomposition and a few others have been applied in…

Machine Learning · Computer Science 2019-11-28 Kohei Hayashi , Taiki Yamaguchi , Yohei Sugawara , Shin-ichi Maeda

Deep reinforcement learning algorithms are usually impeded by sampling inefficiency, heavily depending on multiple interactions with the environment to acquire accurate decision-making capabilities. In contrast, humans rely on their…

Machine Learning · Computer Science 2024-03-07 Yonggang Jin , Chenxu Wang , Tianyu Zheng , Liuyu Xiang , Yaodong Yang , Junge Zhang , Jie Fu , Zhaofeng He

Decomposition methods have been proposed to approximate solutions to large sequential decision making problems. In contexts where an agent interacts with multiple entities, utility decomposition can be used to separate the global objective…

Machine Learning · Computer Science 2019-04-24 Maxime Bouton , Kyle Julian , Alireza Nakhaei , Kikuo Fujimura , Mykel J. Kochenderfer

We consider task and motion planning in complex dynamic environments for problems expressed in terms of a set of Linear Temporal Logic (LTL) constraints, and a reward function. We propose a methodology based on reinforcement learning that…

Robotics · Computer Science 2017-03-24 Chris Paxton , Vasumathi Raman , Gregory D. Hager , Marin Kobilarov

In this paper, we present an online reinforcement learning algorithm for constrained Markov decision processes with a safety constraint. Despite the necessary attention of the scientific community, considering stochastic stopping time, the…

Machine Learning · Computer Science 2024-03-26 Abhijit Mazumdar , Rafal Wisniewski , Manuela L. Bujorianu