English
Related papers

Related papers: Graying the black box: Understanding DQNs

200 papers

We propose a novel hierarchical reinforcement learning framework for control with continuous state and action spaces. In our framework, the user specifies subgoal regions which are subsets of states; then, we (i) learn options that serve as…

Machine Learning · Computer Science 2021-02-26 Kishor Jothimurugan , Osbert Bastani , Rajeev Alur

Quantum computing promises advantages over classical computing. The manufacturing of quantum hardware is in the infancy stage, called the Noisy Intermediate-Scale Quantum (NISQ) era. A major challenge is automated quantum circuit design…

Representation learning methods are an important tool for addressing the challenges posed by complex observations spaces in sequential decision making problems. Recently, many methods have used a wide variety of types of approaches for…

Machine Learning · Computer Science 2025-06-24 Ayoub Echchahed , Pablo Samuel Castro

Reinforcement learning algorithms such as Q-learning have shown great promise in training models to learn the optimal action to take for a given system state; a goal in applications with an exploratory or adversarial nature such as…

Computation and Language · Computer Science 2020-04-08 Xusen Yin , Jonathan May

Reinforcement learning (RL) has been demonstrated to have great potential in many applications of scientific discovery and design. Recent work includes, for example, the design of new structures and compositions of molecules for therapeutic…

Machine Learning · Computer Science 2020-04-17 Colin Bellinger , Rory Coles , Mark Crowley , Isaac Tamblyn

Learning how to act when there are many available actions in each state is a challenging task for Reinforcement Learning (RL) agents, especially when many of the actions are redundant or irrelevant. In such cases, it is sometimes easier to…

Machine Learning · Computer Science 2019-02-26 Tom Zahavy , Matan Haroush , Nadav Merlis , Daniel J. Mankowitz , Shie Mannor

We propose a distributed deep learning model to successfully learn control policies directly from high-dimensional sensory input using reinforcement learning. The model is based on the deep Q-network, a convolutional neural network trained…

Machine Learning · Computer Science 2015-10-16 Hao Yi Ong , Kevin Chavez , Augustus Hong

Recent studies have greatly improved reinforcement learning, and an increased interest in real-world implementation has emerged. In many cases, the implementation is challenged by time-varying disturbances as it introduces hidden states,…

Machine Learning · Computer Science 2026-03-04 Saki Omi , Hyo-Sang Shin , Namhoon Cho , Antonios Tsourdos

Humans and most animals inherently possess a distinctive capacity to continually acquire novel experiences and accumulate worldly knowledge over time. This ability, termed continual learning, is also critical for deep neural networks (DNNs)…

Machine Learning · Computer Science 2025-04-22 Geng Liu , Fei Zhu , Rong Feng , Zhiqiang Yi , Shiqi Wang , Gaofeng Meng , Zhaoxiang Zhang

This paper offers a new hybrid probably approximately correct (PAC) reinforcement learning (RL) algorithm for Markov decision processes (MDPs) that intelligently maintains favorable features of its parents. The designed algorithm, referred…

Machine Learning · Computer Science 2021-01-29 Ashkan Zehfroosh , Herbert G. Tanner

Making sophisticated, robust, and safe sequential decisions is at the heart of intelligent systems. This is especially critical for planning in complex multi-agent environments, where agents need to anticipate other agents' intentions and…

Robotics · Computer Science 2020-01-29 Yichuan Charlie Tang

Deep RL approaches build much of their success on the ability of the deep neural network to generate useful internal representations. Nevertheless, they suffer from a high sample-complexity and starting with a good input representation can…

Machine Learning · Computer Science 2021-02-17 Vikram Waradpande , Daniel Kudenko , Megha Khosla

Deep learning has revolutionized many areas of machine learning, from computer vision to natural language processing, but these high-performance models are generally "black box." Explaining such models would improve transparency and trust…

Machine Learning · Computer Science 2023-05-18 Daniel Lundstrom , Meisam Razaviyayn

The need for consistent treatment of uncertainty has recently triggered increased interest in probabilistic deep learning methods. However, most current approaches have severe limitations when it comes to inference, since many of these…

There have been numerous breakthroughs with reinforcement learning in the recent years, perhaps most notably on Deep Reinforcement Learning successfully playing and winning relatively advanced computer games. There is undoubtedly an…

Artificial Intelligence · Computer Science 2017-12-19 Per-Arne Andersen , Morten Goodwin , Ole-Christoffer Granmo

Deep reinforcement learning (RL) has recently led to many breakthroughs on a range of complex control tasks. However, the agent's decision-making process is generally not transparent. The lack of interpretability hinders the applicability…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Wenjie Shi , Gao Huang , Shiji Song , Zhuoyuan Wang , Tingyu Lin , Cheng Wu

State representation learning aims to capture latent factors of an environment. Contrastive methods have performed better than generative models in previous state representation learning research. Although some researchers realize the…

Machine Learning · Computer Science 2023-03-15 Li Meng , Morten Goodwin , Anis Yazidi , Paal Engelstad

Deep reinforcement learning is poised to revolutionise the field of AI and represents a step towards building autonomous systems with a higher level understanding of the visual world. Currently, deep learning is enabling reinforcement…

Machine Learning · Computer Science 2017-11-15 Kai Arulkumaran , Marc Peter Deisenroth , Miles Brundage , Anil Anthony Bharath

Deep learning (DL) enables deep neural networks (DNNs) to automatically learn complex tasks or rules from given examples without instructions or guiding principles. As we do not engineer DNNs' functions, it is extremely difficult to…

Machine Learning · Computer Science 2024-11-19 Jung H. Lee , Sujith Vijayan

A long-standing goal in deep learning has been to characterize the learning behavior of black-box models in a more interpretable manner. For graph neural networks (GNNs), considerable advances have been made in formalizing what functions…

Machine Learning · Computer Science 2024-06-19 Chenxiao Yang , Qitian Wu , David Wipf , Ruoyu Sun , Junchi Yan