English
Related papers

Related papers: NFQ2.0: The CartPole Benchmark Revisited

200 papers

Despite the proliferation of diverse hardware accelerators (e.g., NPU, TPU, DPU), deploying deep learning models on edge devices with fixed-point hardware is still challenging due to complex model quantization and conversion. Existing model…

Machine Learning · Computer Science 2023-08-07 Manasa Manohara , Sankalp Dayal , Tariq Afzal , Rahul Bakshi , Kahkuen Fu

Using deep neural nets as function approximator for reinforcement learning tasks have recently been shown to be very powerful for solving problems approaching real-world complexity. Using these results as a benchmark, we discuss the role…

Machine Learning · Computer Science 2016-01-21 Vincent François-Lavet , Raphael Fonteneau , Damien Ernst

The deep reinforcement learning method usually requires a large number of training images and executing actions to obtain sufficient results. When it is extended a real-task in the real environment with an actual robot, the method will be…

Computer Vision and Pattern Recognition · Computer Science 2018-06-05 Daiki Kimura

Considering its advantages in dealing with high-dimensional visual input and learning control policies in discrete domain, Deep Q Network (DQN) could be an alternative method of traditional auto-focus means in the future. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Xiaofan Yu , Runze Yu , Jingsong Yang , Xiaohui Duan

Deep Q-Network (DQN) marked a major milestone for reinforcement learning, demonstrating for the first time that human-level control policies could be learned directly from raw visual inputs via reward maximization. Even years after its…

Machine Learning · Computer Science 2021-11-03 Brett Daley , Christopher Amato

There is increasing interest in data-driven approaches for recommending optimal treatment strategies in many chronic disease management and critical care applications. Reinforcement learning methods are well-suited to this sequential…

Machine Learning · Computer Science 2023-06-14 Milashini Nambiar , Supriyo Ghosh , Priscilla Ong , Yu En Chan , Yong Mong Bee , Pavitra Krishnaswamy

Deep Q-learning Network (DQN) is a successful way which combines reinforcement learning with deep neural networks and leads to a widespread application of reinforcement learning. One challenging problem when applying DQN or other…

Machine Learning · Computer Science 2022-09-19 Zhe Zhang , Yukun Zou , Junjie Lai , Qing Xu

Operating deep neural networks on devices with limited resources requires the reduction of their memory footprints and computational requirements. In this paper we introduce a training method, called look-up table quantization, LUT-Q, which…

Neural networks allow Q-learning reinforcement learning agents such as deep Q-networks (DQN) to approximate complex mappings from state spaces to value functions. However, this also brings drawbacks when compared to other function…

Machine Learning · Computer Science 2018-06-21 Jack Shannon , Marek Grzes

Reinforcement Learning (RL) is currently one of the most commonly used techniques for traffic signal control (TSC), which can adaptively adjusted traffic signal phase and duration according to real-time traffic data. However, a fully…

Computer Science and Game Theory · Computer Science 2023-01-03 Yuli. Zhang , Shangbo. Wang , Ruiyuan. Jiang

Recent advances in quantum computing (QC) and machine learning (ML) have drawn significant attention to the development of quantum machine learning (QML). Reinforcement learning (RL) is one of the ML paradigms which can be used to solve…

Quantum Physics · Physics 2022-10-27 Samuel Yen-Chi Chen

The $Q$-function is a central quantity in many Reinforcement Learning (RL) algorithms for which RL agents behave following a (soft)-greedy policy w.r.t. to $Q$. It is a powerful tool that allows action selection without a model of the…

Machine Learning · Computer Science 2022-06-01 Nino Vieillard , Marcin Andrychowicz , Anton Raichuk , Olivier Pietquin , Matthieu Geist

Traditional power grid systems have become obsolete under more frequent and extreme natural disasters. Reinforcement learning (RL) has been a promising solution for resilience given its successful history of power grid control. However,…

Machine Learning · Computer Science 2022-12-09 Zhenting Zhao , Po-Yen Chen , Yucheng Jin

Offline Reinforcement Learning (RL) focuses on learning policies solely from a batch of previously collected data. offering the potential to leverage such datasets effectively without the need for costly or risky active exploration. While…

Machine Learning · Computer Science 2025-06-06 Riccardo Zamboni , Enrico Brunetti , Marcello Restelli

Real-world reinforcement learning tasks often involve some form of partial observability where the observations only give a partial or noisy view of the true state of the world. Such tasks typically require some form of memory, where the…

Machine Learning · Computer Science 2022-11-11 Kevin Esslinger , Robert Platt , Christopher Amato

With the rapid advent of quantum computing, hybrid quantum-classical machine learning has shown promising computational advantages in many key fields. Quantum reinforcement learning, as one of the most challenging tasks, has recently…

Quantum Physics · Physics 2024-03-06 BAQIS Quafu Group

Nonlinear model predictive control (NMPC) has proven to be an effective control method, but it is expensive to compute. This work demonstrates the use of hardware FPGA neural network controllers trained to imitate NMPC with supervised…

Robotics · Computer Science 2024-07-12 Marcin Paluch , Florian Bolli , Xiang Deng , Antonio Rios Navarro , Chang Gao , Tobi Delbruck

We present APQ for efficient deep learning inference on resource-constrained hardware. Unlike previous methods that separately search the neural architecture, pruning policy, and quantization policy, we optimize them in a joint manner. To…

Machine Learning · Computer Science 2020-06-16 Tianzhe Wang , Kuan Wang , Han Cai , Ji Lin , Zhijian Liu , Song Han

A Temporal Neural Network (TNN) architecture for implementing efficient online reinforcement learning is proposed and studied via simulation. The proposed T-learning system is composed of a frontend TNN that implements online unsupervised…

Neural and Evolutionary Computing · Computer Science 2022-04-13 James E. Smith

The current success of Reinforcement Learning algorithms for its performance in complex environments has inspired many recent theoretical approaches to cognitive science. Artistic environments are studied within the cognitive science…

Robotics · Computer Science 2024-02-02 Raul Fernandez-Fernandez , Juan G. Victores , Carlos Balaguer