English
Related papers

Related papers: Continuous Control with Action Quantization from D…

200 papers

The emerging field of Reinforcement Learning (RL) has led to impressive results in varied domains like strategy games, robotics, etc. This handout aims to give a simple introduction to RL from control perspective and discuss three possible…

Machine Learning · Computer Science 2021-03-09 Farnaz Adib Yaghmaie , Lennart Ljung

Learning actions that are relevant to decision-making and can be executed effectively is a key problem in autonomous robotics. Current state-of-the-art action representations in robotics lack proper effect-driven learning of the robot's…

Robotics · Computer Science 2024-04-04 Marko Zaric , Jakob Hollenstein , Justus Piater , Erwan Renaudo

Modeling of real-world biological multi-agents is a fundamental problem in various scientific and engineering fields. Reinforcement learning (RL) is a powerful framework to generate flexible and diverse behaviors in cyberspace; however,…

Artificial Intelligence · Computer Science 2023-12-20 Keisuke Fujii , Kazushi Tsutsui , Atom Scott , Hiroshi Nakahara , Naoya Takeishi , Yoshinobu Kawahara

With the fast improvement of machine learning, reinforcement learning (RL) has been used to automate human tasks in different areas. However, training such agents is difficult and restricted to expert users. Moreover, it is mostly limited…

Machine Learning · Computer Science 2023-03-21 André Correia , Luís A. Alexandre

This study evaluates the application of a discrete action space reinforcement learning method (Q-learning) to the continuous control problem of robot inverted pendulum balancing. To speed up the learning process and to overcome technical…

Robotics · Computer Science 2023-12-06 Mohammad Safeea , Pedro Neto

Deep reinforcement learning (RL) has achieved several high profile successes in difficult decision-making problems. However, these algorithms typically require a huge amount of data before they reach reasonable performance. In fact, their…

Safe and efficient autonomous driving maneuvers in an interactive and complex environment can be considerably challenging due to the unpredictable actions of other surrounding agents that may be cooperative or adversarial in their…

Robotics · Computer Science 2019-01-28 Pin Wang , Ching-Yao Chan , Hanhan Li

Reinforcement learning (RL) has been successful in training agents in various learning environments, including video-games. However, such work modifies and shrinks the action space from the game's original. This is to avoid trying…

Artificial Intelligence · Computer Science 2020-05-27 Anssi Kanervisto , Christian Scheller , Ville Hautamäki

Dealing with high variance is a significant challenge in model-free reinforcement learning (RL). Existing methods are unreliable, exhibiting high variance in performance from run to run using different initializations/seeds. Focusing on…

Machine Learning · Computer Science 2019-05-15 Richard Cheng , Abhinav Verma , Gabor Orosz , Swarat Chaudhuri , Yisong Yue , Joel W. Burdick

Developing an agent in reinforcement learning (RL) that is capable of performing complex control tasks directly from high-dimensional observation such as raw pixels is yet a challenge as efforts are made towards improving sample efficiency…

Machine Learning · Computer Science 2023-01-13 Thanh Nguyen , Tung M. Luu , Thang Vu , Chang D. Yoo

Optimal Control for legged robots has gone through a paradigm shift from position-based to torque-based control, owing to the latter's compliant and robust nature. In parallel to this shift, the community has also turned to Deep…

Robotics · Computer Science 2024-09-04 Shivam Sood , Ge Sun , Peizhuo Li , Guillaume Sartoretti

In this article, we sketch an algorithm that extends the Q-learning algorithms to the continuous action space domain. Our method is based on the discretization of the action space. Despite the commonly used discretization methods, our…

Machine Learning · Computer Science 2018-07-25 Peyman Tavallali , Gary B. Doran , Lukas Mandrake

Deep reinforcement learning (RL) models, despite their efficiency in learning an optimal policy in static environments, easily loses previously learned knowledge (i.e., catastrophic forgetting). It leads RL models to poor performance in…

Machine Learning · Computer Science 2025-09-08 Wonseo Jang , Dongjae Kim

We propose a reinforcement learning (RL) scheme for feedback quantum control within the quan-tum approximate optimization algorithm (QAOA). QAOA requires a variational minimization for states constructed by applying a sequence of unitary…

Quantum Physics · Physics 2020-09-23 Matteo M. Wauters , Emanuele Panizon , Glen B. Mbeng , Giuseppe E. Santoro

Quantum reinforcement learning (QRL) is a promising paradigm for near-term quantum devices. While existing QRL methods have shown success in discrete action spaces, extending these techniques to continuous domains is challenging due to the…

Quantum Physics · Physics 2025-03-19 Shaojun Wu , Shan Jin , Dingding Wen , Donghong Han , Xiaoting Wang

In this extended abstract we introduce a novel control-tutored Q-learning approach (CTQL) as part of the ongoing effort in developing model-based and safe RL for continuous state spaces. We validate our approach by applying it to a…

Machine Learning · Computer Science 2019-11-28 Francesco De Lellis , Fabrizia Auletta , Giovanni Russo , Mario di Bernardo

Poor sample efficiency continues to be the primary challenge for deployment of deep Reinforcement Learning (RL) algorithms for real-world applications, and in particular for visuo-motor control. Model-based RL has the potential to be highly…

Machine Learning · Computer Science 2022-12-13 Nicklas Hansen , Yixin Lin , Hao Su , Xiaolong Wang , Vikash Kumar , Aravind Rajeswaran

Model-based reinforcement learning (MBRL) approaches rely on discrete-time state transition models whereas physical systems and the vast majority of control tasks operate in continuous-time. To avoid time-discretization approximation of the…

Machine Learning · Computer Science 2021-06-14 Çağatay Yıldız , Markus Heinonen , Harri Lähdesmäki

We present Reinforcement Learning via Auxiliary Task Distillation (AuxDistill), a new method that enables reinforcement learning (RL) to perform long-horizon robot control problems by distilling behaviors from auxiliary RL tasks. AuxDistill…

Machine Learning · Computer Science 2024-06-26 Abhinav Narayan Harish , Larry Heck , Josiah P. Hanna , Zsolt Kira , Andrew Szot

A reinforcement learning (RL) control policy could fail in a new/perturbed environment that is different from the training environment, due to the presence of dynamic variations. For controlling systems with continuous state and action…

Robotics · Computer Science 2022-08-31 Y. Cheng , P. Zhao , F. Wang , D. J. Block , N. Hovakimyan