English
Related papers

Related papers: Deep Abstract Q-Networks

200 papers

Large Reasoning Models (LRMs) have demonstrated impressive capabilities but suffer from cognitive inefficiencies like "overthinking" simple problems and "underthinking" complex ones. While existing methods that use supervised fine-tuning…

Artificial Intelligence · Computer Science 2026-03-24 Tian Liang , Wenxiang Jiao , Zhiwei He , Jiahao Xu , Haitao Mi , Dong Yu

Long-horizon robotic manipulation remains challenging for reinforcement learning (RL) because sparse rewards provide limited guidance for credit assignment. Practical policy improvement thus relies on richer intermediate supervision, such…

Robotics · Computer Science 2026-04-22 Yiming Mao , Zixi Yu , Weixin Mao , Yinhao Li , Qirui Hu , Zihan Lan , Minzhao Zhu , Hua Chen

In the context of addressing the Robot Air Hockey Challenge 2023, we investigate the applicability of model-based deep reinforcement learning to acquire a policy capable of autonomously playing air hockey. Our agents learn solely from…

Robotics · Computer Science 2024-06-04 Andrej Orsula

We investigate the hardness of online reinforcement learning in fixed horizon, sparse linear Markov decision process (MDP), with a special focus on the high-dimensional regime where the ambient dimension is larger than the number of…

Machine Learning · Computer Science 2021-02-11 Botao Hao , Tor Lattimore , Csaba Szepesvári , Mengdi Wang

Building systems that autonomously create temporal abstractions from data is a key challenge in scaling learning and planning in reinforcement learning. One popular approach for addressing this challenge is the options framework (Sutton et…

Machine Learning · Computer Science 2020-01-01 Matthew Riemer , Miao Liu , Gerald Tesauro

Diffusion models have achieved remarkable success in text-to-image generation. However, their practical applications are hindered by the misalignment between generated images and corresponding text prompts. To tackle this issue,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Zijing Hu , Fengda Zhang , Long Chen , Kun Kuang , Jiahui Li , Kaifeng Gao , Jun Xiao , Xin Wang , Wenwu Zhu

In recent years, there have been many deep structures for Reinforcement Learning, mainly for value function estimation and representations. These methods achieved great success in Atari 2600 domain. In this paper, we propose an improved…

Machine Learning · Computer Science 2022-04-28 Alireza Nadali , Mohammad Mehdi Ebadzadeh

Learning an effective representation for high-dimensional data is a challenging problem in reinforcement learning (RL). Deep reinforcement learning (DRL) such as Deep Q networks (DQN) achieves remarkable success in computer games by…

Machine Learning · Computer Science 2019-05-10 Borislav Mavrin , Hengshuai Yao , Linglong Kong

Inverse reinforcement learning (IRL) has progressed significantly toward accurately learning the underlying rewards in both discrete and continuous domains from behavior data. The next advance is to learn {\em intrinsic} preferences in ways…

Machine Learning · Computer Science 2026-05-28 Yikang Gui , Prashant Doshi

The growing interest in complex decision-making and language modeling problems highlights the importance of sample-efficient learning over very long horizons. This work takes a step in this direction by investigating contextual linear…

Machine Learning · Computer Science 2023-02-07 Yuzhen Qin , Yingcong Li , Fabio Pasqualetti , Maryam Fazel , Samet Oymak

The ability to abstract, count, and use System~2 reasoning are well-known manifestations of intelligence and understanding. In this paper, we argue, using the example of the ``Look and Say" puzzle, that although deep neural networks can…

Artificial Intelligence · Computer Science 2022-03-22 Wlodek W. Zadrozny

Deep reinforcement learning, applied to vision-based problems like Atari games, maps pixels directly to actions; internally, the deep neural network bears the responsibility of both extracting useful information and making decisions based…

Machine Learning · Computer Science 2019-03-05 Giuseppe Cuccu , Julian Togelius , Philippe Cudre-Mauroux

Deep Reinforcement Learning (RL) recently emerged as one of the most competitive approaches for learning in sequential decision making problems with fully observable environments, e.g., computer Go. However, very little work has been done…

Machine Learning · Computer Science 2018-05-09 Pengfei Zhu , Xin Li , Pascal Poupart , Guanghui Miao

Deep Reinforcement Learning (RL) recently emerged as one of the most competitive approaches for learning in sequential decision making problems with fully observable environments, e.g., computer Go. However, very little work has been done…

Machine Learning · Computer Science 2018-05-25 Pengfei Zhu , Xin Li , Pascal Poupart , Guanghui Miao

The challenges inherent in long-horizon tasks in robotics persist due to the typical inefficient exploration and sparse rewards in traditional reinforcement learning approaches. To address these challenges, we have developed a novel…

Recent reinforcement learning (RL) approaches have shown strong performance in complex domains such as Atari games, but are often highly sample inefficient. A common approach to reduce interaction time with the environment is to use reward…

Machine Learning · Computer Science 2019-06-03 Prasoon Goyal , Scott Niekum , Raymond J. Mooney

Efficient control in long-horizon robotic manipulation is challenging due to complex representation and policy learning requirements. Model-based visual reinforcement learning (RL) has shown great potential in addressing these challenges…

Robotics · Computer Science 2025-01-27 Zixuan Chen , Jing Huo , Yangtao Chen , Yang Gao

This paper reviews exploration techniques in deep reinforcement learning. Exploration techniques are of primary importance when solving sparse reward problems. In sparse reward problems, the reward is rare, which means that the agent will…

Machine Learning · Computer Science 2022-05-03 Pawel Ladosz , Lilian Weng , Minwoo Kim , Hyondong Oh

Recent advances in vision-based navigation and exploration have shown impressive capabilities in photorealistic indoor environments. However, these methods still struggle with long-horizon tasks and require large amounts of data to…

Robotics · Computer Science 2022-08-25 Fabian Schmalstieg , Daniel Honerkamp , Tim Welschehold , Abhinav Valada

Although deep reinforcement learning methods can learn effective policies for challenging problems such as Atari games and robotics tasks, algorithms are complex, and training times are often long. This study investigates how Evolution…

Machine Learning · Computer Science 2024-07-25 Annie Wong , Jacob de Nobel , Thomas Bäck , Aske Plaat , Anna V. Kononova