中文
相关论文

相关论文: Self-correcting Q-Learning

200 篇论文

We present an approach called Q-probing to adapt a pre-trained language model to maximize a task-specific reward function. At a high level, Q-probing sits between heavier approaches such as finetuning and lighter approaches such as few shot…

机器学习 · 计算机科学 2024-06-04 Kenneth Li , Samy Jelassi , Hugh Zhang , Sham Kakade , Martin Wattenberg , David Brandfonbrener

Deep Q-Learning (DQL), a family of temporal difference algorithms for control, employs three techniques collectively known as the `deadly triad' in reinforcement learning: bootstrapping, off-policy learning, and function approximation.…

机器学习 · 计算机科学 2019-03-22 Joshua Achiam , Ethan Knight , Pieter Abbeel

We study whether the learning rate $\alpha$, the discount factor $\gamma$ and the reward signal $r$ have an influence on the overestimation bias of the Q-Learning algorithm. Our preliminary results in environments which are stochastic and…

机器学习 · 统计学 2022-10-12 Julius Wagenbach , Matthia Sabatelli

Fault-tolerant deep learning accelerator is the basis for highly reliable deep learning processing and critical to deploy deep learning in safety-critical applications such as avionics and robotics. Since deep learning is known to be…

硬件体系结构 · 计算机科学 2023-12-22 Qing Zhang , Cheng Liu , Bo Liu , Haitong Huang , Ying Wang , Huawei Li , Xiaowei Li

This paper studies accelerated algorithms for Q-learning. We propose an acceleration scheme by incorporating the historical iterates of the Q-function. The idea is conceptually inspired by the momentum-based acceleration methods in the…

系统与控制 · 电气工程与系统科学 2019-10-28 Bowen Weng , Lin Zhao , Huaqing Xiong , Wei Zhang

This paper explores the problem of simultaneously learning a value function and policy in deep actor-critic reinforcement learning models. We find that the common practice of learning these functions jointly is sub-optimal, due to an…

机器学习 · 计算机科学 2022-11-15 Matthew Aitchison , Penny Sweetser

This paper introduces Q-learning with gradient target tracking, a novel reinforcement learning framework that provides a learned continuous target update mechanism as an alternative to the conventional hard update paradigm. In the standard…

机器学习 · 计算机科学 2025-07-21 Bum Geun Park , Taeho Lee , Donghwan Lee

Q-learning is widely used to optimize wireless networks with unknown system dynamics. Recent advancements include ensemble multi-environment hybrid Q-learning algorithms, which utilize multiple Q-learning algorithms across structurally…

信号处理 · 电气工程与系统科学 2024-09-02 Talha Bozkus , Urbashi Mitra

The study of unsupervised learning can be generally divided into two categories: imitation learning and reinforcement learning. In imitation learning the machine learns by mimicking the behavior of an expert system whereas in reinforcement…

机器学习 · 计算机科学 2020-04-07 Xiao Lei Zhang , Anish Agarwal

Instability and variability of Deep Reinforcement Learning (DRL) algorithms tend to adversely affect their performance. Averaged-DQN is a simple extension to the DQN algorithm, based on averaging previously learned Q-values estimates, which…

人工智能 · 计算机科学 2017-03-13 Oron Anschel , Nir Baram , Nahum Shimkin

We develop methodology for a multistage decision problem with flexible number of stages in which the rewards are survival times that are subject to censoring. We present a novel Q-learning algorithm that is adjusted for censored data and…

统计理论 · 数学 2012-05-31 Yair Goldberg , Michael R. Kosorok

In this paper, an operating system scheduling algorithm based on Double DQN (Double Deep Q network) is proposed, and its performance under different task types and system loads is verified by experiments. Compared with the traditional…

机器学习 · 计算机科学 2025-04-01 Xiaoxuan Sun , Yifei Duan , Yingnan Deng , Fan Guo , Guohui Cai , Yuting Peng

In human decision-making tasks, individuals learn through trials and prediction errors. When individuals learn the task, some are more influenced by good outcomes, while others weigh bad outcomes more heavily. Such confirmation bias can…

机器学习 · 计算机科学 2024-08-09 Jiacheng Shen , Lihan Feng

Q-learning is known as one of the fundamental reinforcement learning (RL) algorithms. Its convergence has been the focus of extensive research over the past several decades. Recently, a new finitetime error bound and analysis for Q-learning…

系统与控制 · 电气工程与系统科学 2024-01-17 Donghwna Lee

With the development of experimental quantum technology, quantum control has attracted increasing attention due to the realization of controllable artificial quantum systems. However, because quantum-mechanical systems are often too…

量子物理 · 物理学 2022-12-22 Zhikang Wang

We show that deep reinforcement learning algorithms can retain their ability to learn without resetting network parameters in settings where the number of gradient updates greatly exceeds the number of environment samples by combatting…

机器学习 · 计算机科学 2024-08-06 Marcel Hussing , Claas Voelcker , Igor Gilitschenski , Amir-massoud Farahmand , Eric Eaton

Deep Q Network (DQN) has several limitations when applied in planning a path in environment with a number of dilemmas according to our experiment. The reward function may be hard to model, and successful experience transitions are difficult…

机器人学 · 计算机科学 2021-07-26 Fei Zhang , Chaochen Gu , Feng Yang

Currently, many applications in Machine Learning are based on define new models to extract more information about data, In this case Deep Reinforcement Learning with the most common application in video games like Atari, Mario, and others…

机器学习 · 计算机科学 2019-10-21 Felipe Moreno-Vera

Considering its advantages in dealing with high-dimensional visual input and learning control policies in discrete domain, Deep Q Network (DQN) could be an alternative method of traditional auto-focus means in the future. In this paper,…

计算机视觉与模式识别 · 计算机科学 2018-09-11 Xiaofan Yu , Runze Yu , Jingsong Yang , Xiaohui Duan

Robots find extensive applications in industry. In recent years, the influence of robots has also increased rapidly in domestic scenarios. The Q-learning algorithm aims to maximise the reward for reaching the goal. This paper proposes a…

机器人学 · 计算机科学 2024-09-04 Varun Prakash Rajamohan , Senthil Kumar Jagatheesaperumal