English
Related papers

Related papers: ConQUR: Mitigating Delusional Bias in Deep Q-learn…

200 papers

Reinforcement Learning in domains with sparse rewards is a difficult problem, and a large part of the training process is often spent searching the state space in a more or less random fashion for any learning signals. For control problems,…

Machine Learning · Computer Science 2019-11-22 Eivind Bøhn , Signe Moe , Tor Arne Johansen

Reinforcement learning is a model-free optimal control method that optimizes a control policy through direct interaction with the environment. For reaching tasks that end in regulation, popular discrete-action methods are not well suited…

Robotics · Computer Science 2021-06-23 Wouter Caarls

Q-learning is one of the most well-known Reinforcement Learning algorithms. There have been tremendous efforts to develop this algorithm using neural networks. Bootstrapped Deep Q-Learning Network is amongst them. It utilizes multiple…

Machine Learning · Computer Science 2024-06-25 Li Meng , Morten Goodwin , Anis Yazidi , Paal Engelstad

$Q$-learning is one of the most fundamental reinforcement learning (RL) algorithms. Despite its widespread success in various applications, it is prone to overestimation bias in the $Q$-learning update. To address this issue, double…

Machine Learning · Computer Science 2026-01-13 Hyunjun Na , Donghwan Lee

Deep learning systems are prone to catastrophic forgetting when learning from a sequence of tasks, as old data from previous tasks is unavailable when learning a new task. To address this, some methods propose replaying data from previous…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Chenyang Wang , Junjun Jiang , Xingyu Hu , Xianming Liu , Xiangyang Ji

Partial label learning (PLL) is a typical weakly supervised learning framework, where each training instance is associated with a candidate label set, among which only one label is valid. To solve PLL problems, typically methods try to…

Machine Learning · Computer Science 2023-12-25 Bo-Shi Zou , Ming-Kun Xie , Sheng-Jun Huang

This paper studies reinforcement learning (RL) under malicious falsification on cost signals and introduces a quantitative framework of attack models to understand the vulnerabilities of RL. Focusing on $Q$-learning, we show that…

Machine Learning · Computer Science 2019-08-20 Yunhan Huang , Quanyan Zhu

To collect large scale annotated data, it is inevitable to introduce label noise, i.e., incorrect class labels. To be robust against label noise, many successful methods rely on the noisy classifiers (i.e., models trained on the noisy…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Songzhu Zheng , Pengxiang Wu , Aman Goswami , Mayank Goswami , Dimitris Metaxas , Chao Chen

Reinforcement learning agents learn by encouraging behaviours which maximize their total reward, usually provided by the environment. In many environments, however, the reward is provided after a series of actions rather than each single…

Artificial Intelligence · Computer Science 2022-01-04 Mohammad Reza Bonyadi , Rui Wang , Maryam Ziaei

We introduce a novel method for training machine learning models in the presence of noisy labels, which are prevalent in domains such as medical diagnosis and autonomous driving and have the potential to degrade a model's generalization…

Machine Learning · Computer Science 2024-06-26 Farooq Ahmad Wani , Maria Sofia Bucarelli , Fabrizio Silvestri

Recent research has revealed that deep neural networks often take dataset biases as a shortcut to make decisions rather than understand tasks, leading to failures in real-world applications. In this study, we focus on the spurious…

Computation and Language · Computer Science 2023-06-23 Yanrui Du , Jing Yan , Yan Chen , Jing Liu , Sendong Zhao , Qiaoqiao She , Hua Wu , Haifeng Wang , Bing Qin

Medical treatments often involve a sequence of decisions, each informed by previous outcomes. This process closely aligns with reinforcement learning (RL), a framework for optimizing sequential decisions to maximize cumulative rewards under…

Machine Learning · Computer Science 2024-10-15 Ali Shirali , Alexander Schubert , Ahmed Alaa

Federated learning is vulnerable to poisoning and backdoor attacks under partial observability. We formulate defence as a partially observable sequential decision problem and introduce a trust-aware Deep Q-Network that integrates…

Machine Learning · Computer Science 2025-10-03 Vedant Palit

Overestimation bias control techniques are used by the majority of high-performing off-policy reinforcement learning algorithms. However, most of these techniques rely on pre-defined bias correction policies that are either not flexible…

Machine Learning · Computer Science 2022-02-01 Arsenii Kuznetsov , Alexander Grishin , Artem Tsypin , Arsenii Ashukha , Artur Kadurin , Dmitry Vetrov

Existing on-policy imitation learning algorithms, such as DAgger, assume access to a fixed supervisor. However, there are many settings where the supervisor may evolve during policy learning, such as a human performing a novel task or an…

Machine Learning · Computer Science 2020-05-19 Ashwin Balakrishna , Brijen Thananjeyan , Jonathan Lee , Felix Li , Arsh Zahed , Joseph E. Gonzalez , Ken Goldberg

Employing one or more additional classifiers to break the self-learning loop in tracing-by-detection has gained considerable attention. Most of such trackers merely utilize the redundancy to address the accumulating label error in the…

Computer Vision and Pattern Recognition · Computer Science 2019-02-15 Kourosh Meshgi , Maryam Sadat Mirzaei , Shigeyuki Oba

In standard passive imitation learning, the goal is to learn a target policy by passively observing full execution trajectories of it. Unfortunately, generating such trajectories can require substantial expert effort and be impractical in…

Machine Learning · Computer Science 2012-10-19 Kshitij Judah , Alan Fern , Thomas G. Dietterich

Deep neural networks are highly susceptible to overfitting noisy labels, which leads to degraded performance. Existing methods address this issue by employing manually defined criteria, aiming to achieve optimal partitioning in each…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Wenzhen Zhang , Debo Cheng , Guangquan Lu , Bo Zhou , Jiaye Li , Shichao Zhang

Majority of state-of-the-art deep learning methods are discriminative approaches, which model the conditional distribution of labels given inputs features. The success of such approaches heavily depends on high-quality labeled instances,…

Machine Learning · Computer Science 2019-09-13 Yanwu Xu , Mingming Gong , Junxiang Chen , Tongliang Liu , Kun Zhang , Kayhan Batmanghelich

In this work, we study the deception of a Linear-Quadratic-Gaussian (LQG) agent by manipulating the cost signals. We show that a small falsification of the cost parameters will only lead to a bounded change in the optimal policy. The bound…

Systems and Control · Electrical Eng. & Systems 2022-04-08 Yunhan Huang , Quanyan Zhu
‹ Prev 1 4 5 6 7 8 10 Next ›