English
Related papers

Related papers: Full Gradient DQN Reinforcement Learning: A Provab…

200 papers

Stochastic gradient methods are among the most important algorithms in training machine learning problems. While classical assumptions such as strong convexity allow a simple analysis they are rarely satisfied in applications. In recent…

Machine Learning · Computer Science 2025-03-18 Simon Weissmann , Sara Klein , Waïss Azizian , Leif Döring

Distortion Risk Measures (DRMs) capture risk preferences in decision-making and serve as general criteria for managing uncertainty. This paper proposes gradient descent algorithms for DRM optimization based on two dual representations: the…

Machine Learning · Computer Science 2025-10-07 Jinyang Jiang , Bernd Heidergott , Jiaqiao Hu , Yijie Peng

Reinforcement learning is a powerful approach for training an optimal policy to solve complex problems in a given system. This project aims to demonstrate the application of reinforcement learning in stochastic process environments with…

Machine Learning · Computer Science 2023-08-08 Kuangheng He

Deep Reinforcement Learning (RL) is unquestionably a robust framework to train autonomous agents in a wide variety of disciplines. However, traditional deep and shallow model-free RL algorithms suffer from low sample efficiency and…

Machine Learning · Computer Science 2022-10-05 Per-Arne Andersen , Ole-Christoffer Granmo , Morten Goodwin

Reinforcement learning methods typically use Deep Neural Networks to approximate the value functions and policies underlying a Markov Decision Process. Unfortunately, DNN-based RL suffers from a lack of explainability of the resulting…

Systems and Control · Electrical Eng. & Systems 2022-05-19 Shambhuraj Sawant , Sebastien Gros

Deep reinforcement learning has been applied more and more widely nowadays, especially in various complex control tasks. Effective exploration for noisy networks is one of the most important issues in deep reinforcement learning. Noisy…

Machine Learning · Computer Science 2020-06-22 Shuai Han , Wenbo Zhou , Jing Liu , Shuai Lü

This book aims to provide an introduction to the topic of deep learning algorithms. We review essential components of deep learning algorithms in full mathematical detail including different artificial neural network (ANN) architectures…

Machine Learning · Computer Science 2025-07-17 Arnulf Jentzen , Benno Kuckuck , Philippe von Wurstemberger

We consider the development of practical stochastic quasi-Newton, and in particular Kronecker-factored block-diagonal BFGS and L-BFGS methods, for training deep neural networks (DNNs). In DNN training, the number of variables and components…

Machine Learning · Computer Science 2021-01-11 Donald Goldfarb , Yi Ren , Achraf Bahamou

We propose a new way of deriving policy gradient updates for reinforcement learning. Our technique, based on Fourier analysis, recasts integrals that arise with expected policy gradients as convolutions and turns them into multiplications.…

Machine Learning · Computer Science 2018-05-31 Matthew Fellows , Kamil Ciosek , Shimon Whiteson

In this article, we introduce and analyze a deep learning based approximation algorithm for SPDEs. Our approach employs neural networks to approximate the solutions of SPDEs along given realizations of the driving noise process. If applied…

Numerical Analysis · Mathematics 2025-10-21 Christian Beck , Sebastian Becker , Patrick Cheridito , Arnulf Jentzen , Ariel Neufeld

In deep reinforcement learning (RL), adversarial attacks can trick an agent into unwanted states and disrupt training. We propose a system called Robust Student-DQN (RS-DQN), which permits online robustness training alongside Q networks,…

Machine Learning · Computer Science 2019-11-25 Marc Fischer , Matthew Mirman , Steven Stalder , Martin Vechev

Training deep neural networks for solving machine learning problems is one great challenge in the field, mainly due to its associated optimisation problem being highly non-convex. Recent developments have suggested that many training…

Machine Learning · Computer Science 2017-11-23 Hao Shen

Despite a large amount of attention on adversarial examples, very few works have demonstrated an effective defense against this threat. We examine Deep k-Nearest Neighbor (DkNN), a proposed defense that combines k-Nearest Neighbor (kNN) and…

Cryptography and Security · Computer Science 2019-03-21 Chawin Sitawarin , David Wagner

Reinforcement learning agents are faced with two types of uncertainty. Epistemic uncertainty stems from limited data and is useful for exploration, whereas aleatoric uncertainty arises from stochastic environments and must be accounted for…

Machine Learning · Computer Science 2020-09-10 William R. Clements , Bastien Van Delft , Benoît-Marie Robaglia , Reda Bahi Slaoui , Sébastien Toth

Ordinary Differential Equations are generally too complex to be solved analytically. Approximations thereof can be obtained by general purpose numerical methods. However, even though accurate schemes have been developed, they remain…

Numerical Analysis · Mathematics 2023-04-19 Maxime Bouchereau , Philippe Chartier , Mohammed Lemou , Florian Méhats

Large-scale deep neural networks (DNNs) have achieved remarkable success in many application scenarios. However, high computational complexity and energy costs of modern DNNs make their deployment on edge devices challenging. Model…

Machine Learning · Computer Science 2024-04-29 Cédric Gernigon , Silviu-Ioan Filip , Olivier Sentieys , Clément Coggiola , Mickael Bruno

Deep Q Network (DQN) is a very successful algorithm, yet the inherent problem of reinforcement learning, i.e. the exploit-explore balance, remains. In this work, we introduce entropy regularization into DQN and propose SQN. We find that the…

Machine Learning · Computer Science 2020-12-15 Jingbin Liu , Shuai Liu , Xinyang Gu

In this paper, we introduce the Reinforced Mnemonic Reader for machine reading comprehension tasks, which enhances previous attentive readers in two aspects. First, a reattention mechanism is proposed to refine current attentions by…

Computation and Language · Computer Science 2018-06-07 Minghao Hu , Yuxing Peng , Zhen Huang , Xipeng Qiu , Furu Wei , Ming Zhou

A key task in Artificial Intelligence is learning effective policies for controlling agents in unknown environments to optimize performance measures. Off-policy learning methods, like Q-learning, allow learners to make optimal decisions…

Artificial Intelligence · Computer Science 2025-10-27 Mingxuan Li , Junzhe Zhang , Elias Bareinboim

Over the past decade, remarkable progress has been made in adopting deep neural networks to enhance the performance of conventional reinforcement learning. A notable milestone was the development of Deep Q-Networks (DQN), which achieved…

Systems and Control · Electrical Eng. & Systems 2025-07-14 Klinsmann Agyei , Pouria Sarhadi , Daniel Polani