English
Related papers

Related papers: Consistent Dropout for Policy Gradient Reinforceme…

200 papers

This article provides a rigorous analysis of convergence and stability of Episodic Upside-Down Reinforcement Learning, Goal-Conditioned Supervised Learning and Online Decision Transformers. These algorithms performed competitively across…

Dropout is a simple but efficient regularization technique for achieving better generalization of deep neural networks (DNNs); hence it is widely used in tasks based on DNNs. During training, dropout randomly discards a portion of the…

Neural and Evolutionary Computing · Computer Science 2020-10-22 Hiroshi Inoue

Recurrent neural networks (RNNs) stand at the forefront of many recent developments in deep learning. Yet a major difficulty with these models is their tendency to overfit, with dropout shown to fail when applied to recurrent layers. Recent…

Machine Learning · Statistics 2016-10-06 Yarin Gal , Zoubin Ghahramani

Deep time series models are vulnerable to noisy data ubiquitous in real-world applications. Existing robustness strategies either prune data or rely on costly prior quantification, failing to balance effectiveness and efficiency. In this…

Artificial Intelligence · Computer Science 2026-05-26 Siru Zhong , Yiqiu Liu , Zhiqing Cui , Zezhi Shao , Fei Wang , Qingsong Wen , Yuxuan Liang

Recurrent neural networks (RNNs) with Long Short-Term memory cells currently hold the best known results in unconstrained handwriting recognition. We show that their performance can be greatly improved using dropout - a recently proposed…

Computer Vision and Pattern Recognition · Computer Science 2014-03-11 Vu Pham , Théodore Bluche , Christopher Kermorvant , Jérôme Louradour

Neural networks are often over-parameterized and hence benefit from aggressive regularization. Conventional regularization methods, such as Dropout or weight decay, do not leverage the structures of the network's inputs and hidden states.…

Machine Learning · Computer Science 2021-01-07 Hieu Pham , Quoc V. Le

The performance of a deep neural network is highly dependent on its training, and finding better local optimal solutions is the goal of many optimization algorithms. However, existing optimization algorithms show a preference for descent…

Computer Vision and Pattern Recognition · Computer Science 2019-12-06 Huangxing Lin , Weihong Zeng , Xinghao Ding , Yue Huang , Chenxi Huang , John Paisley

Dropout and DropConnect are well-known techniques that apply a consistent drop rate to randomly deactivate neurons or edges in a neural network layer during training. This paper introduces a novel methodology that assigns dynamic drop rates…

Machine Learning · Computer Science 2025-02-28 Yuan-Chih Yang , Hung-Hsuan Chen

Deep neural networks are typically trained by uniformly sampling large datasets across epochs, despite evidence that not all samples contribute equally throughout learning. Recent work shows that progressively reducing the amount of…

Machine Learning · Computer Science 2026-04-15 Amar Gahir , Varshil Patel , Shreyank N Gowda

Dropout is a common operator in deep learning, aiming to prevent overfitting by randomly dropping neurons during training. This paper introduces a new family of poisoning attacks against neural networks named DROPOUTATTACK. DROPOUTATTACK…

Machine Learning · Computer Science 2023-09-06 Andrew Yuan , Alina Oprea , Cheng Tan

Recent success in Deep Reinforcement Learning (DRL) methods has shown that policy optimization with respect to an off-policy distribution via importance sampling is effective for sample reuse. In this paper, we show that the use of…

Machine Learning · Computer Science 2023-02-07 Zichuan Lin , Xiapeng Wu , Mingfei Sun , Deheng Ye , Qiang Fu , Wei Yang , Wei Liu

Deep convolutional neural networks have shown remarkable performance on various computer vision tasks, and yet, they are susceptible to picking up spurious correlations from the training signal. So called `shortcuts' can occur during…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Mobarakol Islam , Ben Glocker

Dropout has proven to be an effective technique for regularization and preventing the co-adaptation of neurons in deep neural networks (DNN). It randomly drops units with a probability $p$ during the training stage of DNN. Dropout also…

Machine Learning · Computer Science 2018-08-30 Zongjie Ma , Abdul Sattar , Jun Zhou , Qingliang Chen , Kaile Su

Policy gradient methods are powerful reinforcement learning algorithms and have been demonstrated to solve many complex tasks. However, these methods are also data-inefficient, afflicted with high variance gradient estimates, and frequently…

Machine Learning · Computer Science 2019-05-15 Andreas Doerr , Michael Volpp , Marc Toussaint , Sebastian Trimpe , Christian Daniel

Scaling deep reinforcement learning networks is challenging and often results in degraded performance, yet the root causes of this failure mode remain poorly understood. Several recent works have proposed mechanisms to address this, but…

Dropout as a common regularizer to prevent overfitting in deep neural networks has been less effective in convolutional layers than in fully connected layers. This is because Dropout drops features randomly, without considering local…

Machine Learning · Computer Science 2025-06-05 Liyan Chen , Philippos Mordohai , Sergul Aydore

Deep neural networks with their large number of parameters are highly flexible learning systems. The high flexibility in such networks brings with some serious problems such as overfitting, and regularization is used to address this…

Machine Learning · Statistics 2017-12-20 Beyza Ermis , Ali Taylan Cemgil

Gradient descent prevails in artificial neural network training, but seems inept for spiking neural networks as small parameter changes can cause sudden, disruptive (dis-)appearances of spikes. Here, we demonstrate exact gradient descent…

Neurons and Cognition · Quantitative Biology 2025-01-29 Christian Klos , Raoul-Martin Memmesheimer

The success of the machine learning field has reliably depended on training on large datasets. While effective, this trend comes at an extraordinary cost. This is due to two deeply intertwined factors: the size of models and the size of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Shriram M Sathiyanarayanan , Xinyue Hao , Shihao Hou , Yang Lu , Laura Sevilla-Lara , Anurag Arnab , Shreyank N Gowda

Reinforcement learning agents need exploratory behaviors to escape from local optima. These behaviors may include both immediate dithering perturbation and temporally consistent exploration. To achieve these, a stochastic policy model that…

Machine Learning · Computer Science 2018-12-27 Sirui Xie , Junning Huang , Lanxin Lei , Chunxiao Liu , Zheng Ma , Wei Zhang , Liang Lin