中文
相关论文

相关论文: Learning Sparse Representations Incrementally in D…

200 篇论文

Deep latent generative models have attracted increasing attention due to the capacity of combining the strengths of deep learning and probabilistic models in an elegant way. The data representations learned with the models are often…

机器学习 · 计算机科学 2023-04-04 Zhao Xu , Daniel Onoro Rubio , Giuseppe Serra , Mathias Niepert

In many real-world scenarios, reward signal for agents are exceedingly sparse, making it challenging to learn an effective reward function for reward shaping. To address this issue, the proposed approach in this paper performs reward…

机器学习 · 计算机科学 2026-05-18 Wenyun Li , Wenjie Huang , Chen Sun

While recent progress in deep reinforcement learning has enabled robots to learn complex behaviors, tasks with long horizons and sparse rewards remain an ongoing challenge. In this work, we propose an effective reward shaping method through…

机器学习 · 计算机科学 2020-08-04 Xingyu Lu , Stas Tiomkin , Pieter Abbeel

Deep neural networks are the most commonly used function approximators in offline reinforcement learning. Prior works have shown that neural nets trained with TD-learning and gradient descent can exhibit implicit regularization that can be…

Sequential learning, also called lifelong learning, studies the problem of learning tasks in a sequence with access restricted to only the data of the current task. In this paper we look at a scenario with fixed model capacity, and…

机器学习 · 统计学 2019-04-15 Rahaf Aljundi , Marcus Rohrbach , Tinne Tuytelaars

Deep reinforcement-learning methods have achieved remarkable performance on challenging control tasks. Observations of the resulting behavior give the impression that the agent has constructed a generalized representation that supports…

机器学习 · 计算机科学 2018-12-12 Sam Witty , Jun Ki Lee , Emma Tosch , Akanksha Atrey , Michael Littman , David Jensen

From the point of view of the human brain, continual learning can perform various tasks without mutual interference. An effective way to reduce mutual interference can be found in sparsity and selectivity of neurons. According to Aljundi et…

机器学习 · 计算机科学 2024-10-04 Jin Hyun Park

Reinforcement learning (RL) in sparse-reward environments remains a significant challenge due to the lack of informative feedback. We propose a simple yet effective method that uses a small number of successful demonstrations to initialize…

机器学习 · 计算机科学 2025-10-29 Seyed Mahdi Basiri Azad , Joschka Boedecker

Deep reinforcement learning in partially observable environments is a difficult task in itself, and can be further complicated by a sparse reward signal. Most tasks involving navigation in three-dimensional environments provide the agent…

机器学习 · 计算机科学 2023-10-17 Matvey Gerasyov , Ilya Makarov

Sparse neural networks are a key factor in developing resource-efficient machine learning applications. We propose the novel and powerful sparse learning method Adaptive Regularized Training (ART) to compress dense into sparse networks.…

计算机视觉与模式识别 · 计算机科学 2023-08-17 Patrick Glandorf , Timo Kaiser , Bodo Rosenhahn

In reinforcement learning, state representations are used to tractably deal with large problem spaces. State representations serve both to approximate the value function with few parameters, but also to generalize to newly encountered…

机器学习 · 计算机科学 2022-03-02 Charline Le Lan , Stephen Tu , Adam Oberman , Rishabh Agarwal , Marc G. Bellemare

We study the action generalization ability of deep Q-learning in discrete action spaces. Generalization is crucial for efficient reinforcement learning (RL) because it allows agents to use knowledge learned from past experiences on new…

人工智能 · 计算机科学 2022-05-12 Zhiyuan Zhou , Cameron Allen , Kavosh Asadi , George Konidaris

Multi-agent reinforcement learning involves multiple agents interacting with each other and a shared environment to complete tasks. When rewards provided by the environment are sparse, agents may not receive immediate feedback on the…

机器学习 · 计算机科学 2021-03-31 Baicen Xiao , Bhaskar Ramasubramanian , Radha Poovendran

Inspired by the robustness and efficiency of sparse representation in sparse coding based image restoration models, we investigate the sparsity of neurons in deep networks. Our method structurally enforces sparsity constraints upon hidden…

计算机视觉与模式识别 · 计算机科学 2020-06-09 Yuchen Fan , Jiahui Yu , Yiqun Mei , Yulun Zhang , Yun Fu , Ding Liu , Thomas S. Huang

Instability and variability of Deep Reinforcement Learning (DRL) algorithms tend to adversely affect their performance. Averaged-DQN is a simple extension to the DQN algorithm, based on averaging previously learned Q-values estimates, which…

人工智能 · 计算机科学 2017-03-13 Oron Anschel , Nir Baram , Nahum Shimkin

Sparse deep learning has become a popular technique for improving the performance of deep neural networks in areas such as uncertainty quantification, variable selection, and large-scale network compression. However, most existing research…

机器学习 · 统计学 2023-10-06 Mingxuan Zhang , Yan Sun , Faming Liang

Deep reinforcement learning (RL) methods generally engage in exploratory behavior through noise injection in the action space. An alternative is to add noise directly to the agent's parameters, which can lead to more consistent exploration…

We investigate the effect of the dimensionality of the representations learned in Deep Neural Networks (DNNs) on their robustness to input perturbations, both adversarial and random. To achieve low dimensionality of learned representations,…

机器学习 · 计算机科学 2020-02-20 Amartya Sanyal , Varun Kanade , Philip H. S. Torr , Puneet K. Dokania

Explainable reinforcement learning allows artificial agents to explain their behavior in a human-like manner aiming at non-expert end-users. An efficient alternative of creating explanations is to use an introspection-based method that…

机器学习 · 计算机科学 2021-08-23 Angel Ayala , Francisco Cruz , Bruno Fernandes , Richard Dazeley

We study continual learning in the large scale setting where tasks in the input sequence are not limited to classification, and the outputs can be of high dimension. Among multiple state-of-the-art methods, we found vanilla experience…

机器学习 · 计算机科学 2020-10-07 Yogesh Balaji , Mehrdad Farajtabar , Dong Yin , Alex Mott , Ang Li