English
Related papers

Related papers: Rethinking the Role of Dynamic Sparse Training for…

200 papers

Deep Reinforcement Learning (DRL) is a promising approach for teaching robots new behaviour. However, one of its main limitations is the need for carefully hand-coded reward signals by an expert. We argue that it is crucial to automate the…

Robotics · Computer Science 2021-08-09 Abdalkarim Mohtasib , Gerhard Neumann , Heriberto Cuayahuitl

Dynamic Sparse Training (DST) is a rapidly evolving area of research that seeks to optimize the sparse initialization of a neural network by adapting its topology during training. It has been shown that under specific conditions, DST is…

Machine Learning · Computer Science 2023-12-01 Aleksandra I. Nowak , Bram Grooten , Decebal Constantin Mocanu , Jacek Tabor

Multimodal Large Language Models (MLLMs) have demonstrated outstanding performance across a variety of domains. However, training MLLMs is often inefficient, as much of the computation is redundant due to the long input sequences from…

Machine Learning · Computer Science 2026-05-19 Kean Shi , Liang Chen , Haozhe Zhao , Baobao Chang

Over-parameterization of deep neural networks (DNNs) has shown high prediction accuracy for many applications. Although effective, the large number of parameters hinders its popularity on resource-limited devices and has an outsize…

Machine Learning · Computer Science 2023-04-25 Shaoyi Huang , Bowen Lei , Dongkuan Xu , Hongwu Peng , Yue Sun , Mimi Xie , Caiwen Ding

Deep Neural Networks (DNNs) have been proven to be exceptionally effective and have been applied across diverse domains within deep learning. However, as DNN models increase in complexity, the demand for reduced computational costs and…

Neural and Evolutionary Computing · Computer Science 2025-06-12 Xiaotian Chen , Hongyun Liu , Seyed Sahand Mohammadi Ziabari

Recent advances in parallel computing and GPU acceleration have created new opportunities for computation-intensive learning problems such as Active SLAM -- where actions are selected to reduce uncertainty and improve joint mapping and…

Robotics · Computer Science 2026-03-30 Martín Arce Llobera , Julio A. Placed , Mariano De Paula , Pablo De Cristóforis

Sparse training has received an upsurging interest in machine learning due to its tantalizing saving potential for the entire training process as well as inference. Dynamic sparse training (DST), as a leading sparse training approach, can…

Machine Learning · Computer Science 2023-11-13 Lu Yin , Gen Li , Meng Fang , Li Shen , Tianjin Huang , Zhangyang Wang , Vlado Menkovski , Xiaolong Ma , Mykola Pechenizkiy , Shiwei Liu

Multi-task reinforcement learning (MTRL) aims to endow a single agent with the ability to perform well on multiple tasks. Recent works have focused on developing novel sophisticated architectures to improve performance, often resulting in…

Machine Learning · Computer Science 2025-03-13 Reginald McLean , Evangelos Chatzaroulas , Jordan Terry , Isaac Woungang , Nariman Farsad , Pablo Samuel Castro

We propose a novel framework for Deep Reinforcement Learning (DRL) in modular robotics using traditional robotic tools that extend state-of-the-art DRL implementations and provide an end-to-end approach which trains a robot directly from…

Robotics · Computer Science 2018-02-08 Risto Kojcev , Nora Etxezarreta , Alejandro Hernández , Víctor Mayoral

Reinforcement Learning (RL) has become essential for eliciting complex reasoning capabilities in Large Language Models (LLMs). However, the substantial memory overhead of storing Key-Value (KV) caches during long-horizon rollouts acts as a…

Machine Learning · Computer Science 2026-03-31 Sijia Luo , Xiaokang Zhang , Yuxuan Hu , Bohan Zhang , Ke Wang , Jinbo Su , Mengshu Sun , Lei Liang , Jing Zhang

This paper presents meta-sparsity, a framework for learning model sparsity, basically learning the parameter that controls the degree of sparsity, that allows deep neural networks (DNNs) to inherently generate optimal sparse shared…

Machine Learning · Computer Science 2025-01-22 Richa Upadhyay , Ronald Phlypo , Rajkumar Saini , Marcus Liwicki

In the realm of deep learning-based recommendation systems, the increasing computational demands, driven by the growing number of users and items, pose a significant challenge to practical deployment. This challenge is primarily twofold:…

Information Retrieval · Computer Science 2024-02-06 Shuyao Wang , Yongduo Sui , Jiancan Wu , Zhi Zheng , Hui Xiong

Continual Reinforcement Learning (CRL) is essential for developing agents that can learn, adapt, and accumulate knowledge over time. However, a fundamental challenge persists as agents must strike a delicate balance between plasticity,…

Machine Learning · Computer Science 2025-03-11 Chengqi Zheng , Haiyan Yin , Jianda Chen , Terence Ng , Yew-Soon Ong , Ivor Tsang

We study the benefits of different sparse architectures for deep reinforcement learning. In particular, we focus on image-based domains where spatially-biased and fully-connected architectures are common. Using these and several other…

Machine Learning · Computer Science 2025-02-04 Fatima Davelouis , John D. Martin , Michael Bowling

Obtaining versions of deep neural networks that are both highly-accurate and highly-sparse is one of the main challenges in the area of model compression, and several high-performance pruning techniques have been investigated by the…

Machine Learning · Computer Science 2023-09-11 Denis Kuznedelev , Eldar Kurtic , Eugenia Iofinova , Elias Frantar , Alexandra Peste , Dan Alistarh

Deep Reinforcement Learning (DRL) is a subfield of machine learning for training autonomous agents that take sequential actions across complex environments. Despite its significant performance in well-known environments, it remains…

Deep learning (DL) has transformed applications in a variety of domains, including computer vision, natural language processing, and tabular data analysis. The search for improved DL model accuracy has led practitioners to explore…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-10 Kabir Nagrecha

It is generally perceived that Dynamic Sparse Training opens the door to a new era of scalability and efficiency for artificial neural networks at, perhaps, some costs in accuracy performance for the classification task. At the same time,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Boqian Wu , Qiao Xiao , Shunxin Wang , Nicola Strisciuglio , Mykola Pechenizkiy , Maurice van Keulen , Decebal Constantin Mocanu , Elena Mocanu

Deep reinforcement learning (DRL) is one promising approach to teaching robots to perform complex tasks. Because methods that directly reuse the stored experience data cannot follow the change of the environment in robotic problems with a…

Robotics · Computer Science 2022-01-26 Taisuke Kobayashi

While improvements in deep learning architectures have played a crucial role in improving the state of supervised and unsupervised learning in computer vision and natural language processing, neural network architecture choices for…

Machine Learning · Computer Science 2020-12-01 Samarth Sinha , Homanga Bharadhwaj , Aravind Srinivas , Animesh Garg