English
Related papers

Related papers: Policy Distillation with Selective Input Gradient …

200 papers

Effective data selection is critical for efficient training of modern Large Language Models (LLMs). This paper introduces Influence Distillation, a novel, mathematically-justified framework for data selection that employs second-order…

Computation and Language · Computer Science 2025-05-27 Mahdi Nikdan , Vincent Cohen-Addad , Dan Alistarh , Vahab Mirrokni

Deep regression trackers are among the fastest tracking algorithms available, and therefore suitable for real-time robotic applications. However, their accuracy is inadequate in many domains due to distribution shift and overfitting. In…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Matteo Dunnhofer , Niki Martinel , Christian Micheloni

Low precision networks in the reinforcement learning (RL) setting are relatively unexplored because of the limitations of binary activations for function approximation. Here, in the discrete action ATARI domain, we demonstrate, for the…

The interpretation of reasoning by Deep Neural Networks (DNN) is still challenging due to their perceived black-box nature. Therefore, deploying DNNs in several real-world tasks is restricted by the lack of transparency of these models. We…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Maddimsetti Srinivas , Debdoot Sheet

Deep reinforcement learning (DRL) has gained great success by learning directly from high-dimensional sensory inputs, yet is notorious for the lack of interpretability. Interpretability of the subtasks is critical in hierarchical…

Artificial Intelligence · Computer Science 2019-03-01 Daoming Lyu , Fangkai Yang , Bo Liu , Steven Gustafson

R1-style Reinforcement Learning (RL) significantly enhances Large Language Models' reasoning capabilities, yet the mechanism behind rule-based RL remains unclear. We found that small-scale SFT has substantial influence on RL but shows poor…

Machine Learning · Computer Science 2025-08-06 Yutong Chen , Jiandong Gao , Ji Wu

In recent years, Deep Reinforcement Learning (DRL) algorithms have achieved state-of-the-art performance in many challenging strategy games. Because these games have complicated rules, an action sampled from the full discrete action…

Machine Learning · Computer Science 2022-06-01 Shengyi Huang , Santiago Ontañón

This paper considers the problem of learning safe policies in the context of reinforcement learning (RL). In particular, we consider the notion of probabilistic safety. This is, we aim to design policies that maintain the state of the…

Machine Learning · Computer Science 2023-04-20 Weiqin Chen , Dharmashankar Subramanian , Santiago Paternain

We present Reinforcement Learning via Auxiliary Task Distillation (AuxDistill), a new method that enables reinforcement learning (RL) to perform long-horizon robot control problems by distilling behaviors from auxiliary RL tasks. AuxDistill…

Machine Learning · Computer Science 2024-06-26 Abhinav Narayan Harish , Larry Heck , Josiah P. Hanna , Zsolt Kira , Andrew Szot

Safe Reinforcement learning (Safe RL) aims at learning optimal policies while staying safe. A popular solution to Safe RL is shielding, which uses a logical safety specification to prevent an RL agent from taking unsafe actions. However,…

Artificial Intelligence · Computer Science 2023-03-07 Wen-Chi Yang , Giuseppe Marra , Gavin Rens , Luc De Raedt

To alleviate the reliance of deep neural networks on large-scale datasets, dataset distillation aims to generate compact, high-quality synthetic datasets that can achieve comparable performance to the original dataset. The integration of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Mingzhuo Li , Guang Li , Jiafeng Mao , Linfeng Ye , Takahiro Ogawa , Miki Haseyama

Deep learning techniques have proven highly effective in image classification, but their deployment in resourceconstrained environments remains challenging due to high computational demands. Furthermore, their interpretability is of high…

Machine Learning · Computer Science 2024-12-06 Alireza Maleki , Mahsa Lavaei , Mohsen Bagheritabar , Salar Beigzad , Zahra Abadi

We consider the challenge of policy simplification and verification in the context of policies learned through reinforcement learning (RL) in continuous environments. In well-behaved settings, RL algorithms have convergence guarantees in…

Machine Learning · Computer Science 2022-06-15 Florent Delgrange , Ann Nowé , Guillermo A. Pérez

Despite numerous successes in Deep Reinforcement Learning (DRL), the learned policies are not interpretable. Moreover, since DRL does not exploit symbolic relational representations, it has difficulties in coping with structural changes in…

Artificial Intelligence · Computer Science 2023-07-17 Rishi Hazra , Luc De Raedt

Knowledge distillation is an effective approach to transferring knowledge from a teacher neural network to a student target network for satisfying the low-memory and fast running requirements in practice use. Whilst being able to create…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Xu Lan , Xiatian Zhu , Shaogang Gong

We consider the challenging problem of using domain knowledge to improve deep reinforcement learning policies. To this end, we propose LEGIBLE, a novel approach, following a multi-step process, which starts by mining rules from a deep RL…

Machine Learning · Computer Science 2025-03-13 Martin Tappler , Ignacio D. Lopez-Miguel , Sebastian Tschiatschek , Ezio Bartocci

Deep neuroevolution and deep reinforcement learning (deep RL) algorithms are two popular approaches to policy search. The former is widely applicable and rather stable, but suffers from low sample efficiency. By contrast, the latter is more…

Machine Learning · Computer Science 2019-02-12 Aloïs Pourchot , Olivier Sigaud

Policy gradient methods are among the most effective methods for large-scale reinforcement learning, and their empirical success has prompted several works that develop the foundation of their global convergence theory. However, prior works…

Machine Learning · Computer Science 2020-12-25 Junzi Zhang , Jongho Kim , Brendan O'Donoghue , Stephen Boyd

Deep Reinforcement Learning (Deep RL) has been receiving increasingly more attention thanks to its encouraging performance on a variety of control tasks. Yet, conventional regularization techniques in training neural networks (e.g., $L_2$…

Machine Learning · Computer Science 2021-11-30 Zhuang Liu , Xuanlin Li , Bingyi Kang , Trevor Darrell

Real-world driving involves intricate interactions among vehicles navigating through dense traffic scenarios. Recent research focuses on enhancing the interaction awareness of autonomous vehicles to leverage these interactions in…

Robotics · Computer Science 2024-04-03 Piyush Gupta , David Isele , Sangjae Bae