English
Related papers

Related papers: Safety-Oriented Pruning and Interpretation of Rein…

200 papers

Structural pruning of neural network parameters reduces computation, energy, and memory transfer costs during inference. We propose a novel method that estimates the contribution of a neuron (filter) to the final loss and iteratively…

Machine Learning · Computer Science 2019-06-27 Pavlo Molchanov , Arun Mallya , Stephen Tyree , Iuri Frosio , Jan Kautz

Deep learning approaches have provided state-of-the-art performance in many applications by relying on large and overparameterized neural networks. However, such networks have been shown to be very brittle and are difficult to deploy on…

Human-Computer Interaction · Computer Science 2023-10-26 Zhimin Li , Shusen Liu , Xin Yu , Kailkhura Bhavya , Jie Cao , Diffenderfer James Daniel , Peer-Timo Bremer , Valerio Pascucci

Convolutional neural networks (CNN) play a major role in image processing tasks like image classification, object detection, semantic segmentation. Very often CNN networks have from several to hundred stacked layers with several megabytes…

Machine Learning · Computer Science 2020-02-18 Marcin Pietron , Maciej Wielgosz

Ensuring the safety of reinforcement learning (RL) algorithms is crucial to unlock their potential for many real-world tasks. However, vanilla RL and most safe RL approaches do not guarantee safety. In recent years, several methods have…

Machine Learning · Computer Science 2023-11-21 Hanna Krasowski , Jakob Thumm , Marlon Müller , Lukas Schäfer , Xiao Wang , Matthias Althoff

In an ever expanding set of research and application areas, deep neural networks (DNNs) set the bar for algorithm performance. However, depending upon additional constraints such as processing power and execution time limits, or…

Machine Learning · Computer Science 2021-06-22 Nathan Dahlin , Krishna Chaitanya Kalagarla , Nikhil Naik , Rahul Jain , Pierluigi Nuzzo

Deep Neural Networks (DNNs) are known to be vulnerable to backdoor attacks, posing concerning threats to their reliable deployment. Recent research reveals that backdoors can be erased from infected DNNs by pruning a specific group of…

Machine Learning · Computer Science 2024-05-29 Nan Li , Haiyang Yu , Ping Yi

Pruning on neural networks before training not only compresses the original models, but also accelerates the network training phase, which has substantial application value. The current work focuses on fine-grained pruning, which uses…

Machine Learning · Computer Science 2022-09-28 Xiatao Kang , Ping Li , Jiayi Yao , Chengxi Li

The subject of green AI has been gaining attention within the deep learning community given the recent trend of ever larger and more complex neural network models. Existing solutions for reducing the computational load of training at…

Machine Learning · Computer Science 2025-01-13 Xiaoying Zhi , Varun Babbar , Rundong Liu , Pheobe Sun , Fran Silavong , Ruibo Shi , Sean Moran

Recently, neural network compression schemes like channel pruning have been widely used to reduce the model size and computational complexity of deep neural network (DNN) for applications in power-constrained scenarios such as embedded…

Machine Learning · Computer Science 2021-07-20 Jiandong Mu , Mengdi Wang , Feiwen Zhu , Jun Yang , Wei Lin , Wei Zhang

History-dependent policies induced by recurrent neural networks (RNNs) rely on latent hidden state dynamics, making verification in partially observable reinforcement learning (RL) challenging. Existing RNN verification tools typically rely…

Artificial Intelligence · Computer Science 2026-05-15 Luca Marzari , Enrico Marchesini

Regularization techniques such as $\mathcal{L}_1$ and $\mathcal{L}_2$ regularizers are effective in sparsifying neural networks (NNs). However, to remove a certain neuron or channel in NNs, all weight elements related to that neuron or…

Machine Learning · Computer Science 2023-05-31 Ali Haisam Muhammad Rafid , Adrian Sandu

Real-time inference of vision-language-action (VLA) models is essential for robotic control. While visual token pruning has shown strong potential for accelerating inference, most existing methods mainly base pruning decisions on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Shilin Ma , Chubin Zhang , Changyuan Wang , Yuji Wang , Yue Wu , Zixuan Wang , Jingqi Tian , Zheng Zhu , Yansong Tang

Deep Reinforcement Learning (RL) has shown promise in addressing complex robotic challenges. In real-world applications, RL is often accompanied by failsafe controllers as a last resort to avoid catastrophic events. While necessary for…

Robotics · Computer Science 2023-09-26 Jakob Thumm , Guillaume Pelat , Matthias Althoff

Neural network pruning techniques reduce the number of parameters without compromising predicting ability of a network. Many algorithms have been developed for pruning both over-parameterized fully-connected networks (FCNs) and…

Machine Learning · Computer Science 2021-05-24 Xin Qian , Diego Klabjan

Safe reinforcement learning (RL) agents accomplish given tasks while adhering to specific constraints. Employing constraints expressed via easily-understandable human language offers considerable potential for real-world applications due to…

Machine Learning · Computer Science 2024-05-16 Xingzhou Lou , Junge Zhang , Ziyan Wang , Kaiqi Huang , Yali Du

This paper introduces a new method for safety-aware robot learning, focusing on repairing policies using predictive models. Our method combines behavioral cloning with neural network repair in a two-step supervised learning framework. It…

Robotics · Computer Science 2024-11-08 Keyvan Majd , Geoffrey Clark , Georgios Fainekos , Heni Ben Amor

Deep neural networks (DNNs) have been found to be vulnerable to backdoor attacks, raising security concerns about their deployment in mission-critical applications. While existing defense methods have demonstrated promising results, it is…

Machine Learning · Computer Science 2023-12-11 Yige Li , Xixiang Lyu , Xingjun Ma , Nodens Koren , Lingjuan Lyu , Bo Li , Yu-Gang Jiang

Affective computing systems are increasingly embedded in pervasive and interactive environments, such as adaptive games, assistive technologies, and resource-constrained platforms, where computational efficiency must be balanced with…

Machine Learning · Computer Science 2026-05-28 Kosmas Pinitas , Konstantinos Katsifis

Deep neural networks have been widely adopted in many vision and robotics applications with visual inputs. It is essential to verify its robustness against semantic transformation perturbations, such as brightness and contrast. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Hanjiang Hu , Bowei Li , Ziwei Wang , Tianhao Wei , Casidhe Hutchison , Eric Sample , Changliu Liu

This paper presents a constrained policy gradient algorithm. We introduce constraints for safe learning with the following steps. First, learning is slowed down (lazy learning) so that the episodic policy change can be computed with the…

Machine Learning · Computer Science 2022-01-24 Balázs Varga , Balázs Kulcsár , Morteza Haghir Chehreghani