English
Related papers

Related papers: RobustNeuralNetworks.jl: a Package for Machine Lea…

200 papers

Deep networks have recently been shown to be vulnerable to universal perturbations: there exist very small image-agnostic perturbations that cause most natural images to be misclassified by such classifiers. In this paper, we propose the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-03 Seyed-Mohsen Moosavi-Dezfooli , Alhussein Fawzi , Omar Fawzi , Pascal Frossard , Stefano Soatto

The robust disturbance rejection controller has been the subject of intensive research due to its undeniable importance for automation. Modern control theory tends to use model-based approaches versus model-free approaches, especially when…

Systems and Control · Electrical Eng. & Systems 2022-01-03 Atta Oveisi

In this paper, we propose shifting the focus of robustness evaluation for Neural Program Repair (NPR) techniques toward naturally-occurring data transformations. To accomplish this, we first examine the naturalness of semantic-preserving…

Software Engineering · Computer Science 2024-11-14 Thanh Le-Cong , Dat Nguyen , Bach Le , Toby Murray

The last decade has witnessed the breakthrough of deep neural networks (DNNs) in many fields. With the increasing depth of DNNs, hundreds of millions of multiply-and-accumulate (MAC) operations need to be executed. To accelerate such…

Hardware Architecture · Computer Science 2022-11-29 Amro Eldebiky , Grace Li Zhang , Georg Boecherer , Bing Li , Ulf Schlichtmann

Accurate motion control in the face of disturbances within complex environments remains a major challenge in robotics. Classical model-based approaches often struggle with nonlinearities and unstructured disturbances, while RL-based methods…

Robotics · Computer Science 2025-05-23 Feng Gao , Chao Yu , Yu Wang , Yi Wu

We present a theoretically grounded approach to train deep neural networks, including recurrent networks, subject to class-dependent label noise. We propose two procedures for loss correction that are agnostic to both application domain and…

Machine Learning · Statistics 2017-03-23 Giorgio Patrini , Alessandro Rozza , Aditya Menon , Richard Nock , Lizhen Qu

With the development of neural networks based machine learning and their usage in mission critical applications, voices are rising against the \textit{black box} aspect of neural networks as it becomes crucial to understand their limits and…

Machine Learning · Statistics 2017-08-08 El Mahdi El Mhamdi , Rachid Guerraoui , Sebastien Rouault

Deep Neural Networks (DNNs) are finding important applications in safety-critical systems such as Autonomous Vehicles (AVs), where perceiving the environment correctly and robustly is necessary for safe operation. Raising unique challenges…

Machine Learning · Computer Science 2020-03-26 Edward Ayers , Francisco Eiras , Majd Hawasly , Iain Whiteside

Neural networks trained on visual data are well-known to be vulnerable to often imperceptible adversarial perturbations. The reasons for this vulnerability are still being debated in the literature. Recently Ilyas et al. (2019) showed that…

Machine Learning · Computer Science 2021-02-11 Jacob M. Springer , Melanie Mitchell , Garrett T. Kenyon

The Renormalisation Group (RG) provides a framework in which it is possible to assess whether a deep-learning network is sensitive to small changes in the input data and hence prone to error, or susceptible to adversarial attack. Distinct…

Machine Learning · Statistics 2018-03-19 Richard Kenway

We investigate the topics of sensitivity and robustness in feedforward and convolutional neural networks. Combining energy landscape techniques developed in computational chemistry with tools drawn from formal methods, we produce empirical…

Machine Learning · Statistics 2018-12-06 Timothy E. Wang , Yiming Gu , Dhagash Mehta , Xiaojun Zhao , Edgar A. Bernal

Modern machine learning pipelines leverage large amounts of public data, making it infeasible to guarantee data quality and leaving models open to poisoning and backdoor attacks. Provably bounding model behavior under such attacks remains…

Machine Learning · Computer Science 2024-10-31 Philip Sosnin , Mark N. Müller , Maximilian Baader , Calvin Tsay , Matthew Wicker

Deep convolutional neural networks are generally regarded as robust function approximators. So far, this intuition is based on perturbations to external stimuli such as the images to be classified. Here we explore the robustness of…

Machine Learning · Computer Science 2017-03-27 Nicholas Cheney , Martin Schrimpf , Gabriel Kreiman

Score-driven models, also known as generalized autoregressive score models, represent a class of observation-driven time series models. They possess powerful properties, such as the ability to model different conditional distributions and…

Computation · Statistics 2020-08-27 Guilherme Bodin , Raphael Saavedra , Cristiano Fernandes , Alexandre Street

Neural Linear Models (NLM) are deep Bayesian models that produce predictive uncertainties by learning features from the data and then performing Bayesian linear regression over these features. Despite their popularity, few works have…

Machine Learning · Statistics 2021-12-17 Sujay Thakur , Cooper Lorsung , Yaniv Yacoby , Finale Doshi-Velez , Weiwei Pan

Ensuring robust safety alignment while preserving utility is critical for the reliable deployment of Large Language Models (LLMs). However, current techniques fundamentally suffer from intertwined deficiencies: insufficient robustness…

Machine Learning · Computer Science 2025-08-14 Birong Pan , Mayi Xu , Qiankun Pi , Jianhao Chen , Yuanyuan Zhu , Ming Zhong , Tieyun Qian

Spiking neural networks (SNNs) are gaining popularity in deep learning due to their low energy budget on neuromorphic hardware. However, they still face challenges in lacking sufficient robustness to guard safety-critical applications such…

Neural and Evolutionary Computing · Computer Science 2024-06-03 Jianhao Ding , Zhiyu Pan , Yujia Liu , Zhaofei Yu , Tiejun Huang

Deep Reinforcement Learning (DRL) has achieved remarkable advances in sequential decision tasks. However, recent works have revealed that DRL agents are susceptible to slight perturbations in observations. This vulnerability raises concerns…

Machine Learning · Computer Science 2023-12-15 Buqing Nie , Jingtian Ji , Yangqing Fu , Yue Gao

Recent breakthroughs in machine and deep learning (ML and DL) research have provided excellent tools for leveraging enormous amounts of data and optimizing huge models with millions of parameters to obtain accurate networks for image…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Mohammadreza Amirian

In this paper, we present Insertus.jl, the Julia package that can help the user generate a randomization sequence of a given length for a multi-arm trial with a pre-specified target allocation ratio and assess the operating characteristics…

Methodology · Statistics 2024-07-22 Yevgen Ryeznik , Oleksandr Sverdlov