English
Related papers

Related papers: On Hardening DNNs against Noisy Computations

200 papers

Deep neural networks (DNNs) are vulnerable to adversarial examples where inputs with imperceptible perturbations mislead DNNs to incorrect results. Despite the potential risk they bring, adversarial examples are also valuable for providing…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Chongzhi Zhang , Aishan Liu , Xianglong Liu , Yitao Xu , Hang Yu , Yuqing Ma , Tianlin Li

As deep neural networks (DNNs) are becoming the prominent solution for many computational problems, the aviation industry seeks to explore their potential in alleviating pilot workload and in improving operational safety. However, the use…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Yizhak Elboher , Raya Elsaleh , Omri Isac , Mélanie Ducoffe , Audrey Galametz , Guillaume Povéda , Ryma Boumazouza , Noémie Cohen , Guy Katz

Emerging reinforcement learning techniques using deep neural networks have shown great promise in control optimization. They harness non-local regularities of noisy control trajectories and facilitate transfer learning between tasks. To…

Quantum Physics · Physics 2018-04-17 Murphy Yuezhen Niu , Sergio Boixo , Vadim Smelyanskiy , Hartmut Neven

Over recent years, devising classification algorithms that are robust to adversarial perturbations has emerged as a challenging problem. In particular, deep neural nets (DNNs) seem to be susceptible to small imperceptible changes over test…

Machine Learning · Computer Science 2019-12-20 Sanjam Garg , Somesh Jha , Saeed Mahloujifar , Mohammad Mahmoody

The presence of noise is common in signal processing regardless the signal type. Deep neural networks have shown good performance in noise removal, especially on the image domain. In this work, we consider deep neural networks as a…

Machine Learning · Computer Science 2020-07-07 Leslie Casas , Attila Klimmek , Nassir Navab , Vasileios Belagiannis

We present a theoretical and experimental investigation of the quantization problem for artificial neural networks. We provide a mathematical definition of quantized neural networks and analyze their approximation capabilities, showing in…

Machine Learning · Computer Science 2019-05-29 Matteo Spallanzani , Lukas Cavigelli , Gian Paolo Leonardi , Marko Bertogna , Luca Benini

Deep neural networks provide excellent performance for inverse problems such as denoising. However, neural networks can be sensitive to adversarial or worst-case perturbations. This raises the question of whether such networks can be…

Machine Learning · Computer Science 2023-07-25 Anselm Krainovic , Mahdi Soltanolkotabi , Reinhard Heckel

Quantization replaces floating point arithmetic with integer arithmetic in deep neural network models, providing more efficient on-device inference with less power and memory. In this work, we propose a framework for formally verifying…

Machine Learning · Computer Science 2023-12-29 Pei Huang , Haoze Wu , Yuting Yang , Ieva Daukantas , Min Wu , Yedi Zhang , Clark Barrett

We study the recently introduced stability training as a general-purpose method to increase the robustness of deep neural networks against input perturbations. In particular, we explore its use as an alternative to data augmentation and…

Machine Learning · Computer Science 2019-11-14 Jan Laermann , Wojciech Samek , Nils Strodthoff

Labelling of data for supervised learning can be costly and time-consuming and the risk of incorporating label noise in large data sets is imminent. When training a flexible discriminative model using a strictly proper loss, such noise will…

Machine Learning · Statistics 2022-05-13 Amanda Olmin , Fredrik Lindsten

Energy efficient implementations and deployments of Spiking neural networks (SNNs) have been of great interest due to the possibility of developing artificial systems that can achieve the computational powers and energy efficiency of the…

Machine Learning · Computer Science 2023-02-09 Clemens JS Schaefer , Pooria Taheri , Mark Horeni , Siddharth Joshi

A high efficiency hardware integration of neural networks benefits from realizing nonlinearity, network connectivity and learning fully in a physical substrate. Multiple systems have recently implemented some or all of these operations, yet…

Neural and Evolutionary Computing · Computer Science 2021-06-28 Louis Andreoli , Xavier Porte , Stéphane Chrétien , Maxime Jacquot , Laurent Larger , Daniel Brunner

Quantum advantage requires overcoming noise-induced degradation of quantum systems. Conventional methods for reducing noise such as error mitigation face scalability issues in deep circuits. Specifically, noise hampers the extraction of…

Quantum Physics · Physics 2023-12-05 Yonglong Ding , Ruyu Yang

Neural network quantization methods often involve simulating the quantization process during training, making the trained model highly dependent on the target bit-width and precise way quantization is performed. Robust quantization offers…

Machine Learning · Computer Science 2020-10-23 Moran Shkolnik , Brian Chmiel , Ron Banner , Gil Shomron , Yury Nahshan , Alex Bronstein , Uri Weiser

Quantum noise fundamentally limits the utility of near-term quantum devices, making error mitigation essential for practical quantum computation. While traditional quantum error correction codes require substantial qubit overhead and…

Quantum Physics · Physics 2025-09-23 Karan Kendre

Recently deep neural networks have shown their capacity to memorize training data, even with noisy labels, which hurts generalization performance. To mitigate this issue, we provide a simple but effective baseline method that is robust to…

Machine Learning · Computer Science 2019-09-30 Yucen Luo , Jun Zhu , Tomas Pfister

Data quantization is an effective method to accelerate neural network training and reduce power consumption. However, it is challenging to perform low-bit quantized training: the conventional equal-precision quantization will lead to either…

Machine Learning · Computer Science 2022-11-01 Ruoyang Liu , Chenhan Wei , Yixiong Yang , Wenxun Wang , Huazhong Yang , Yongpan Liu

This is an introduction to software methods of quantum fault tolerance. Broadly speaking, these methods describe strategies for using the noisy hardware components of a quantum computer to perform computations while continually monitoring…

Quantum Physics · Physics 2013-12-06 Panos Aliferis

The rising popularity of intelligent mobile devices and the daunting computational cost of deep learning-based models call for efficient and accurate on-device inference schemes. We propose a quantization scheme that allows inference to be…

Machine Learning · Computer Science 2017-12-19 Benoit Jacob , Skirmantas Kligys , Bo Chen , Menglong Zhu , Matthew Tang , Andrew Howard , Hartwig Adam , Dmitry Kalenichenko

We propose a novel framework to perform classification via deep learning in the presence of noisy annotations. When trained on noisy labels, deep neural networks have been observed to first fit the training data with clean labels during an…

Machine Learning · Computer Science 2020-10-26 Sheng Liu , Jonathan Niles-Weed , Narges Razavian , Carlos Fernandez-Granda
‹ Prev 1 8 9 10 Next ›