English
Related papers

Related papers: Investigating Weight-Perturbed Deep Neural Network…

200 papers

Robustness of Deep Neural Networks (DNNs) is an important aspect to consider for their clinical applications. This work examined robustness issue for a DNN-based multi-class classification model via comprehensive experimental and simulation…

Medical Physics · Physics 2023-03-07 Yuting Peng , Chenyang Shen , Yesenia Gonzalez , Yin Gao , Xun Jia

The ability to accurately predict deep neural network (DNN) inference performance metrics, such as latency, power, and memory footprint, for an arbitrary DNN on a target hardware platform is essential to the design of DNN based models. This…

Machine Learning · Computer Science 2023-01-27 Yuji Chai , Devashree Tripathy , Chuteng Zhou , Dibakar Gope , Igor Fedorov , Ramon Matas , David Brooks , Gu-Yeon Wei , Paul Whatmough

In the computer vision community, Convolutional Neural Networks (CNNs), first proposed in the 1980's, have become the standard visual classification model. Recently, as alternatives to CNNs, Capsule Networks (CapsNets) and Vision…

Computer Vision and Pattern Recognition · Computer Science 2023-01-05 Jindong Gu

Deep Neural Networks (DNNs) have emerged as a core tool for machine learning. The computations performed during DNN training and inference are dominated by operations on the weight matrices describing the DNN. As DNNs incorporate more…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-06 Jeremy Kepner , Manoj Kumar , José Moreira , Pratap Pattnaik , Mauricio Serrano , Henry Tufo

This paper investigates efficient deep neural networks (DNNs) to replace dense unstructured weight matrices with structured ones that possess desired properties. The challenge arises because the optimal weight matrix structure in popular…

Machine Learning · Computer Science 2024-03-11 Changwoo Lee , Hun-Seok Kim

Intrusion detection system (IDS) plays an essential role in computer networks protecting computing resources and data from outside attacks. Recent IDS faces challenges improving flexibility and efficiency of the IDS for unexpected and…

Cryptography and Security · Computer Science 2020-03-05 Azizjon Meliboev , Jumabek Alikhanov , Wooseong Kim

We explore the robustness of recurrent neural networks when the computations within the network are noisy. One of the motivations for looking into this problem is to reduce the high power cost of conventional computing of neural network…

Machine Learning · Computer Science 2018-07-18 Minghai Qin , Dejan Vucinic

Deep neural networks (DNNs) have demonstrated their great potential in recent years, exceeding the per-formance of human experts in a wide range of applications. Due to their large sizes, however, compressiontechniques such as weight…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Wentao Chen , Hailong Qiu , Jian Zhuang , Chutong Zhang , Yu Hu , Qing Lu , Tianchen Wang , Yiyu Shi , Meiping Huang , Xiaowe Xu

Explaining the output of a complicated machine learning model like a deep neural network (DNN) is a central challenge in machine learning. Several proposed local explanation methods address this issue by identifying what dimensions of a…

Computer Vision and Pattern Recognition · Computer Science 2018-10-09 Julius Adebayo , Justin Gilmer , Ian Goodfellow , Been Kim

The success of deep neural networks (DNNs) is attributable to three factors: increased compute capacity, more complex models, and more data. These factors, however, are not always present, especially for edge applications such as autonomous…

Computer Vision and Pattern Recognition · Computer Science 2019-08-26 Bichen Wu

Deep neural networks (DNNs) are vulnerable to subtle adversarial perturbations applied to the input. These adversarial perturbations, though imperceptible, can easily mislead the DNN. In this work, we take a control theoretic approach to…

Machine Learning · Computer Science 2019-11-13 Arash Rahnama , Andre T. Nguyen , Edward Raff

Deep neural networks (DNNs) are known to be vulnerable to adversarial attacks. A range of defense methods have been proposed to train adversarially robust DNNs, among which adversarial training has demonstrated promising results. However,…

Machine Learning · Computer Science 2022-01-25 Hanxun Huang , Yisen Wang , Sarah Monazam Erfani , Quanquan Gu , James Bailey , Xingjun Ma

It is commonly believed that the hidden layers of deep neural networks (DNNs) attempt to extract informative features for learning tasks. In this paper, we formalize this intuition by showing that the features extracted by DNN coincide with…

Information Theory · Computer Science 2019-05-17 Shao-Lun Huang , Xiangxiang Xu , Lizhong Zheng , Gregory W. Wornell

The adoption of large-scale iris recognition systems around the world has brought to light the importance of detecting presentation attack images (textured contact lenses and printouts). This work presents a new approach in iris…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Andrey Kuehlkamp , Allan Pinto , Anderson Rocha , Kevin Bowyer , Adam Czajka

Deep learning has become an integral part of various computer vision systems in recent years due to its outstanding achievements for object recognition, facial recognition, and scene understanding. However, deep neural networks (DNNs) are…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Nima Mirnateghi , Syed Afaq Ali Shah , Mohammed Bennamoun

Deep neural networks (DNNs) are known to be vulnerable to adversarial geometric transformation. This paper aims to verify the robustness of large-scale DNNs against the combination of multiple geometric transformations with a provable…

Machine Learning · Computer Science 2023-04-03 Fu Wang , Peipei Xu , Wenjie Ruan , Xiaowei Huang

Deep Neural Networks (DNNs) have become key components of many safety-critical applications such as autonomous driving and medical diagnosis. However, DNNs have been shown suffering from poor robustness because of their susceptibility to…

Machine Learning · Computer Science 2020-07-28 Wenjie Wan , Zhaodi Zhang , Yiwei Zhu , Min Zhang , Fu Song

Adversarial attacks have been shown to be highly effective at degrading the performance of deep neural networks (DNNs). The most prominent defense is adversarial training, a method for learning a robust model. Nevertheless, adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Uriya Pesso , Koby Bibas , Meir Feder

Over the past few years, deep neural networks (DNNs) have achieved tremendous success and have been continuously applied in many application domains. However, during the practical deployment in the industrial tasks, DNNs are found to be…

Machine Learning · Computer Science 2021-12-14 Hua Qi , Zhijie Wang , Qing Guo , Jianlang Chen , Felix Juefei-Xu , Lei Ma , Jianjun Zhao

Studying the sensitivity of weight perturbation in neural networks and its impacts on model performance, including generalization and robustness, is an active research topic due to its implications on a wide range of machine learning tasks…

Machine Learning · Computer Science 2021-12-20 Yu-Lin Tsai , Chia-Yi Hsu , Chia-Mu Yu , Pin-Yu Chen