English
Related papers

Related papers: Towards Characterizing and Limiting Information Ex…

200 papers

It is commonly believed that the hidden layers of deep neural networks (DNNs) attempt to extract informative features for learning tasks. In this paper, we formalize this intuition by showing that the features extracted by DNN coincide with…

Information Theory · Computer Science 2019-05-17 Shao-Lun Huang , Xiangxiang Xu , Lizhong Zheng , Gregory W. Wornell

Deep neural networks (DNNs) may outperform human brains in complex tasks, but the lack of transparency in their decision-making processes makes us question whether we could fully trust DNNs with high stakes problems. As DNNs' operations…

Machine Learning · Computer Science 2020-03-19 Jung Hoon Lee

The surge in popularity of machine learning (ML) has driven significant investments in training Deep Neural Networks (DNNs). However, these models that require resource-intensive training are vulnerable to theft and unauthorized use. This…

Cryptography and Security · Computer Science 2024-03-12 Jasper Stang , Torsten Krauß , Alexandra Dmitrienko

We propose a privacy-preserving ensemble infused enhanced Deep Neural Network (DNN) based learning framework in this paper for Internet-of-Things (IoT), edge, and cloud convergence in the context of healthcare. In the convergence, edge…

Cryptography and Security · Computer Science 2023-05-17 Veronika Stephanie , Ibrahim Khalil , Mohammad Saidur Rahman , Mohammed Atiquzzaman

Deep neural networks (DNNs) are increasingly deployed in different applications to achieve state-of-the-art performance. However, they are often applied as a black box with limited understanding of what knowledge the model has learned from…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Shihao Zhao , Xingjun Ma , Yisen Wang , James Bailey , Bo Li , Yu-Gang Jiang

Deep neural network (DNN) is a popular model implemented in many systems to handle complex tasks such as image classification, object recognition, natural language processing etc. Consequently DNN structural vulnerabilities become part of…

Machine Learning · Computer Science 2021-07-02 Juan Shu , Bowei Xi , Charles Kamhoua

Deep neural networks (DNNs) have long been recognized as vulnerable to backdoor attacks. By providing poisoned training data in the fine-tuning process, the attacker can implant a backdoor into the victim model. This enables input samples…

Cryptography and Security · Computer Science 2024-09-10 Abdullah Arafat Miah , Yu Bi

With the emergence of smart cities, Internet of Things (IoT) devices as well as deep learning technologies have witnessed an increasing adoption. To support the requirements of such paradigm in terms of memory and computation, joint and…

Networking and Internet Architecture · Computer Science 2020-10-27 Emna Baccour , Aiman Erbad , Amr Mohamed , Mounir Hamdi , Mohsen Guizani

Deep Neural Networks (DNNs) are known to be vulnerable to adversarial attacks. Currently, there is no clear insight into how slight perturbations cause such a large difference in classification results and how we can design a more robust…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Haizhong Zheng , Ziqi Zhang , Honglak Lee , Atul Prakash

Despite impressive capabilities and outstanding performance, deep neural networks (DNNs) have captured increasing public concern about their security problems, due to their frequently occurred erroneous behaviors. Therefore, it is necessary…

Machine Learning · Computer Science 2022-11-22 Haibo Jin , Ruoxi Chen , Haibin Zheng , Jinyin Chen , Yao Cheng , Yue Yu , Xianglong Liu

Deep Neural Networks (DNNs) excel at many tasks, often rivaling or surpassing human performance. Yet their internal processes remain elusive, frequently described as "black boxes." While performance can be refined experimentally, achieving…

Disordered Systems and Neural Networks · Physics 2025-02-03 Sebastiano Ariosto

Deep learning has shown promising results in many machine learning applications. The hierarchical feature representation built by deep networks enable compact and precise encoding of the data. A kernel analysis of the trained deep networks…

Machine Learning · Computer Science 2017-03-22 Mandar Kulkarni , Shirish Karande

Deep neural network (DNN) models have become prevalent in edge devices for real-time inference. However, they are vulnerable to model extraction attacks and require protection. Existing defense approaches either fail to fully safeguard…

Cryptography and Security · Computer Science 2023-11-17 Ziyu Liu , Yukui Luo , Shijin Duan , Tong Zhou , Xiaolin Xu

This paper proposes a method to visualize the discrimination power of intermediate-layer visual patterns encoded by a DNN. Specifically, we visualize (1) how the DNN gradually learns regional visual patterns in each intermediate layer…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Mingjie Li , Shaobo Wang , Quanshi Zhang

Deep neural networks (DNNs) have proven to be quite effective in a vast array of machine learning tasks, with recent examples in cyber security and autonomous vehicles. Despite the superior performance of DNNs in these applications, it has…

Machine Learning · Computer Science 2017-08-22 Qinglong Wang , Wenbo Guo , Kaixuan Zhang , Alexander G. Ororbia , Xinyu Xing , Xue Liu , C. Lee Giles

In recent years Deep Neural Networks (DNNs) have been rapidly developed in various applications, together with increasingly complex architectures. The performance gain of these DNNs generally comes with high computational costs and large…

Machine Learning · Computer Science 2017-12-05 Yiren Zhou , Seyed-Mohsen Moosavi-Dezfooli , Ngai-Man Cheung , Pascal Frossard

Trained Deep Neural Network (DNN) models are considered valuable Intellectual Properties (IP) in several business models. Prevention of IP theft and unauthorized usage of such DNN models has been raised as of significant concern by…

Machine Learning · Computer Science 2024-02-20 Manaar Alam , Sayandeep Saha , Debdeep Mukhopadhyay , Sandip Kundu

This paper explains the generalization power of a deep neural network (DNN) from the perspective of interactions. Although there is no universally accepted definition of the concepts encoded by a DNN, the sparsity of interactions in a DNN…

Machine Learning · Computer Science 2024-09-16 Huilin Zhou , Hao Zhang , Huiqi Deng , Dongrui Liu , Wen Shen , Shih-Han Chan , Quanshi Zhang

Understanding the per-layer learning dynamics of deep neural networks is of significant interest as it may provide insights into how neural networks learn and the potential for better training regimens. We investigate learning in Deep…

Machine Learning · Computer Science 2020-12-02 Ayush Manish Agrawal , Atharva Tendle , Harshvardhan Sikka , Sahib Singh , Amr Kayid

When the training data are maliciously tampered, the predictions of the acquired deep neural network (DNN) can be manipulated by an adversary known as the Trojan attack (or poisoning backdoor attack). The lack of robustness of DNNs against…

Machine Learning · Computer Science 2020-08-03 Ren Wang , Gaoyuan Zhang , Sijia Liu , Pin-Yu Chen , Jinjun Xiong , Meng Wang