English
Related papers

Related papers: Recurrent Neural Network Attention Mechanisms for …

200 papers

Unsupervised Deep Learning (DL) techniques have been widely used in various security-related anomaly detection applications, owing to the great promise of being able to detect unforeseen threats and superior performance provided by Deep…

Cryptography and Security · Computer Science 2021-09-24 Dongqi Han , Zhiliang Wang , Wenqi Chen , Ying Zhong , Su Wang , Han Zhang , Jiahai Yang , Xingang Shi , Xia Yin

Recurrent neural networks (RNNs) are a widely used tool for modeling sequential data, yet they are often treated as inscrutable black boxes. Given a trained recurrent network, we would like to reverse engineer it--to obtain a quantitative,…

Machine Learning · Computer Science 2019-12-06 Niru Maheswaranathan , Alex Williams , Matthew D. Golub , Surya Ganguli , David Sussillo

In recent years Deep Neural Networks (DNNs) have achieved remarkable results and even showed super-human capabilities in a broad range of domains. This led people to trust in DNNs' classifications and resulting actions even in…

Cryptography and Security · Computer Science 2020-12-14 Philip Sperl , Ching-Yu Kao , Peng Chen , Konstantin Böttinger

Recurrent neural networks (RNN) are the backbone of many text and speech applications. These architectures are typically made up of several computationally complex components such as; non-linear activation functions, normalization,…

Machine Learning · Computer Science 2022-12-23 Vahid Partovi Nia , Eyyüb Sari , Vanessa Courville , Masoud Asgharian

Deep learning is increasingly used as a building block of security systems. Unfortunately, neural networks are hard to interpret and typically opaque to the practitioner. The machine learning community has started to address this problem by…

Machine Learning · Computer Science 2020-04-28 Alexander Warnecke , Daniel Arp , Christian Wressnegger , Konrad Rieck

Machine learning models have been successfully applied to a wide range of applications including computer vision, natural language processing, and speech recognition. A successful implementation of these models however, usually relies on…

Machine Learning · Computer Science 2020-09-29 Arash Rahnama , Andrew Tseng

Explainability has been widely stated as a cornerstone of the responsible and trustworthy use of machine learning models. With the ubiquitous use of Deep Neural Network (DNN) models expanding to risk-sensitive and safety-critical domains,…

Deep Neural Networks (DNNs) are widely used for decision making in a myriad of critical applications, ranging from medical to societal and even judicial. Given the importance of these decisions, it is crucial for us to be able to interpret…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Teddy Koker , Fatemehsadat Mireshghallah , Tom Titcombe , Georgios Kaissis

Neural networks (NNs) achieve outstanding performance in many domains; however, their decision processes are often opaque and their inference can be computationally expensive in resource-constrained environments. We recently proposed…

Machine Learning · Computer Science 2025-05-30 Chang Yue , Niraj K. Jha

Recurrent neural networks (RNNs) have been successfully applied to various natural language processing (NLP) tasks and achieved better results than conventional methods. However, the lack of understanding of the mechanisms behind their…

Computation and Language · Computer Science 2017-10-31 Yao Ming , Shaozu Cao , Ruixiang Zhang , Zhen Li , Yuanzhe Chen , Yangqiu Song , Huamin Qu

There has been a large number of studies in interpretable and explainable ML for cybersecurity, in particular, for intrusion detection. Many of these studies have significant amount of overlapping and repeated evaluations and analysis. At…

Cryptography and Security · Computer Science 2024-07-08 Omer Subasi , Johnathan Cree , Joseph Manzano , Elena Peterson

Introduction: Machine learning provides fundamental tools both for scientific research and for the development of technologies with significant impact on society. It provides methods that facilitate the discovery of regularities in data and…

Machine Learning · Computer Science 2019-03-12 Andrea Ceni , Peter Ashwin , Lorenzo Livi

Knowledge tracing---where a machine models the knowledge of a student as they interact with coursework---is a well established problem in computer supported education. Though effectively modeling student knowledge would have high…

Artificial Intelligence · Computer Science 2015-06-22 Chris Piech , Jonathan Spencer , Jonathan Huang , Surya Ganguli , Mehran Sahami , Leonidas Guibas , Jascha Sohl-Dickstein

Intrusion detection for computer network systems has been becoming one of the most critical tasks for network administrators today. It has an important role for organizations, governments and our society due to the valuable resources hosted…

Machine Learning · Computer Science 2018-02-02 Nga Nguyen Thi , Van Loi Cao , Nhien-An Le-Khac

This paper reviews recent studies in understanding neural-network representations and learning neural networks with interpretable/disentangled middle-layer representations. Although deep neural networks have exhibited superior performance…

Computer Vision and Pattern Recognition · Computer Science 2018-02-08 Quanshi Zhang , Song-Chun Zhu

Time series models with recurrent neural networks (RNNs) can have high accuracy but are unfortunately difficult to interpret as a result of feature-interactions, temporal-interactions, and non-linear transformations. Interpretability is…

Machine Learning · Computer Science 2021-09-17 Asif Rahman , Yale Chang , Jonathan Rubin

Deep neural networks (DNNs) have proven to be quite effective in a vast array of machine learning tasks, with recent examples in cyber security and autonomous vehicles. Despite the superior performance of DNNs in these applications, it has…

Machine Learning · Computer Science 2017-08-22 Qinglong Wang , Wenbo Guo , Kaixuan Zhang , Alexander G. Ororbia , Xinyu Xing , Xue Liu , C. Lee Giles

Deep learning as represented by the artificial deep neural networks (DNNs) has achieved great success in many important areas that deal with text, images, videos, graphs, and so on. However, the black-box nature of DNNs has become one of…

Machine Learning · Computer Science 2021-09-29 Fenglei Fan , Jinjun Xiong , Mengzhou Li , Ge Wang

In order to gain access to networks, different types of intrusion attacks have been designed, and the attackers are working on improving them. Computer networks have become increasingly important in daily life due to the increasing reliance…

Cryptography and Security · Computer Science 2022-12-09 Mohammad Hossein Modirrousta , Parisa Forghani Arani , Mahdi Aliyari Shoorehdeli

Recurrent neural networks (RNNs) are powerful constructs capable of modeling complex systems, up to and including Turing Machines. However, learning such complex models from finite training sets can be difficult. In this paper we…

Machine Learning · Statistics 2018-10-23 John Clemens