中文
相关论文

相关论文: Model Extraction Attacks against Recurrent Neural …

200 篇论文

Models based on deep convolutional networks have dominated recent image interpretation tasks; we investigate whether models which are also recurrent, or "temporally deep", are effective for tasks involving sequences, visual and otherwise.…

计算机视觉与模式识别 · 计算机科学 2016-06-02 Jeff Donahue , Lisa Anne Hendricks , Marcus Rohrbach , Subhashini Venugopalan , Sergio Guadarrama , Kate Saenko , Trevor Darrell

Recurrent neural networks (RNN) are simple dynamical systems whose computational power has been attributed to their short-term memory. Short-term memory of RNNs has been previously studied analytically only for the case of orthogonal…

神经与进化计算 · 计算机科学 2016-04-26 Alireza Goudarzi , Sarah Marzen , Peter Banda , Guy Feldman , Christof Teuscher , Darko Stefanovic

Recent advances in event-based neuromorphic systems have resulted in significant interest in the use and development of spiking neural networks (SNNs). However, the non-differentiable nature of spiking neurons makes SNNs incompatible with…

神经与进化计算 · 计算机科学 2020-07-10 Ali Lotfi Rezaabad , Sriram Vishwanath

Recurrent Neural Networks (RNNs) produce state-of-art performance on many machine learning tasks but their demand on resources in terms of memory and computational power are often high. Therefore, there is a great interest in optimizing the…

神经与进化计算 · 计算机科学 2017-02-28 Joachim Ott , Zhouhan Lin , Ying Zhang , Shih-Chii Liu , Yoshua Bengio

Traffic prediction plays an important role in evaluating the performance of telecommunication networks and attracts intense research interests. A significant number of algorithms and models have been put forward to analyse traffic data and…

网络与互联网体系结构 · 计算机科学 2018-04-04 Yuxiu Hua , Zhifeng Zhao , Rongpeng Li , Xianfu Chen , Zhiming Liu , Honggang Zhang

When using recurrent neural networks (RNNs) it is common practice to apply trained models to sequences longer than those seen in training. This "extrapolating" usage deviates from the traditional statistical learning setup where guarantees…

机器学习 · 计算机科学 2022-03-25 Edo Cohen-Karlik , Avichai Ben David , Nadav Cohen , Amir Globerson

Deep learning is gaining importance in many applications. However, Neural Networks face several security and privacy threats. This is particularly significant in the scenario where Cloud infrastructures deploy a service with Neural Network…

密码学与安全 · 计算机科学 2019-07-09 Vasisht Duddu , Debasis Samanta , D Vijay Rao , Valentina E. Balas

Despite recent advances in training recurrent neural networks (RNNs), capturing long-term dependencies in sequences remains a fundamental challenge. Most approaches use backpropagation through time (BPTT), which is difficult to scale to…

机器学习 · 计算机科学 2018-06-14 Trieu H. Trinh , Andrew M. Dai , Minh-Thang Luong , Quoc V. Le

Designing deep neural networks is an art that often involves an expensive search over candidate architectures. To overcome this for recurrent neural nets (RNNs), we establish a connection between the hidden state dynamics in an RNN and…

机器学习 · 计算机科学 2021-12-14 Tan M. Nguyen , Richard G. Baraniuk , Andrea L. Bertozzi , Stanley J. Osher , Bao Wang

Recurrent Neural Networks (RNNs) offer fast inference on long sequences but are hard to optimize and slow to train. Deep state-space models (SSMs) have recently been shown to perform remarkably well on long sequence modeling tasks, and have…

机器学习 · 计算机科学 2023-03-14 Antonio Orvieto , Samuel L Smith , Albert Gu , Anushan Fernando , Caglar Gulcehre , Razvan Pascanu , Soham De

Recursive neural networks (RNN) and their recently proposed extension recursive long short term memory networks (RLSTM) are models that compute representations for sentences, by recursively combining word embeddings according to an…

人工智能 · 计算机科学 2016-03-02 Phong Le , Willem Zuidema

The significance of learning constraints from data is underscored by its potential applications in real-world problem-solving. While constraints are popular for modeling and solving, the approaches to learning constraints from data remain…

机器学习 · 计算机科学 2024-03-05 Eduardo Vyhmeister , Rocio Paez , Gabriel Gonzalez

This study proposes two straightforward yet effective approaches to reduce the required computational time of the training process for time-series modeling through a recurrent neural network (RNN) using multi-time-scale time-series data as…

大气与海洋物理 · 物理学 2021-11-11 Kei Ishida , Masato Kiyama , Ali Ercan , Motoki Amagasaki , Tongbi Tu

Countless learning tasks require dealing with sequential data. Image captioning, speech synthesis, and music generation all require that a model produce outputs that are sequences. In other domains, such as time series prediction, video…

机器学习 · 计算机科学 2015-10-20 Zachary C. Lipton , John Berkowitz , Charles Elkan

Deep neural networks (DNNs) have been deployed in myriad machine learning applications. However, advances in their accuracy are often achieved with increasingly complex and deep network architectures. These large, deep models are often…

机器学习 · 计算机科学 2020-04-22 Wenhan Xia , Hongxu Yin , Niraj K. Jha

Recurrent Neural Networks (RNNs), and specifically a variant with Long Short-Term Memory (LSTM), are enjoying renewed interest as a result of successful applications in a wide range of machine learning problems that involve sequential data.…

机器学习 · 计算机科学 2015-11-18 Andrej Karpathy , Justin Johnson , Li Fei-Fei

We describe recurrent neural networks (RNNs), which have attracted great attention on sequential tasks, such as handwriting recognition, speech recognition and image to text. However, compared to general feedforward neural networks, RNNs…

机器学习 · 计算机科学 2018-01-16 Gang Chen

We show that a recurrent neural network is able to learn a model to represent sequences of communications between computers on a network and can be used to identify outlier network traffic. Defending computer networks is a challenging…

计算机与社会 · 计算机科学 2018-03-30 Benjamin J. Radford , Leonardo M. Apolonio , Antonio J. Trias , Jim A. Simpson

Real-time lightweight time series anomaly detection has become increasingly crucial in cybersecurity and many other domains. Its ability to adapt to unforeseen pattern changes and swiftly identify anomalies enables prompt responses and…

机器学习 · 计算机科学 2024-07-29 Ming-Chang Lee , Jia-Chun Lin , Sokratis Katsikas

Machine unlearning is motivated by desire for data autonomy: a person can request to have their data's influence removed from deployed models, and those models should be updated as if they were retrained without the person's data. We show…

机器学习 · 计算机科学 2024-05-31 Martin Bertran , Shuai Tang , Michael Kearns , Jamie Morgenstern , Aaron Roth , Zhiwei Steven Wu