中文
相关论文

相关论文: Recurrent Neural Network Attention Mechanisms for …

200 篇论文

Recurrent Neural Networks (RNN) are known as powerful models for handling sequential data, and especially widely utilized in various natural language processing tasks. In this paper, we propose Contextual Recurrent Units (CRU) for enhancing…

计算与语言 · 计算机科学 2019-11-15 Yiming Cui , Wei-Nan Zhang , Wanxiang Che , Ting Liu , Zhipeng Chen , Shijin Wang , Guoping Hu

Recent efforts to improve the interpretability of deep neural networks use saliency to characterize the importance of input features to predictions made by models. Work on interpretability using saliency-based methods on Recurrent Neural…

机器学习 · 计算机科学 2019-10-29 Aya Abdelsalam Ismail , Mohamed Gunady , Luiz Pessoa , Héctor Corrada Bravo , Soheil Feizi

Deep neural networks (DNN) can achieve high performance when applied to In-Distribution (ID) data which come from the same distribution as the training set. When presented with anomaly inputs not from the ID, the outputs of a DNN should be…

机器学习 · 计算机科学 2021-10-08 Fangzhen Zhao , Chenyi Zhang , Naipeng Dong , Zefeng You , Zhenxin Wu

We address the problem of anomaly detection, that is, detecting anomalous events in a video sequence. Anomaly detection methods based on convolutional neural networks (CNNs) typically leverage proxy tasks, such as reconstructing input video…

计算机视觉与模式识别 · 计算机科学 2020-03-31 Hyunjong Park , Jongyoun Noh , Bumsub Ham

Natural Language Processing (NLP) is widely used in fields like machine translation and sentiment analysis. However, traditional NLP models struggle with accuracy and efficiency. This paper introduces Deep Convolutional Neural Networks…

计算与语言 · 计算机科学 2024-12-23 Chang Weng , Scott Rood , Mehdi Ali Ramezani , Amir Aslani , Reza Zarrab , Wang Zwuo , Sanjeev Salimans , Tim Satheesh

Deep learning continues to play as a powerful state-of-art technique that has achieved extraordinary accuracy levels in various domains of regression and classification tasks, including images, video, signal, and natural language data. The…

神经与进化计算 · 计算机科学 2022-06-03 Anna Zou , Zhiyuan Li

Deep neural networks have been well-known for their superb handling of various machine learning and artificial intelligence tasks. However, due to their over-parameterized black-box nature, it is often difficult to understand the prediction…

机器学习 · 计算机科学 2022-07-18 Xuhong Li , Haoyi Xiong , Xingjian Li , Xuanyu Wu , Xiao Zhang , Ji Liu , Jiang Bian , Dejing Dou

Supervised Continual learning involves updating a deep neural network (DNN) from an ever-growing stream of labeled data. While most work has focused on overcoming catastrophic forgetting, one of the major motivations behind continual…

计算机视觉与模式识别 · 计算机科学 2023-04-04 Md Yousuf Harun , Jhair Gallardo , Tyler L. Hayes , Christopher Kanan

Recurrent Neural Networks (RNNs), and specifically a variant with Long Short-Term Memory (LSTM), are enjoying renewed interest as a result of successful applications in a wide range of machine learning problems that involve sequential data.…

机器学习 · 计算机科学 2015-11-18 Andrej Karpathy , Justin Johnson , Li Fei-Fei

Recurrent neural networks (RNNs) have shown the ability to improve scene parsing through capturing long-range dependencies among image units. In this paper, we propose dense RNNs for scene labeling by exploring various long-range semantic…

计算机视觉与模式识别 · 计算机科学 2018-11-13 Heng Fan , Peng Chu , Longin Jan Latecki , Haibin Ling

We propose a one-class neural network (OC-NN) model to detect anomalies in complex data sets. OC-NN combines the ability of deep networks to extract a progressively rich representation of data with the one-class objective of creating a…

机器学习 · 计算机科学 2019-01-14 Raghavendra Chalapathy , Aditya Krishna Menon , Sanjay Chawla

Backdoor attacks embed hidden functionalities in deep neural networks (DNN), triggering malicious behavior with specific inputs. Advanced defenses monitor anomalous DNN inferences to detect such attacks. However, concealed backdoors evade…

密码学与安全 · 计算机科学 2025-02-18 Manaar Alam , Hithem Lamri , Michail Maniatakos

The interpretability of deep learning models has raised extended attention these years. It will be beneficial if we can learn an interpretable structure from deep learning models. In this paper, we focus on Recurrent Neural Networks~(RNNs)…

神经与进化计算 · 计算机科学 2020-01-15 Bo-Jian Hou , Zhi-Hua Zhou

Predictive models in acute care settings must be able to immediately recognize precipitous changes in a patient's status when presented with data reflecting such changes. Recurrent neural networks (RNNs) have become common for training and…

机器学习 · 计算机科学 2020-07-30 David Ledbetter , Eugene Laksana , Melissa Aczon , Randall Wetzel

Semantic segmentation is a crucial component for perception in automated driving. Deep neural networks (DNNs) are commonly used for this task and they are usually trained on a closed set of object classes appearing in a closed operational…

计算机视觉与模式识别 · 计算机科学 2022-02-18 Robin Chan , Svenja Uhlemeyer , Matthias Rottmann , Hanno Gottschalk

Recent architectural developments have enabled recurrent neural networks (RNNs) to reach and even surpass the performance of Transformers on certain sequence modeling tasks. These modern RNNs feature a prominent design pattern: linear…

Security analysts and administrators face a lot of challenges to detect and prevent network intrusions in their organizations, and to prevent network breaches, detecting the breach on time is crucial. Challenges arise while detecting…

密码学与安全 · 计算机科学 2019-10-04 Shisrut Rawat , Aishwarya Srinivasan , Vinayakumar R

Despite their impact on the society, deep neural networks are often regarded as black-box models due to their intricate structures and the absence of explanations for their decisions. This opacity poses a significant challenge to AI systems…

机器学习 · 计算机科学 2024-07-18 Biagio La Rosa

Attention mechanisms play a central role in NLP systems, especially within recurrent neural network (RNN) models. Recently, there has been increasing interest in whether or not the intermediate representations offered by these modules may…

计算与语言 · 计算机科学 2019-09-06 Sarah Wiegreffe , Yuval Pinter

Recently recurrent neural networks (RNNs) have demonstrated the ability to improve scene labeling through capturing long-range dependencies among image units. In this paper, we propose dense RNNs for scene labeling by exploring various…

计算机视觉与模式识别 · 计算机科学 2018-01-23 Heng Fan , Haibin Ling