English
Related papers

Related papers: Differentiable Neural Computers with Memory Demon

200 papers

Neural network based models have achieved impressive results on various specific tasks. However, in previous works, most models are learned separately based on single-task supervised objectives, which often suffer from insufficient training…

Computation and Language · Computer Science 2016-09-26 Pengfei Liu , Xipeng Qiu , Xuanjing Huang

Deep neural networks (DNNs) have revolutionized the field of artificial intelligence and have achieved unprecedented success in cognitive tasks such as image and speech recognition. Training of large DNNs, however, is computationally…

Neural systems are well known for their ability to learn and store information as memories. Even more impressive is their ability to abstract these memories to create complex internal representations, enabling advanced functions such as the…

Neural and Evolutionary Computing · Computer Science 2024-09-20 Lindsay M. Smith , Jason Z. Kim , Zhixin Lu , Dani S. Bassett

Deep neural networks (DNNs) have achieved substantial predictive performance in various speech processing tasks. Particularly, it has been shown that a monaural speech separation task can be successfully solved with a DNN-based method…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-20 Chihiro Watanabe , Hirokazu Kameoka

Deep neural networks (DNNs) can easily fit a random labeling of the training data with zero training error. What is the difference between DNNs trained with random labels and the ones trained with true labels? Our paper answers this…

Machine Learning · Computer Science 2019-11-22 Jindong Gu , Volker Tresp

Deep neural networks have shown superior performance in many regimes to remember familiar patterns with large amounts of data. However, the standard supervised deep learning paradigm is still limited when facing the need to learn new…

Machine Learning · Computer Science 2018-11-16 Jing Shi , Jiaming Xu , Yiqun Yao , Bo Xu

Deep neural networks (DNNs), the agents of deep learning (DL), require a massive number of parallel/sequential operations, which makes it difficult to comprehend them and impedes proper diagnosis. Without better knowledge of DNNs' internal…

Machine Learning · Computer Science 2024-11-19 Jung Hoon Lee , Sujith Vijayan

Machine learning systems based on deep neural networks (DNNs) have gained mainstream adoption in many applications. Recently, however, DNNs are shown to be vulnerable to adversarial example attacks with slight perturbations on the inputs.…

Machine Learning · Computer Science 2018-12-10 Bo Luo , Min Li , Yu Li , Qiang Xu

In this paper, we propose a novel control architecture, inspired from neuroscience, for adaptive control of continuous-time systems. The proposed architecture, in the setting of standard Neural Network (NN) based adaptive control, augments…

Systems and Control · Computer Science 2021-10-11 Deepan Muthirayan , Pramod P. Khargonekar

Learning-based model predictive control (MPC) is an approach designed to reduce the computational cost of MPC. In this paper, a constrained deep neural network (DNN) design is proposed to learn MPC policy for nonlinear systems. Using…

Systems and Control · Electrical Eng. & Systems 2023-03-30 Farshid Asadi

Memory-augmented neural networks (MANNs) provide better inference performance in many tasks with the help of an external memory. The recently developed differentiable neural computer (DNC) is a MANN that has been shown to outperform in…

Hardware Architecture · Computer Science 2022-02-16 Yaoyu Tao , Zhengya Zhang

Deep Neural networks are efficient and flexible models that perform well for a variety of tasks such as image, speech recognition and natural language understanding. In particular, convolutional neural networks (CNN) generate a keen…

Machine Learning · Computer Science 2018-12-20 Yesmina Jaafra , Jean Luc Laurent , Aline Deruyver , Mohamed Saber Naceur

Deep Neural Networks (DNNs) are vulnerable to adversarial attacks: carefully constructed perturbations to an image can seriously impair classification accuracy, while being imperceptible to humans. While there has been a significant amount…

Machine Learning · Computer Science 2020-12-23 Can Bakiskan , Metehan Cekic , Ahmet Dundar Sezer , Upamanyu Madhow

The emergence of Deep Neural Networks (DNNs) has revolutionized various domains by enabling the resolution of complex tasks spanning image recognition, natural language processing, and scientific problem-solving. However, this progress has…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Jindong Gu , Xiaojun Jia , Pau de Jorge , Wenqain Yu , Xinwei Liu , Avery Ma , Yuan Xun , Anjun Hu , Ashkan Khakzar , Zhijiang Li , Xiaochun Cao , Philip Torr

We develop a novel form of differentiable predictive control (DPC) with safety and robustness guarantees based on control barrier functions. DPC is an unsupervised learning-based method for obtaining approximate solutions to explicit model…

Systems and Control · Electrical Eng. & Systems 2022-08-05 Wenceslao Shaw Cortez , Jan Drgona , Aaron Tuor , Mahantesh Halappanavar , Draguna Vrabie

The structure and weights of Deep Neural Networks (DNN) typically encode and contain very valuable information about the dataset that was used to train the network. One way to protect this information when DNN is published is to perform an…

Cryptography and Security · Computer Science 2021-04-29 Philip Derbeko , Shlomi Dolev

In this paper, detection of deception attack on deep neural network (DNN) based image classification in autonomous and cyber-physical systems is considered. Several studies have shown the vulnerability of DNN to malicious deception attacks.…

Image and Video Processing · Electrical Eng. & Systems 2020-07-10 Darpan Kumar Yadav , Kartik Mundra , Rahul Modpur , Arpan Chattopadhyay , Indra Narayan Kar

To address the issue that deep neural networks (DNNs) are vulnerable to model inversion attacks, we design an objective function, which adjusts the separability of the hidden data representations, as a way to control the trade-off between…

Machine Learning · Computer Science 2020-10-23 Xiaoxiao Li , Yangsibo Huang , Binghui Peng , Zhao Song , Kai Li

In traditional software programs, it is easy to trace program logic from variables back to input, apply assertion statements to block erroneous behavior, and compose programs together. Although deep learning programs have demonstrated…

Machine Learning · Computer Science 2021-10-27 Mike Wu , Noah Goodman , Stefano Ermon

Deep neural networks (DNNs) have shown remarkable performance improvements on vision-related tasks such as object detection or image segmentation. Despite their success, they generally lack the understanding of 3D objects which form the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Hiroharu Kato , Deniz Beker , Mihai Morariu , Takahiro Ando , Toru Matsuoka , Wadim Kehl , Adrien Gaidon