English
Related papers

Related papers: Drop-Connect as a Fault-Tolerance Approach for RRA…

200 papers

Resistive random access memory (ReRAM) is a promising emerging non-volatile memory (NVM) technology that shows high potential for both data storage and computing. However, its crossbar array architecture leads to the sneak path problem,…

Information Theory · Computer Science 2024-11-20 Xingwei Zhong , Kui Cai , Guanghui Song , Weijie Wang , Yao Zhu

With the widespread deployment of deep neural networks (DNNs), ensuring the reliability of DNN-based systems is of great importance. Serious reliability issues such as system failures can be caused by numerical defects, one of the most…

Software Engineering · Computer Science 2023-04-25 Linyi Li , Yuhao Zhang , Luyao Ren , Yingfei Xiong , Tao Xie

Specialized hardware accelerators have been designed and employed to maximize the performance efficiency of Spiking Neural Networks (SNNs). However, such accelerators are vulnerable to transient faults (i.e., soft errors), which occur due…

Hardware Architecture · Computer Science 2023-03-06 Rachmad Vidya Wicaksana Putra , Muhammad Abdullah Hanif , Muhammad Shafique

On-device learning allows AI models to adapt to user data, thereby enhancing service quality on edge platforms. However, training AI on resource-limited devices poses significant challenges due to the demanding computing workload and the…

Hardware Architecture · Computer Science 2023-12-27 Sai Qian Zhang , Thierry Tambe , Nestor Cuevas , Gu-Yeon Wei , David Brooks

Resistive Random Access Memory (ReRAM) has emerged as a promising platform for deep neural networks (DNNs) due to its support for parallel in-situ matrix-vector multiplication. However, hardware failures, such as stuck-at-fault defects, can…

Machine Learning · Computer Science 2024-01-23 Bingbing Li , Geng Yuan , Zigeng Wang , Shaoyi Huang , Hongwu Peng , Payman Behnam , Wujie Wen , Hang Liu , Caiwen Ding

Computing-in-memory (CIM) is an emerging computing paradigm, offering noteworthy potential for accelerating neural networks with high parallelism, low latency, and energy efficiency compared to conventional von Neumann architectures.…

Neural and Evolutionary Computing · Computer Science 2024-09-30 Kam Chi Loong , Shihao Han , Sishuo Liu , Ning Lin , Zhongrui Wang

The superior performance of Deep Neural Networks (DNNs) has led to their application in various aspects of human life. Safety-critical applications are no exception and impose rigorous reliability requirements on DNNs. Quantized Neural…

Machine Learning · Computer Science 2023-06-19 Mohammad Hasan Ahmadilivani , Mahdi Taheri , Jaan Raik , Masoud Daneshtalab , Maksim Jenihhin

Recurrent neural networks (RNNs) with Long Short-Term memory cells currently hold the best known results in unconstrained handwriting recognition. We show that their performance can be greatly improved using dropout - a recently proposed…

Computer Vision and Pattern Recognition · Computer Science 2014-03-11 Vu Pham , Théodore Bluche , Christopher Kermorvant , Jérôme Louradour

Progress in artificial intelligence and machine learning over the past decade has been driven by the ability to train larger deep neural networks (DNNs), leading to a compute demand that far exceeds the growth in hardware performance…

Hardware Architecture · Computer Science 2023-08-07 Sourjya Roy , Cheng Wang , Anand Raghunathan

Recent advancements in side-channel attacks have revealed the vulnerability of modern Deep Neural Networks (DNNs) to malicious adversarial weight attacks. The well-studied RowHammer attack has effectively compromised DNN performance by…

Hardware Architecture · Computer Science 2024-12-04 Ranyang Zhou , Jacqueline T. Liu , Sabbir Ahmed , Shaahin Angizi , Adnan Siraj Rakin

Deep neural network (DNN) based approaches hold significant potential for reinforcement learning (RL) and have already shown remarkable gains over state-of-art methods in a number of applications. The effectiveness of DNN methods can be…

Machine Learning · Statistics 2017-06-01 Henghui Zhu , Feng Nan , Ioannis Paschalidis , Venkatesh Saligrama

With the widespread use of Deep Neural Networks (DNNs), machine learning algorithms have evolved in two diverse directions -- one with ever-increasing connection density for better accuracy and the other with more compact sizing for energy…

Hardware Architecture · Computer Science 2021-07-07 Gokul Krishnan , Sumit K. Mandal , Chaitali Chakrabarti , Jae-sun Seo , Umit Y. Ogras , Yu Cao

Deep neural networks (DNN) trained in a supervised way suffer from two known problems. First, the minima of the objective function used in learning correspond to data points (also known as rubbish examples or fooling images) that lack…

Machine Learning · Computer Science 2018-11-27 Dmitry Krotov , John J Hopfield

Deep learning methods have shown great promise in many practical applications, ranging from speech recognition, visual object recognition, to text processing. However, most of the current deep learning methods suffer from scalability…

Machine Learning · Statistics 2015-08-31 Yanping Huang , Sai Zhang

On-chip memory (usually based on Static RAMs-SRAMs) are crucial components for various computing devices including heterogeneous devices, e.g., GPUs, FPGAs, ASICs to achieve high performance. Modern workloads such as Deep Neural Networks…

Hardware Architecture · Computer Science 2022-07-20 İsmail Emir Yüksel , Behzad Salami , Oğuz Ergin , Osman Sabri Ünsal , Adrian Cristal Kestelman

Deep neural networks (DNNs) are known vulnerable to adversarial attacks. That is, adversarial examples, obtained by adding delicately crafted distortions onto original legal inputs, can mislead a DNN to classify them as any target labels.…

Cryptography and Security · Computer Science 2018-09-17 Siyue Wang , Xiao Wang , Pu Zhao , Wujie Wen , David Kaeli , Peter Chin , Xue Lin

The effectiveness of deep neural networks (DNN) in vision, speech, and language processing has prompted a tremendous demand for energy-efficient high-performance DNN inference systems. Due to the increasing memory intensity of most DNN…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-15 Skanda Koppula , Lois Orosa , Abdullah Giray Yağlıkçı , Roknoddin Azizi , Taha Shahroodi , Konstantinos Kanellopoulos , Onur Mutlu

Nowadays, the extensive exploitation of Deep Neural Networks (DNNs) in safety-critical applications raises new reliability concerns. In practice, methods for fault injection by emulation in hardware are efficient and widely used to study…

Machine Learning · Computer Science 2023-06-01 Mahdi Taheri , Mohammad Hasan Ahmadilivani , Maksim Jenihhin , Masoud Daneshtalab , Jaan Raik

As deep neural networks continue to expand and become more complex, most edge devices are unable to handle their extensive processing requirements. Therefore, the concept of distributed inference is essential to distribute the neural…

Artificial Intelligence · Computer Science 2023-07-24 Fazeela Mazhar Khan , Emna Baccour , Aiman Erbad , Mounir Hamdi

Deep learning is envisioned to facilitate the operation of wireless receivers, with emerging architectures integrating deep neural networks (DNNs) with traditional modular receiver processing. While deep receivers were shown to operate…

Information Theory · Computer Science 2024-07-15 Nicole Uzlaner , Tomer Raviv , Nir Shlezinger , Koby Todros