English
Related papers

Related papers: Efficient Triple Modular Redundancy for Reliabilit…

200 papers

Conditional computation for Deep Neural Networks (DNNs) reduce overall computational load and improve model accuracy by running a subset of the network. In this work, we present a runtime throttleable neural network (TNN) that can…

Machine Learning · Computer Science 2020-11-06 Hengyue Liu , Samyak Parajuli , Jesse Hostetler , Sek Chai , Bir Bhanu

Recent studies have highlighted that deep neural networks (DNNs) are vulnerable to adversarial examples. In this paper, we improve the robustness of DNNs by utilizing techniques of Distance Metric Learning. Specifically, we incorporate…

Machine Learning · Computer Science 2019-05-29 Pengcheng Li , Jinfeng Yi , Bowen Zhou , Lijun Zhang

We introduce Dynamic Nested Depth (DND), a novel method that improves performance for off-the-shelf LLMs by selecting critical tokens to reprocess in a nested depth manner. Specifically, at the end of the given transformer layer, DND…

Computation and Language · Computer Science 2026-01-28 Tieyuan Chen , Xiaodong Chen , Haoxing Chen , Zhenzhong Lan , Weiyao Lin , Jianguo Li

Transformer-based deep NLP models are trained using hundreds of millions of parameters, limiting their applicability in computationally constrained environments. In this paper, we study the cause of these limitations by defining a notion of…

Computation and Language · Computer Science 2020-10-07 Fahim Dalvi , Hassan Sajjad , Nadir Durrani , Yonatan Belinkov

Deep neural networks (DNNs) demonstrate outstanding performance across most computer vision tasks. Some critical applications, such as autonomous driving or medical imaging, also require investigation into their behavior and the reasons…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Edouard Yvinec , Arnaud Dapogny , Kevin Bailly , Xavier Fischer

With the rapid growth of machine learning, deep neural networks (DNNs) are now being used in numerous domains. Unfortunately, DNNs are "black-boxes", and cannot be interpreted by humans, which is a substantial concern in safety-critical…

Machine Learning · Computer Science 2023-02-10 Shahaf Bassan , Guy Katz

Deep neural networks (DNNs) are a type of artificial intelligence models that are inspired by the structure and function of the human brain, designed to process and learn from large amounts of data, making them particularly well-suited for…

Hardware Architecture · Computer Science 2024-07-18 Alireza Senobari , Jafar Vafaei , Omid Akbari , Christian Hochberger , Muhammad Shafique

Explainability has been widely stated as a cornerstone of the responsible and trustworthy use of machine learning models. With the ubiquitous use of Deep Neural Network (DNN) models expanding to risk-sensitive and safety-critical domains,…

Two-Phase TMR conserves energy by partitioning redundancy operations into two stages and making the execution of the third task copy optional, yet it remains susceptible to permanent faults. Reactive-TMR (R-TMR) counters this by isolating…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-30 Yiming Hu

Deep Neural Networks (DNNs) enable a wide series of technological advancements, ranging from clinical imaging, to predictive industrial maintenance and autonomous driving. However, recent findings indicate that transient hardware faults may…

Machine Learning · Computer Science 2022-05-31 Niccolò Cavagnero , Fernando Dos Santos , Marco Ciccone , Giuseppe Averta , Tatiana Tommasi , Paolo Rech

A Deep Neural Network (DNN) based algorithm is proposed for the detection and classification of faults in industrial plants. The proposed algorithm has the ability to classify faults, especially incipient faults that are difficult to detect…

Machine Learning · Computer Science 2022-12-02 Piyush Agarwal , Jorge Ivan Mireles Gonzalez , Ali Elkamel , Hector Budman

For critical applications that require a higher level of reliability, the Triple Modular Redundancy (TMR) scheme is usually employed to implement fault-tolerant arithmetic units. However, this method imposes a significant area and…

Hardware Architecture · Computer Science 2024-10-29 Jafar Vafaei , Omid Akbari

Deep reinforcement learning has been extensively studied in decision-making processes and has demonstrated superior performance over conventional approaches in various fields, including radar resource management (RRM). However, a notable…

Machine Learning · Computer Science 2025-06-27 Ziyang Lu , M. Cenk Gursoy , Chilukuri K. Mohan , Pramod K. Varshney

Deep learning has demonstrated success in many applications; however, their use in healthcare has been limited due to the lack of transparency into how they generate predictions. Algorithms such as Recurrent Neural Networks (RNNs) when…

Machine Learning · Computer Science 2021-01-14 Long V. Ho , Melissa D. Aczon , David Ledbetter , Randall Wetzel

Deep learning (DL) algorithms are becoming ubiquitous in everyday life and in scientific research. However, the price we pay for their impressively accurate predictions is significant: their inner workings are notoriously opaque - it is…

Machine Learning · Computer Science 2026-01-26 Florian J. Boge , Annika Schuster

Recent research has developed a number of eXplainable AI (XAI) techniques, such as gradient-based approaches, input perturbation-base methods, and black-box explanation methods. While these XAI techniques can extract meaningful insights…

Machine Learning · Computer Science 2025-03-10 Xu Zheng , Farhad Shirani , Zhuomin Chen , Chaohao Lin , Wei Cheng , Wenbo Guo , Dongsheng Luo

Recurrent Neural Networks (RNNs) are useful in temporal sequence tasks. However, training RNNs involves dense matrix multiplications which require hardware that can support a large number of arithmetic operations and memory accesses.…

Machine Learning · Computer Science 2023-12-18 Xi Chen , Chang Gao , Zuowen Wang , Longbiao Cheng , Sheng Zhou , Shih-Chii Liu , Tobi Delbruck

Deep neural networks (DNNs) are increasingly being deployed in safety-critical systems such as personal healthcare devices and self-driving cars. In such DNN-based systems, error resilience is a top priority since faults in DNN inference…

Machine Learning · Computer Science 2021-12-28 Behnam Ghavami , Mani Sadati , Zhenman Fang , Lesley Shannon

State of the art Deep Neural Networks (DNN) can now achieve above human level accuracy on image classification tasks. However their outstanding performances come along with a complex inference mechanism making them arduously interpretable…

Machine Learning · Computer Science 2019-11-07 Fei Wu , Thomas Michel , Alexandre Briot

Deep Neural Networks (DNN) have found numerous applications in various domains, including fraud detection, medical diagnosis, facial recognition, and autonomous driving. However, DNN-based systems often suffer from reliability issues due to…

Software Engineering · Computer Science 2025-01-23 Sigma Jahan , Mehil B Shah , Parvez Mahbub , Mohammad Masudur Rahman