English
Related papers

Related papers: EPSILON: Adaptive Fault Mitigation in Approximate …

200 papers

Fault-tolerant deep learning accelerator is the basis for highly reliable deep learning processing and critical to deploy deep learning in safety-critical applications such as avionics and robotics. Since deep learning is known to be…

Hardware Architecture · Computer Science 2023-12-22 Qing Zhang , Cheng Liu , Bo Liu , Haitong Huang , Ying Wang , Huawei Li , Xiaowei Li

While Deep Neural Networks (DNNs) push the state-of-the-art in many machine learning applications, they often require millions of expensive floating-point operations for each input classification. This computation overhead limits the…

Neural and Evolutionary Computing · Computer Science 2017-05-12 Hokchhay Tann , Soheil Hashemi , Iris Bahar , Sherief Reda

Today's performance analysis frameworks for deep learning accelerators suffer from two significant limitations. First, although modern convolutional neural network (CNNs) consist of many types of layers other than convolution, especially…

Hardware Architecture · Computer Science 2025-01-28 Hadi Esmaeilzadeh , Soroush Ghodrati , Andrew B. Kahng , Sean Kinzer , Susmita Dey Manasi , Sachin S. Sapatnekar , Zhiang Wang

Deep reinforcement learning (RL) is increasingly deployed in resource-constrained environments, yet the go-to function approximators - multilayer perceptrons (MLPs) - are often parameter-inefficient due to an imperfect inductive bias for…

Machine Learning · Computer Science 2026-02-02 Rajib Mostakim , Reza T. Batley , Sourav Saha

Implicit graph neural networks have gained popularity in recent years as they capture long-range dependencies while improving predictive performance in static graphs. Despite the tussle between performance degradation due to the…

Machine Learning · Computer Science 2024-06-27 Yongjian Zhong , Hieu Vu , Tianbao Yang , Bijaya Adhikari

In recent years, transformer models have revolutionized Natural Language Processing (NLP) and shown promising performance on Computer Vision (CV) tasks. Despite their effectiveness, transformers' attention operations are hard to accelerate…

Hardware Architecture · Computer Science 2022-04-26 Zhe Zhou , Junlin Liu , Zhenyu Gu , Guangyu Sun

Edge vision systems combining sensing and embedded processing promise low-latency, decentralized, and energy-efficient solutions that forgo reliance on the cloud. As opposed to conventional frame-based vision sensors, event-based cameras…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Yufeng Yang , Adrian Kneip , Charlotte Frenkel

Deep neural networks (DNN) has received increasing attention in machine learning applications in the last several years. Recently, a non-asymptotic error bound has been developed to measure the performance of the fully connected DNN…

Machine Learning · Statistics 2024-05-15 Kejin Wu , Dimitris N. Politis

Industrial pumps are essential components in various sectors, such as manufacturing, energy production, and water treatment, where their failures can cause significant financial and safety risks. Anomaly detection can be used to reduce…

Signal Processing · Electrical Eng. & Systems 2025-03-11 Jonas Ney , Norbert Wehn

This paper proposes an low power approximate multiplier architecture for deep neural network (DNN) applications. A 4:2 compressor, introducing only a single combination error, is designed and integrated into an 8x8 unsigned multiplier. This…

Hardware Architecture · Computer Science 2025-09-03 Pragun Jaswal , L. Hemanth Krishna , B. Srinivasu

This work presents a two-stage adaptive framework for progressively developing deep neural network (DNN) architectures that generalize well for a given training data set. In the first stage, a layerwise training approach is adopted where a…

Machine Learning · Computer Science 2024-09-24 C G Krishnanunni , Tan Bui-Thanh

Purpose: The primary aim of this study is to enhance fault diagnosis in induction machines by leveraging the Pad\'e Approximant Neuron (PAON) model. While accelerometers and microphones are standard in motor condition monitoring, deep…

Machine Learning · Computer Science 2025-10-15 Sertac Kilickaya , Levent Eren

In this paper, we propose a phase shift deep neural network (PhaseDNN) which provides a wideband convergence in approximating a high dimensional function during its training of the network. The PhaseDNN utilizes the fact that many DNN…

Signal Processing · Electrical Eng. & Systems 2019-05-14 Wei Cai , Xiaoguang Li , Lizuo Liu

The effectiveness of Deep Neural Networks (DNNs) heavily relies on the abundance and accuracy of available training data. However, collecting and annotating data on a large scale is often both costly and time-intensive, particularly in…

Image and Video Processing · Electrical Eng. & Systems 2024-03-28 Yasamin Medghalchi , Niloufar Zakariaei , Arman Rahmim , Ilker Hacihaliloglu

Deep neural networks (DNNs) are increasingly being deployed in safety-critical systems such as personal healthcare devices and self-driving cars. In such DNN-based systems, error resilience is a top priority since faults in DNN inference…

Machine Learning · Computer Science 2021-12-28 Behnam Ghavami , Mani Sadati , Zhenman Fang , Lesley Shannon

Harvesting dense pixel-level annotations to train deep neural networks for semantic segmentation is extremely expensive and unwieldy at scale. While learning from synthetic data where labels are readily available sounds promising,…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Zuxuan Wu , Xintong Han , Yen-Liang Lin , Mustafa Gkhan Uzunbas , Tom Goldstein , Ser Nam Lim , Larry S. Davis

Pruning of deep neural networks has been an effective technique for reducing model size while preserving most of the performance of dense networks, crucial for deploying models on memory and power-constrained devices. While recent sparse…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Andy Li , Aiden Durrant , Milan Markovic , Tianjin Huang , Souvik Kundu , Tianlong Chen , Lu Yin , Georgios Leontidis

With the rapid development of deep learning, Deep Spiking Neural Networks (DSNNs) have emerged as promising due to their unique spike event processing and asynchronous computation. When deployed on neuromorphic chips, DSNNs offer…

Neural and Evolutionary Computing · Computer Science 2024-07-15 Hui Xie , Ge Yang , Wenjuan Gao

Deep neural networks ( DNNs ) are becoming a key enabling technology for many application domains. However, on-device inference on battery-powered, resource-constrained embedding systems is often infeasible due to prohibitively long…

Machine Learning · Computer Science 2019-11-13 Vicent Sanz Marco , Ben Taylor , Zheng Wang , Yehia Elkhatib

Modern software systems generate extensive heterogeneous log data with dynamic formats, fragmented event sequences, and varying temporal patterns, making anomaly detection both crucial and challenging. To address these complexities, we…

Artificial Intelligence · Computer Science 2025-12-17 Przemek Pospieszny , Wojciech Mormul , Karolina Szyndler , Sanjeev Kumar