English
Related papers

Related papers: DeepRepair: Style-Guided Repairing for DNNs in the…

200 papers

An increasing number of artificial intelligence (AI) applications involve the execution of deep neural networks (DNNs) on edge devices. Many practical reasons motivate the need to update the DNN model on the edge device post-deployment,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Bo Chen , Ali Bakhshi , Gustavo Batista , Brian Ng , Tat-Jun Chin

Deploying deep neural networks (DNNs) in real-world environments poses challenges due to faults that can manifest in physical hardware from radiation, aging, and temperature fluctuations. To address this, previous works have focused on…

Machine Learning · Computer Science 2024-12-02 Ninnart Fuengfusin , Hakaru Tamukoh

Deep neural networks (DNNs) are becoming increasingly deeper, wider, and non-linear due to the growing demands on prediction accuracy and analysis quality. When training a DNN model, the intermediate activation data must be saved in the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-24 Sian Jin , Guanpeng Li , Shuaiwen Leon Song , Dingwen Tao

We present a deep learning framework for correcting existing dynamical system models utilizing only a scarce high-fidelity data set. In many practical situations, one has a low-fidelity model that can capture the dynamics reasonably well…

Machine Learning · Computer Science 2024-10-24 Caroline Tatsuoka , Dongbin Xiu

A recurring problem faced when training neural networks is that there is typically not enough data to maximize the generalization capability of deep neural networks(DNN). There are many techniques to address this, including data…

Artificial Intelligence · Computer Science 2017-04-26 Joseph Lemley , Shabab Bazrafkan , Peter Corcoran

Modern deep neural networks have a large number of parameters, making them very hard to train. We propose DSD, a dense-sparse-dense training flow, for regularizing deep neural networks and achieving better optimization performance. In the…

Computer Vision and Pattern Recognition · Computer Science 2017-02-23 Song Han , Jeff Pool , Sharan Narang , Huizi Mao , Enhao Gong , Shijian Tang , Erich Elsen , Peter Vajda , Manohar Paluri , John Tran , Bryan Catanzaro , William J. Dally

The standard approach to tackling computer vision problems is to train deep convolutional neural network (CNN) models using large-scale image datasets which are representative of the target task. However, in many scenarios, it is often…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Alhassan Mumuni , Fuseini Mumuni , Nana Kobina Gerrar

This paper introduces deep neural networks (DNNs) as add-on blocks to baseline feedback control systems to enhance tracking performance of arbitrary desired trajectories. The DNNs are trained to adapt the reference signals to the feedback…

Robotics · Computer Science 2017-10-09 Siqi Zhou , Mohamed K. Helwa , Angela P. Schoellig

Deep learning has been widely adopted to tackle various code-based tasks by building deep code models based on a large amount of code snippets. While these deep code models have achieved great success, even state-of-the-art models suffer…

Software Engineering · Computer Science 2023-08-22 Zhao Tian , Junjie Chen , Xiangyu Zhang

We explore the potential of feed-forward deep neural networks (DNNs) for emulating cloud superparameterization in realistic geography, using offline fits to data from the Super Parameterized Community Atmospheric Model. To identify the…

Atmospheric and Oceanic Physics · Physics 2021-06-09 Griffin Mooers , Mike Pritchard , Tom Beucler , Jordan Ott , Galen Yacalis , Pierre Baldi , Pierre Gentine

Edge computing offers an additional layer of compute infrastructure closer to the data source before raw data from privacy-sensitive and performance-critical applications is transferred to a cloud data center. Deep Neural Networks (DNNs)…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-17 Francis McNamee , Schahram Dustadar , Peter Kilpatrick , Weisong Shi , Ivor Spence , Blesson Varghese

DNNs have been quickly and broadly exploited to improve the data analysis quality in many complex science and engineering applications. Today's DNNs are becoming deeper and wider because of increasing demand on the analysis quality and more…

Computer Vision and Pattern Recognition · Computer Science 2019-04-24 Sian Jin , Sheng Di , Xin Liang , Jiannan Tian , Dingwen Tao , Franck Cappello

Deep neural networks (DNNs), are widely used in many industries such as image recognition, supply chain, medical diagnosis, and autonomous driving. However, prior work has shown the high accuracy of a DNN model does not imply high…

Machine Learning · Computer Science 2022-11-28 Guanqin Zhang , Jiankun Sun , Feng Xu , H. M. N. Dilum Bandara , Shiping Chen , Yulei Sui , Tim Menzies

Fault tolerance in Deep Neural Networks (DNNs) deployed on resource-constrained systems presents unique challenges for high-accuracy applications with strict timing requirements. Memory bit-flips can severely degrade DNN accuracy, while…

Deep Neural Networks are well known for efficiently fitting training data, yet experiencing poor generalization capabilities whenever some kind of bias dominates over the actual task labels, resulting in models learning "shortcuts". In…

Machine Learning · Computer Science 2024-08-12 Pietro Morerio , Ruggero Ragonesi , Vittorio Murino

Deep neural networks (DNNs) have shown very promising results for various image restoration (IR) tasks. However, the design of network architectures remains a major challenging for achieving further improvements. While most existing…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Weisheng Dong , Peiyao Wang , Wotao Yin , Guangming Shi , Fangfang Wu , Xiaotong Lu

Deep neural networks (DNNs) have emerged as key enablers of machine learning. Applying larger DNNs to more diverse applications is an important challenge. The computations performed during DNN training and inference are dominated by…

Machine Learning · Computer Science 2018-12-17 Jeremy Kepner , Vijay Gadepally , Hayden Jananthan , Lauren Milechin , Sid Samsi

Deep neural networks (DNN) techniques have become pervasive in domains such as natural language processing and computer vision. They have achieved great success in these domains in task such as machine translation and image generation. Due…

Sound · Computer Science 2023-06-21 Peter Ochieng

Recent deep neural networks (DNNs) can easily overfit to biased training data with noisy labels. Label correction strategy is commonly used to alleviate this issue by designing a method to identity suspected noisy labels and then correct…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Yichen Wu , Jun Shu , Qi Xie , Qian Zhao , Deyu Meng

Deep Neural Networks (DNNs) have revolutionized a wide range of industries, from healthcare and finance to automotive, by offering unparalleled capabilities in data analysis and decision-making. Despite their transforming impact, DNNs face…

Machine Learning · Computer Science 2024-02-08 Zhenyu Liu , Garrett Gagnon , Swagath Venkataramani , Liu Liu