中文
相关论文

相关论文: Training Deep Neural Networks Using Posit Number S…

200 篇论文

Automated feature extraction capability and significant performance of Deep Neural Networks (DNN) make them suitable for Internet of Things (IoT) applications. However, deploying DNN on edge devices becomes prohibitive due to the colossal…

机器学习 · 计算机科学 2022-10-03 Rahul Mishra , Hari Prabhat Gupta

Deep neural networks (DNNs) are efficient solvers for ill-posed problems and have been shown to outperform classical optimization techniques in several computational imaging problems. DNNs are trained by solving an optimization problem…

图像与视频处理 · 电气工程与系统科学 2019-06-14 Mo Deng , Alexandre Goy , Shuai Li , Kwabena Arthur , George Barbastathis

Deep neural networks (DNNs) are successful in many computer vision tasks. However, the most accurate DNNs require millions of parameters and operations, making them energy, computation and memory intensive. This impedes the deployment of…

计算机视觉与模式识别 · 计算机科学 2020-03-26 Abhinav Goel , Caleb Tung , Yung-Hsiang Lu , George K. Thiruvathukal

Deep neural networks (DNNs) have demonstrated their effectiveness in a wide range of computer vision tasks, with the state-of-the-art results obtained through complex and deep structures that require intensive computation and memory.…

神经与进化计算 · 计算机科学 2022-03-24 Ahmad Shawahna , Sadiq M. Sait , Aiman El-Maleh , Irfan Ahmad

Deep Neural Networks (DNN) represent a performance-hungry application. Floating-Point (FP) and custom floating-point-like arithmetic satisfies this hunger. While there is need for speed, inference in DNNs does not seem to have any need for…

机器学习 · 计算机科学 2020-02-11 Christoph Lauter , Anastasia Volkova

The training for deep neural networks (DNNs) demands immense energy consumption, which restricts the development of deep learning as well as increases carbon emissions. Thus, the study of energy-efficient training for DNNs is essential. In…

机器学习 · 计算机科学 2023-03-01 Chang Liu , Rui Zhang , Xishan Zhang , Yifan Hao , Zidong Du , Xing Hu , Ling Li , Qi Guo

Recent advances in image data processing through machine learning and especially deep neural networks (DNNs) allow for new optimization and performance-enhancement schemes for radiation detectors and imaging hardware through data-endowed…

仪器与探测器 · 物理学 2024-02-23 S. Lin , S. Ning , H. Zhu , T. Zhou , C. L. Morris , S. Clayton , M. Cherukara , R. T. Chen , Z. Wang

In this work, we propose an effective scheme (called DP-Net) for compressing the deep neural networks (DNNs). It includes a novel dynamic programming (DP) based algorithm to obtain the optimal solution of weight quantization and an…

机器学习 · 计算机科学 2020-03-24 Dingcheng Yang , Wenjian Yu , Ao Zhou , Haoyuan Mu , Gary Yao , Xiaoyi Wang

This paper introduces an incremental training framework for compressing popular Deep Neural Network (DNN) based unfolded multiple-input-multiple-output (MIMO) detection algorithms like DetNet. The idea of incremental training is explored to…

信息论 · 计算机科学 2021-04-19 Nancy Nayak , Thulasi Tholeti , Muralikrishnan Srinivasan , Sheetal Kalyani

Deep learning algorithms have shown tremendous success in many recognition tasks; however, these algorithms typically include a deep neural network (DNN) structure and a large number of parameters, which makes it challenging to implement…

神经与进化计算 · 计算机科学 2018-04-23 Shihui Yin , Gaurav Srivastava , Shreyas K. Venkataramanaiah , Chaitali Chakrabarti , Visar Berisha , Jae-sun Seo

Deep Neural Networks (DNN) achieve human level performance in many image analytics tasks but DNNs are mostly deployed to GPU platforms that consume a considerable amount of power. New hardware platforms using lower precision arithmetic…

神经与进化计算 · 计算机科学 2017-05-23 Antonio Jimeno Yepes , Jianbin Tang , Benjamin Scott Mashford

Deep neural networks (DNNs) are state-of-the-art algorithms for multiple applications, spanning from image classification to speech recognition. While providing excellent accuracy, they often have enormous compute and memory requirements.…

机器学习 · 计算机科学 2020-11-12 Ussama Zahid , Giulio Gambardella , Nicholas J. Fraser , Michaela Blott , Kees Vissers

The success of deep neural networks (DNNs) is attributable to three factors: increased compute capacity, more complex models, and more data. These factors, however, are not always present, especially for edge applications such as autonomous…

计算机视觉与模式识别 · 计算机科学 2019-08-26 Bichen Wu

The excellent performance of modern deep neural networks (DNNs) comes at an often prohibitive training cost, limiting the rapid development of DNN innovations and raising various environmental concerns. To reduce the dominant data movement…

分布式、并行与集群计算 · 计算机科学 2020-05-13 Hongjie Wang , Yang Zhao , Chaojian Li , Yue Wang , Yingyan Lin

Deep neural networks (DNNs) have revolutionized the field of artificial intelligence and have achieved unprecedented success in cognitive tasks such as image and speech recognition. Training of large DNNs, however, is computationally…

This paper aims at rapid deployment of the state-of-the-art deep neural networks (DNNs) to energy efficient accelerators without time-consuming fine tuning or the availability of the full datasets. Converting DNNs in full precision to…

神经与进化计算 · 计算机科学 2018-10-15 Jun Haeng Lee , Sangwon Ha , Saerom Choi , Won-Jo Lee , Seungwon Lee

Object Detection has been a significant topic in computer vision. As the continuous development of Deep Learning, many advanced academic and industrial outcomes are established on localising and classifying the target objects, such as…

计算机视觉与模式识别 · 计算机科学 2019-07-31 Yingwei Zhou

Deep neural networks (DNNs) have enabled smart applications on hardware devices. However, these hardware devices are vulnerable to unintended faults caused by aging, temperature variance, and write errors. These faults can cause bit-flips…

机器学习 · 计算机科学 2024-12-02 Ninnart Fuengfusin , Hakaru Tamukoh

Deep neural networks (DNNs) depend on the storage of a large number of parameters, which consumes an important portion of the energy used during inference. This paper considers the case where the energy usage of memory elements can be…

机器学习 · 计算机科学 2019-12-24 Sébastien Henwood , François Leduc-Primeau , Yvon Savaria

Motivated by the gap between theoretical optimal approximation rates of deep neural networks (DNNs) and the accuracy realized in practice, we seek to improve the training of DNNs. The adoption of an adaptive basis viewpoint of DNNs leads to…

机器学习 · 计算机科学 2019-12-11 Eric C. Cyr , Mamikon A. Gulian , Ravi G. Patel , Mauro Perego , Nathaniel A. Trask