English
Related papers

Related papers: FPDeep: Scalable Acceleration of CNN Training on D…

200 papers

Latency and energy consumption are key metrics in the performance of deep neural network (DNN) accelerators. A significant factor contributing to latency and energy is data transfers. One method to reduce transfers or data is reusing data…

Hardware Architecture · Computer Science 2024-10-15 Michael Gilbert , Yannan Nellie Wu , Joel S. Emer , Vivienne Sze

The increasing scale and complexity of integrated circuit design have led to increased challenges in Electronic Design Automation (EDA). Graph Neural Networks (GNNs) have emerged as a promising approach to assist EDA design as circuits can…

Machine Learning · Computer Science 2025-08-26 Yuebo Luo , Shiyang Li , Junran Tao , Kiran Thorat , Xi Xie , Hongwu Peng , Nuo Xu , Caiwen Ding , Shaoyi Huang

We propose distributed deep neural networks (DDNNs) over distributed computing hierarchies, consisting of the cloud, the edge (fog) and end devices. While being able to accommodate inference of a deep neural network (DNN) in the cloud, a…

Computer Vision and Pattern Recognition · Computer Science 2017-09-08 Surat Teerapittayanon , Bradley McDanel , H. T. Kung

This paper is focused on the improvement the efficiency of the sparse convolutional neural networks (CNNs) layers on graphic processing units (GPU). The Nvidia deep neural network (cuDnn) library provides the most effective implementation…

Machine Learning · Computer Science 2022-01-03 Marcin Pietroń , Dominik Żurek

With the rise of artificial intelligence in recent years, Deep Neural Networks (DNNs) have been widely used in many domains. To achieve high performance and energy efficiency, hardware acceleration (especially inference) of DNNs is…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-17 Linghao Song , Jiachen Mao , Youwei Zhuo , Xuehai Qian , Hai Li , Yiran Chen

As the backbone technology of machine learning, deep neural networks (DNNs) have have quickly ascended to the spotlight. Running DNNs on resource-constrained mobile devices is, however, by no means trivial, since it incurs high performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-31 En Li , Zhi Zhou , Xu Chen

Many interesting datasets ubiquitous in machine learning and deep learning can be described via graphs. As the scale and complexity of graph-structured datasets increase, such as in expansive social networks, protein folding, chemical…

Machine Learning · Computer Science 2021-04-06 Matthew T. Dearing , Xiaoyan Wang

Deep neural networks (DNNs) have demonstrated their effectiveness in a wide range of computer vision tasks, with the state-of-the-art results obtained through complex and deep structures that require intensive computation and memory.…

Neural and Evolutionary Computing · Computer Science 2022-03-24 Ahmad Shawahna , Sadiq M. Sait , Aiman El-Maleh , Irfan Ahmad

Several distributed frameworks have been developed to scale Graph Neural Networks (GNNs) on billion-size graphs. On several benchmarks, we observe that the graph partitions generated by these frameworks have heterogeneous data distributions…

Machine Learning · Computer Science 2023-11-07 Dhruv Deshmukh , Gagan Raj Gupta , Manisha Chawla , Vishwesh Jatala , Anirban Haldar

This paper studies inference acceleration using distributed convolutional neural networks (CNNs) in collaborative edge computing network. To avoid inference accuracy loss in inference task partitioning, we propose receptive field-based…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-26 Nan Li , Alexandros Iosifidis , Qi Zhang

This paper presents an instruction-based coordination architecture for Field-Programmable Gate Array (FPGA)-based systems with multiple high-performance Processing Units (PUs) for accelerating Deep Neural Network (DNN) inference. This…

Hardware Architecture · Computer Science 2026-01-06 Anastasios Petropoulos , Theodore Antonakopoulos

The remarkable predictive performance of deep neural networks (DNNs) has led to their adoption in service domains of unprecedented scale and scope. However, the widespread adoption and growing commercialization of DNNs have underscored the…

Machine Learning · Computer Science 2020-07-31 Nandan Kumar Jha , Sparsh Mittal , Binod Kumar , Govardhan Mattela

FPGAs have shown great potential in providing low-latency and energy-efficient solutions for deep neural network (DNN) inference applications. Currently, the majority of FPGA-based DNN accelerators in the cloud run in a time-division…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-30 Shulin Zeng , Guohao Dai , Hanbo Sun , Kai Zhong , Guangjun Ge , Kaiyuan Guo , Yu Wang , Huazhong Yang

Training deep neural networks (DNNs) is a major workload in datacenters today, resulting in a tremendously fast growth of energy consumption. It is important to reduce the energy consumption while completing the DL training jobs early in…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-16 Diandian Gu , Xintong Xie , Gang Huang , Xin Jin , Xuanzhe Liu

Deep Neural Networks (DNN) have achieved human level performance in many image analytics tasks but DNNs are mostly deployed to GPU platforms that consume a considerable amount of power. Brain-inspired spiking neuromorphic chips consume low…

Neural and Evolutionary Computing · Computer Science 2016-05-26 Antonio Jimeno Yepes , Jianbin Tang

Deep neural networks (DNNs) are currently widely used for many artificial intelligence (AI) applications including computer vision, speech recognition, and robotics. While DNNs deliver state-of-the-art accuracy on many AI tasks, it comes at…

Computer Vision and Pattern Recognition · Computer Science 2017-08-15 Vivienne Sze , Yu-Hsin Chen , Tien-Ju Yang , Joel Emer

Most power systems' approaches are currently tending towards stochastic and probabilistic methods due to the high variability of renewable sources and the stochastic nature of loads. Conventional power flow (PF) approaches such as…

Systems and Control · Electrical Eng. & Systems 2024-01-17 Deepak Tiwari , Mehdi Jabbari Zideh , Veeru Talreja , Vishal Verma , Sarika K. Solanki , Jignesh Solanki

DNN training is time-consuming and requires efficient multi-accelerator parallelization, where a single training iteration is split over available accelerators. Current approaches often parallelize training using intra-batch…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-24 Ankita Dutta , Nabendu Chaki , Rajat K. De

Nowadays most research in visual recognition using Convolutional Neural Networks (CNNs) follows the "deeper model with deeper confidence" belief to gain a higher recognition accuracy. At the same time, deeper model brings heavier…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Mohammad Farhadi , Mehdi Ghasemi , Yezhou Yang

Deep-unfolding neural networks (NNs) have received great attention since they achieve satisfactory performance with relatively low complexity. Typically, these deep-unfolding NNs are restricted to a fixed-depth for all inputs. However, the…

Signal Processing · Electrical Eng. & Systems 2023-04-21 Qiyu Hu , Shuhan Shi , Yunlong Cai , Guanding Yu
‹ Prev 1 8 9 10 Next ›