English
Related papers

Related papers: Training for 'Unstable' CNN Accelerator:A Case Stu…

200 papers

Convolutional neural network (CNN) is an important deep learning method. The convolution operation takes a large proportion of the total execution time for CNN. Feature maps for convolution operation are usually sparse. Multiplications and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-01 Weizhi Xu , Yintai Sun , fhengyu Fan , Hui Yu , Xin Fu

Convolutional Neural Networks (CNNs) have shown strong promise for analyzing scientific data from many domains including particle imaging detectors. However, the challenge of choosing the appropriate network architecture (depth, kernel…

Computer Vision and Pattern Recognition · Computer Science 2020-01-13 Duc Hoang , Jesse Hamer , Gabriel N. Perdue , Steven R. Young , Jonathan Miller , Anushree Ghosh

Deformable convolutional networks have demonstrated outstanding performance in object recognition tasks with an effective feature extraction. Unlike standard convolution, the deformable convolution decides the receptive field size using…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-16 Saehyun Ahn , Jung-Woo Chang , Suk-Ju Kang

Convolutional neural networks (CNNs) models play a vital role in achieving state-of-the-art performances in various technological fields. CNNs are not limited to Natural Language Processing (NLP) or Computer Vision (CV) but also have…

Cryptography and Security · Computer Science 2023-11-08 Ehsan Nowroozi , Samaneh Ghelichkhani , Imran Haider , Ali Dehghantanha

In this study we show that a Convolutional Neural Network (CNN) model is able to accuratelydiscriminate between 4 different phases of neurological status in a non-Electroencephalogram(EEG) dataset recorded in an experiment in which subjects…

Signal Processing · Electrical Eng. & Systems 2021-04-06 Mehrad Jaloli , Divya Choudhary , Marzia Cescon

This work presents a novel Convolutional Neural Network (CNN) architecture and a training procedure to enable robust and accurate pose estimation of a noncooperative spacecraft. First, a new CNN architecture is introduced that has scored a…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Tae Ha Park , Sumant Sharma , Simone D'Amico

Recent advances in machine learning have become increasingly popular in the applications of phase transitions and critical phenomena. By machine learning approaches, we try to identify the physical characteristics in the two-dimensional…

Disordered Systems and Neural Networks · Physics 2021-01-25 Shu Cheng , Fei He , Huai Zhang , Ka-Di Zhu , Yaolin Shi

On-device CNN inference for real-time computer vision applications can result in computational demands that far exceed the energy budgets of mobile devices. This paper proposes FixyNN, a co-designed hardware accelerator platform which…

Machine Learning · Computer Science 2019-02-28 Paul Whatmough , Chuteng Zhou , Patrick Hansen , Matthew Mattina

When optimizing convolutional neural networks (CNN) for a specific image-based task, specialists commonly overshoot the number of convolutional layers in their designs. By implication, these CNNs are unnecessarily resource intensive to…

Machine Learning · Computer Science 2022-06-23 Mats L. Richter , Julius Schöning , Anna Wiedenroth , Ulf Krumnack

This work aims to enable on-device training of convolutional neural networks (CNNs) by reducing the computation cost at training time. CNN models are usually trained on high-performance computers and only the trained models are deployed to…

Machine Learning · Computer Science 2020-07-08 Yawen Wu , Zhepeng Wang , Yiyu Shi , Jingtong Hu

Hardware accelerator for convolution neural network (CNNs) enables real time applications of artificial intelligence technology. However, most of the accelerators only support dense CNN computations or suffers complex control to support…

Hardware Architecture · Computer Science 2022-05-06 Kuo-Wei Chang , Tian-Sheuan Chang

Deploying deep convolutional neural network (CNN) models on ubiquitous Internet of Things (IoT) devices has attracted much attention from industry and academia since it greatly facilitates our lives by providing various rapid-response…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-14 Chuntao Ding , Zhichao Lu , Felix Juefei-Xu , Vishnu Naresh Boddeti , Yidong Li , Jiannong Cao

Training a Convolutional Neural Network (CNN) model typically requires significant computing power, and cloud computing resources are widely used as a training environment. However, it is difficult for CNN algorithm developers to keep up…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-22 Sungjae Lee , Yoonseo Hur , Subin Park , Kyungyong Lee

Three important criteria of existing convolutional neural networks (CNNs) are (1) test-set accuracy; (2) out-of-distribution accuracy; and (3) explainability. While these criteria have been studied independently, their relationship is…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Mehdi Nourelahi , Lars Kotthoff , Peijie Chen , Anh Nguyen

Consistency models (CMs) are a powerful class of diffusion-based generative models optimized for fast sampling. Most existing CMs are trained using discretized timesteps, which introduce additional hyperparameters and are prone to…

Machine Learning · Computer Science 2025-03-04 Cheng Lu , Yang Song

Deep convolutional neural networks (CNNs) are the deep learning model of choice for performing object detection, classification, semantic segmentation and natural language processing tasks. CNNs require billions of operations to process a…

Hardware Architecture · Computer Science 2017-08-09 Vinayak Gokhale , Aliasger Zaidy , Andre Xian Ming Chang , Eugenio Culurciello

This technical report presents research results achieved in the field of verification of trained Convolutional Neural Network (CNN) used for image classification in safety-critical applications. As running example, we use the obstacle…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Jan Peleska , Felix Brüning , Mario Gleirscher , Wen-ling Huang

This study develops a neural network-based approach for emulating high-resolution modeled precipitation data with comparable statistical properties but at greatly reduced computational cost. The key idea is to use combination of low- and…

Machine Learning · Computer Science 2021-01-19 Jiali Wang , Zhengchun Liu , Ian Foster , Won Chang , Rajkumar Kettimuthu , Rao Kotamarthi

Transformer neural networks (TNN) excel in natural language processing (NLP), machine translation, and computer vision (CV) without relying on recurrent or convolutional layers. However, they have high computational and memory demands,…

Hardware Architecture · Computer Science 2025-12-30 Ehsan Kabir , Jason D. Bakos , David Andrews , Miaoqing Huang

With the rapid development of in-depth learning, neural network and deep learning algorithms have been widely used in various fields, e.g., image, video and voice processing. However, the neural network model is getting larger and larger,…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-30 Teng Wang , Chao Wang , Xuehai Zhou , Huaping Chen