English
Related papers

Related papers: Chain-NN: An Energy-Efficient 1D Chain Architectur…

200 papers

We introduce a new method, called CNNAS (convolutional neural networks for atomistic systems), for calculating the total energy of atomic systems which rivals the computational cost of empirical potentials while maintaining the accuracy of…

Materials Science · Physics 2018-03-21 Kevin Ryczko , Kyle Mills , Iryna Luchak , Christa Homenick , Isaac Tamblyn

Spiking neural networks (SNNs) have closer dynamics to the brain than current deep neural networks. Their low power consumption and sample efficiency make these networks interesting. Recently, several deep convolutional spiking neural…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Shahriar Rezghi Shirsavar , Mohammad-Reza A. Dehaqani

Deep neural networks (DNN) have shown superior performance in a variety of tasks. As they rapidly evolve, their escalating computation and memory demands make it challenging to deploy them on resource-constrained edge devices. Though…

Machine Learning · Computer Science 2021-09-07 Jiaqi Gu , Hanqing Zhu , Chenghao Feng , Mingjie Liu , Zixuan Jiang , Ray T. Chen , David Z. Pan

Dilated and transposed convolutions are widely used in modern convolutional neural networks (CNNs). These kernels are used extensively during CNN training and inference of applications such as image segmentation and high-resolution image…

Convolutional neural networks (CNNs) are widely used for image recognition and text analysis, and have been suggested for application on one-dimensional data as a way to reduce the need for pre-processing steps. Pre-processing is an…

Machine Learning · Computer Science 2020-05-18 Ine L. Jernelv , Dag Roar Hjelme , Yuji Matsuura , Astrid Aksnes

Deep Convolutional Neural Networks (CNNs) are more powerful than Deep Neural Networks (DNN), as they are able to better reduce spectral variation in the input signal. This has also been confirmed experimentally, with CNNs showing…

A convolutional layer in a Convolutional Neural Network (CNN) consists of many filters which apply convolution operation to the input, capture some special patterns and pass the result to the next layer. If the same patterns also occur at…

Computer Vision and Pattern Recognition · Computer Science 2019-02-04 Okan Köpüklü , Maryam Babaee , Stefan Hörmann , Gerhard Rigoll

Convolutional neural networks (CNNs) have revolutionized the world of computer vision over the last few years, pushing image classification beyond human accuracy. The computational effort of today's CNNs requires power-hungry parallel…

Hardware Architecture · Computer Science 2017-02-27 Renzo Andri , Lukas Cavigelli , Davide Rossi , Luca Benini

Despite the remarkable performance, modern deep neural networks are inevitably accompanied by a significant amount of computational cost for learning and deployment, which may be incompatible with their usage on edge devices. Recent efforts…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Seul-Ki Yeom , Kyung-Hwan Shim , Jee-Hyun Hwang

Light-weight convolutional neural networks (CNNs) are specially designed for applications on mobile devices with faster inference speed. The convolutional operation can only capture local information in a window region, which prevents…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Yehui Tang , Kai Han , Jianyuan Guo , Chang Xu , Chao Xu , Yunhe Wang

Convolutional Neural Networks (CNN) have been the centerpiece of many applications including but not limited to computer vision, speech processing, and Natural Language Processing (NLP). However, the computationally expensive convolution…

Emerging Technologies · Computer Science 2019-07-11 Armin Mehrabian , Yousra Al-Kabani , Volker J Sorger , Tarek El-Ghazawi

Convolutional neural networks (CNNs) have been increasingly deployed to edge devices. Hence, many efforts have been made towards efficient CNN inference in resource-constrained platforms. This paper attempts to explore an orthogonal…

Machine Learning · Computer Science 2019-12-09 Yue Wang , Ziyu Jiang , Xiaohan Chen , Pengfei Xu , Yang Zhao , Yingyan Lin , Zhangyang Wang

3D convolution neural networks (CNNs) have been the prevailing option for video recognition. To capture the temporal information, 3D convolutions are computed along the sequences, leading to cubically growing and expensive computations. To…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Junyan Wang , Zhenhong Sun , Yichen Qian , Dong Gong , Xiuyu Sun , Ming Lin , Maurice Pagnucco , Yang Song

Large Deep Neural Networks (DNNs) are the backbone of today's artificial intelligence due to their ability to make accurate predictions when being trained on huge datasets. With advancing technologies, such as the Internet of Things,…

Machine Learning · Computer Science 2023-07-14 Mark Deutel , Philipp Woller , Christopher Mutschler , Jürgen Teich

This paper presents a convolutional neural network (CNN) which can be used for forecasting electricity load profiles 36 hours into the future. In contrast to well established CNN architectures, the input data is one-dimensional. A parameter…

Machine Learning · Computer Science 2019-11-27 Christian Lang , Florian Steinborn , Oliver Steffens , Elmar W. Lang

Light-weight convolutional neural networks (CNNs) have small complexity and are good candidates for low-power, high-throughput inference. Such networks are heterogeneous in terms of computation-to-communication (CTC) ratios and computation…

Hardware Architecture · Computer Science 2021-10-05 Tiandong Zhao , Yunxuan Yu , Kun Wang , Lei He

Deep Convolutional Neural Networks (CNNs) have been widely used in various domains due to their impressive capabilities. These models are typically composed of a large number of 2D convolutional (Conv2D) layers with numerous trainable…

Machine Learning · Computer Science 2022-02-01 Yinan Yu , Samuel Scheidegger , Tomas McKelvey

Semantic Segmentation using deep convolutional neural network pose more complex challenge for any GPU intensive task. As it has to compute million of parameters, it results to huge memory consumption. Moreover, extracting finer features and…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Sharif Amit Kamran , Ali Shihab Sabbir

Convolutional neural network (CNN) is a class of artificial neural networks widely used in computer vision tasks. Most CNNs achieve excellent performance by stacking certain types of basic units. In addition to increasing the depth and…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Junyi An , Fengshan Liu , Jian Zhao , Furao Shen

A novel convolution neural network model, abbreviated NL-CNN is proposed, where nonlinear convolution is emulated in a cascade of convolution + nonlinearity layers. The code for its implementation and some trained models are made publicly…

Machine Learning · Computer Science 2021-02-03 Radu Dogaru , Ioana Dogaru