English
Related papers

Related papers: High-Throughput CNN Inference on Embedded ARM big.…

200 papers

Edge computing solutions that enable the extraction of high-level information from a variety of sensors is in increasingly high demand. This is due to the increasing number of smart devices that require sensory processing for their…

Neural and Evolutionary Computing · Computer Science 2024-05-28 Ole Richter , Yannan Xing , Michele De Marchi , Carsten Nielsen , Merkourios Katsimpris , Roberto Cattaneo , Yudi Ren , Yalun Hu , Qian Liu , Sadique Sheik , Tugba Demirci , Ning Qiao

Implementing large-scale deep neural networks with high computational complexity on low-cost IoT devices may inevitably be constrained by limited computation resource, making the devices hard to respond in real-time. This disjunction makes…

Machine Learning · Computer Science 2018-05-25 Yi Yang , Andy Chen , Xiaoming Chen , Jiang Ji , Zhenyang Chen , Yan Dai

Large language models (LLMs) are becoming increasingly capable at small parameter scales. At the same time, conventional cloud-centric deployment introduces challenges around data privacy, latency, and cost that are acute in operational…

Hardware Architecture · Computer Science 2026-04-29 Harri Renney , Fouad Trad , Michael Mattarock , Zena Wood

The exponential growth of Internet of Things (IoT) applications has intensified the demand for efficient, high-throughput, and energy-efficient data processing at the edge. Conventional CPU-centric encryption methods suffer from performance…

Cryptography and Security · Computer Science 2025-06-19 Rasha Karakchi , Rye Stahle-Smith , Nishant Chinnasami , Tiffany Yu

Convolution layers are prevalent in many classes of deep neural networks, including Convolutional Neural Networks (CNNs) which provide state-of-the-art results for tasks like image recognition, neural machine translation and speech…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-22 Evangelos Georganas , Sasikanth Avancha , Kunal Banerjee , Dhiraj Kalamkar , Greg Henry , Hans Pabst , Alexander Heinecke

Efficient and timely calculations of Machine Learning (ML) algorithms are essential for emerging technologies like autonomous driving, the Internet of Things (IoT), and edge computing. One of the primary ML algorithms used in such systems…

Hardware Architecture · Computer Science 2023-08-11 Christopher A. Metz

This paper describes the architecture and performance of ORACLE, an approach for detecting a unique radio from a large pool of bit-similar devices (same hardware, protocol, physical address, MAC ID) using only IQ samples at the physical…

Signal Processing · Electrical Eng. & Systems 2018-12-05 Kunal Sankhe , Mauro Belgiovine , Fan Zhou , Shamnaz Riyaz , Stratis Ioannidis , Kaushik Chowdhury

Internet of Things (IoT) has become a popular paradigm to fulfil needs of the industry such as asset tracking, resource monitoring and automation. As security mechanisms are often neglected during the deployment of IoT devices, they are…

Cryptography and Security · Computer Science 2022-11-21 Martin Kodys , Zhi Lu , Kar Wai Fok , Vrizlynn L. L. Thing

The growth in the complexity of Convolutional Neural Networks (CNNs) is increasing interest in partitioning a network across multiple accelerators during training and pipelining the backpropagation computations over the accelerators.…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-01 Lifu Zhang , Tarek S. Abdelrahman

Convolutional Neural Networks are extensively used in a wide range of applications, commonly including computer vision tasks like image and video classification, recognition, and segmentation. Recent research results demonstrate that…

Signal Processing · Electrical Eng. & Systems 2020-05-11 Marco Carreras , Gianfranco Deriu , Luigi Raffo , Luca Benini , Paolo Meloni

A surge in artificial intelligence and autonomous technologies have increased the demand toward enhanced edge-processing capabilities. Computational complexity and size of state-of-the-art Deep Neural Networks (DNNs) are rising…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-12 Rawan Naous , Lazar Supic , Yoonhwan Kang , Ranko Sredojevic , Anish Singhani , Vladimir Stojanovic

Convolution Neural Networks (CNN) have performed well in many applications such as object detection, pattern recognition, video surveillance and so on. CNN carryout feature extraction on labelled data to perform classification. Multi-label…

Machine Learning · Computer Science 2021-01-28 Tolulope A. Odetola , Ogheneuriri Oderhohwo , Syed Rafay Hasan

With the growing adoption of deep learning for on-device TinyML applications, there has been an ever-increasing demand for efficient neural network backbones optimized for the edge. Recently, the introduction of attention condenser networks…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Alexander Wong , Mohammad Javad Shafiee , Saad Abbasi , Saeejith Nair , Mahmoud Famouri

To train modern large DNN models, pipeline parallelism has recently emerged, which distributes the model across GPUs and enables different devices to process different microbatches in pipeline. Earlier pipeline designs allow multiple…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-23 Ziyue Luo , Xiaodong Yi , Guoping Long , Shiqing Fan , Chuan Wu , Jun Yang , Wei Lin

We revisit large kernel design in modern convolutional neural networks (CNNs). Inspired by recent advances in vision transformers (ViTs), in this paper, we demonstrate that using a few large convolutional kernels instead of a stack of small…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Xiaohan Ding , Xiangyu Zhang , Yizhuang Zhou , Jungong Han , Guiguang Ding , Jian Sun

We introduce an incremental processing scheme for convolutional neural network (CNN) inference, targeted at embedded applications with limited memory budgets. Instead of processing layers one by one, individual input pixels are propagated…

Neural and Evolutionary Computing · Computer Science 2019-05-22 Jonathan Binas , Yoshua Bengio

Legal practitioners and judicial institutions face an ever-growing volume of case-law documents characterised by formalised language, lengthy sentence structures, and highly specialised terminology, making manual triage both time-consuming…

Computation and Language · Computer Science 2026-04-21 Moinul Hossain , Sourav Rabi Das , Zikrul Shariar Ayon , Sadia Afrin Promi , Ahnaf Atef Choudhury , Shakila Rahman , Jia Uddin

Convolutional Neural Networks (CNNs) are currently adopted to solve an ever greater number of problems, ranging from speech recognition to image classification and segmentation. The large amount of processing required by CNNs calls for…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-06 Kamel Abdelouahab , Maxime Pelcat , Jocelyn Serot , François Berry

Deep convolutional neural networks (CNNs) obtain outstanding results in tasks that require human-level understanding of data, like image or speech recognition. However, their computational load is significant, motivating the development of…

Neural and Evolutionary Computing · Computer Science 2019-11-28 Paolo Meloni , Alessandro Capotondi , Gianfranco Deriu , Michele Brian , Francesco Conti , Davide Rossi , Luigi Raffo , Luca Benini

Graph Convolutional Networks (GCNs) is the state-of-the-art method for learning graph-structured data, and training large-scale GCNs requires distributed training across multiple accelerators such that each accelerator is able to hold a…

Machine Learning · Computer Science 2022-03-22 Cheng Wan , Youjie Li , Cameron R. Wolfe , Anastasios Kyrillidis , Nam Sung Kim , Yingyan Lin