English
Related papers

Related papers: DARE: An Irregularity-Tolerant Matrix Processing U…

200 papers

Deep neural networks (DNNs) have substantial computational and memory requirements, and the compilation of its computational graphs has a great impact on the performance of resource-constrained (e.g., computation, I/O, and memory-bound)…

Hardware Architecture · Computer Science 2023-04-11 Jiaqi Yin , Yingjie Li , Daniel Robinson , Cunxi Yu

Many artificial intelligence (AI) devices have been developed to accelerate the training and inference of neural networks models. The most common ones are the Graphics Processing Unit (GPU) and Tensor Processing Unit (TPU). They are highly…

Machine Learning · Computer Science 2022-10-25 xiangyang Ju , Yunsong Wang , Daniel Murnane , Nicholas Choma , Steven Farrell , Paolo Calafiura

Embedded deep learning platforms have witnessed two simultaneous improvements. First, the accuracy of convolutional neural networks (CNNs) has been significantly improved through the use of automated neural-architecture search (NAS)…

Neural and Evolutionary Computing · Computer Science 2019-10-22 Lile Cai , Anne-Maelle Barneche , Arthur Herbout , Chuan Sheng Foo , Jie Lin , Vijay Ramaseshan Chandrasekhar , Mohamed M. Sabry

Ultra-dense network (UDN) is a promising technology to further evolve wireless networks and meet the diverse performance requirements of 5G networks. With abundant access points, each with communication, computation and storage resources,…

Information Theory · Computer Science 2017-09-27 Yuanming Shi , Jun Zhang , Wei Chen , Khaled B. Letaief

Differentiable neural architecture search (DNAS) is known for its capacity in the automatic generation of superior neural networks. However, DNAS based methods suffer from memory usage explosion when the search space expands, which may…

Machine Learning · Computer Science 2021-09-14 Zheyu Yan , Weiwen Jiang , Xiaobo Sharon Hu , Yiyu Shi

Deep Neural Networks (DNNs) are extremely computationally demanding, which presents a large barrier to their deployment on resource-constrained devices. Since such devices are where many emerging deep learning applications lie (e.g.,…

Machine Learning · Computer Science 2023-11-16 Perry Gibson , José Cano , Elliot J. Crowley , Amos Storkey , Michael O'Boyle

Miniaturized autonomous unmanned aerial vehicles (UAVs) are gaining popularity due to their small size, enabling new tasks such as indoor navigation or people monitoring. Nonetheless, their size and simple electronics pose severe challenges…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Matteo Risso , Francesco Daghero , Beatrice Alessandra Motetti , Daniele Jahier Pagliari , Enrico Macii , Massimo Poncino , Alessio Burrello

Compute-in-memory (CIM) has emerged as a pivotal direction for accelerating workloads in the field of machine learning, such as Deep Neural Networks (DNNs). However, the effective exploitation of sparsity in CIM systems presents numerous…

Hardware Architecture · Computer Science 2025-11-21 Yingjie Qi , Jianlei Yang , Rubing Yang , Cenlin Duan , Xiaolin He , Ziyan He , Weitao Pan , Weisheng Zhao

Single-snapshot signal processing in sparse linear arrays has become increasingly vital, particularly in dynamic environments like automotive radar systems, where only limited snapshots are available. These arrays are often utilized either…

Signal Processing · Electrical Eng. & Systems 2025-01-14 Ruxin Zheng , Shunqiao Sun , Hongshan Liu , Yimin D. Zhang

Adversarial attacks have exposed serious vulnerabilities in Deep Neural Networks (DNNs) through their ability to force misclassifications through human-imperceptible perturbations to DNN inputs. We explore a new direction in the field of…

Machine Learning · Computer Science 2020-09-16 Sarada Krithivasan , Sanchari Sen , Anand Raghunathan

Early-exit deep neural networks enable adaptive inference by terminating computation when sufficient confidence is achieved, reducing cost for edge AI accelerators in resource-constrained settings. Existing methods, however, rely on…

Hardware Architecture · Computer Science 2026-03-16 Parth Patne , Mahdi Taheri , Christian Herglotz , Maksim Jenihhin , Milos Krstic , Michael Hübner

The rapidly growing parameter volume of deep neural networks (DNNs) hinders the artificial intelligence applications on resource constrained devices, such as mobile and wearable devices. Neural network pruning, as one of the mainstream…

Machine Learning · Computer Science 2019-11-21 Ao Ren , Tao Zhang , Yuhao Wang , Sheng Lin , Peiyan Dong , Yen-kuang Chen , Yuan Xie , Yanzhi Wang

Field-Programmable Gate Array (FPGA) accelerators have proven successful in handling latency- and resource-critical deep neural network (DNN) inference tasks. Among the most computationally intensive operations in a neural network (NN) is…

Hardware Architecture · Computer Science 2024-12-10 Marta Andronic , George A. Constantinides

Processing visual data on mobile devices has many applications, e.g., emergency response and tracking. State-of-the-art computer vision techniques rely on large Deep Neural Networks (DNNs) that are usually too power-hungry to be deployed on…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Ishmeet Kaur , Adwaita Janardhan Jadhav

EIE proposed to accelerate pruned and compressed neural networks, exploiting weight sparsity, activation sparsity, and 4-bit weight-sharing in neural network accelerators. Since published in ISCA'16, it opened a new design space to…

Hardware Architecture · Computer Science 2023-06-19 Song Han , Xingyu Liu , Huizi Mao , Jing Pu , Ardavan Pedram , Mark A. Horowitz , William J. Dally

Recent work in Deep Learning has re-imagined the representation of data as functions mapping from a coordinate space to an underlying continuous signal. When such functions are approximated by neural networks this introduces a compelling…

Machine Learning · Statistics 2022-08-09 Jonathan Richard Schwarz , Yee Whye Teh

Computer vision on low-power edge devices enables applications including search-and-rescue and security. State-of-the-art computer vision algorithms, such as Deep Neural Networks (DNNs), are too large for inference on low-power edge…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Abhinav Goel , Caleb Tung , Xiao Hu , George K. Thiruvathukal , James C. Davis , Yung-Hsiang Lu

Deep neural network (DNN) architectures, such as convolutional neural networks (CNN), involve heavy computation and require hardware, such as CPU, GPU, and AI accelerators, to provide the massive computing power. With the many varieties of…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Wei Wei , Lingjie Xu , Lingling Jin , Wei Zhang , Tianjun Zhang

Low-resolution infrared (IR) array sensors enable people counting applications such as monitoring the occupancy of spaces and people flows while preserving privacy and minimizing energy consumption. Deep Neural Networks (DNNs) have been…

Our community has greatly improved the efficiency of deep learning applications, including by exploiting sparsity in inputs. Most of that work, though, is for inference, where weight sparsity is known statically, and/or for specialized…

Machine Learning · Computer Science 2020-12-04 Zhangxiaowen Gong , Houxiang Ji , Christopher Fletcher , Christopher Hughes , Josep Torrellas