中文
相关论文

相关论文: BiFSMN: Binary Neural Network for Keyword Spotting

200 篇论文

Multi-task learning for dense prediction has emerged as a pivotal area in computer vision, enabling simultaneous processing of diverse yet interrelated pixel-wise prediction tasks. However, the substantial computational demands of…

计算机视觉与模式识别 · 计算机科学 2024-05-24 Yuzhang Shang , Dan Xu , Gaowen Liu , Ramana Rao Kompella , Yan Yan

Binarized Neural Networks (BNN) offer efficient implementations for machine learning tasks and facilitate Privacy-Preserving Machine Learning (PPML) by simplifying operations with binary values. Nevertheless, challenges persist in terms of…

机器学习 · 计算机科学 2024-12-24 Benchang Dong , Zhili Chen , Xin Chen , Shiwen Wei , Jie Fu , Huifa Li

Binarized Neural Networks (BNNs) significantly reduce the computation and memory demands with binarized weights and activations compared to full-precision NNs. Executing a layer in a BNN on different devices of a heterogeneous…

分布式、并行与集群计算 · 计算机科学 2023-01-13 Leonard David Bereholschi , Ching-Chi Lin , Mikail Yayla , Jian-Jia Chen

Low-precision weights and activations in deep neural networks (DNNs) outperform their full-precision counterparts in terms of hardware efficiency. When implemented with low-precision operations, specifically in the extreme case where…

人工智能 · 计算机科学 2024-07-09 Behnam Ghavami , Mohammad Shahidzadeh , Lesley Shannon , Steve Wilton

Binary neural networks have attracted tremendous attention due to the efficiency for deploying them on mobile devices. Since the weak expression ability of binary weights and features, their accuracy is usually much lower than that of…

机器学习 · 计算机科学 2019-09-18 Mingzhu Shen , Kai Han , Chunjing Xu , Yunhe Wang

We study embedded Binarized Neural Networks (eBNNs) with the aim of allowing current binarized neural networks (BNNs) in the literature to perform feedforward inference efficiently on small embedded devices. We focus on minimizing the…

计算机视觉与模式识别 · 计算机科学 2017-09-08 Bradley McDanel , Surat Teerapittayanon , H. T. Kung

To alleviate the resource constraint for real-time point cloud applications that run on edge devices, in this paper we present BiPointNet, the first model binarization approach for efficient deep learning on point clouds. We discover that…

计算机视觉与模式识别 · 计算机科学 2021-06-14 Haotong Qin , Zhongang Cai , Mingyuan Zhang , Yifu Ding , Haiyu Zhao , Shuai Yi , Xianglong Liu , Hao Su

Efficient inference of Deep Neural Networks (DNNs) is essential to making AI ubiquitous. Two important algorithmic techniques have shown promise for enabling efficient inference - sparsity and binarization. These techniques translate into…

计算机视觉与模式识别 · 计算机科学 2023-12-06 Sachit Kuhar , Alexey Tumanov , Judy Hoffman

Keyword spotting (KWS) provides a critical user interface for many mobile and edge applications, including phones, wearables, and cars. As KWS systems are typically 'always on', maximizing both accuracy and power efficiency are central to…

音频与语音处理 · 电气工程与系统科学 2021-03-11 Peter Blouw , Gurshaant Malik , Benjamin Morcos , Aaron R. Voelker , Chris Eliasmith

Binary Neural Networks (BNNs) enable efficient deep learning by saving on storage and computational costs. However, as the size of neural networks continues to grow, meeting computational requirements remains a challenge. In this work, we…

机器学习 · 计算机科学 2024-07-18 Matt Gorbett , Hossein Shirazi , Indrakshi Ray

Recurrent Neural Networks (RNN) are widely used for learning sequences in applications such as EEG classification. Complex RNNs could be hardly deployed on wearable devices due to their computation and memory-intensive processing patterns.…

信号处理 · 电气工程与系统科学 2020-04-21 Seyed Ahmad Mirsalari , Sima Sinaei , Mostafa E. Salehi , Masoud Daneshtalab

Binarized Neural Network (BNN) removes bitwidth redundancy in classical CNN by using a single bit (-1/+1) for network parameters and intermediate representations, which has greatly reduced the off-chip data transfer and storage overhead.…

机器学习 · 计算机科学 2018-10-05 Cheng Fu , Shilin Zhu , Hao Su , Ching-En Lee , Jishen Zhao

Binary Neural Networks (BNNs) use 1-bit weights and activations to efficiently execute deep convolutional neural networks on edge devices. Nevertheless, the binarization of the first layer is conventionally excluded, as it leads to a large…

机器学习 · 计算机科学 2023-05-05 Lorenzo Vorabbi , Davide Maltoni , Stefano Santi

Deep Neural Networks (DNNs) have gained immense success in cognitive applications and greatly pushed today's artificial intelligence forward. The biggest challenge in executing DNNs is their extremely data-extensive computations. The…

计算机视觉与模式识别 · 计算机科学 2019-09-10 Fuqiang Liu , C. Liu

Binary Neural Networks (BNNs) show promising progress in reducing computational and memory costs but suffer from substantial accuracy degradation compared to their real-valued counterparts on large-scale datasets, e.g., ImageNet. Previous…

机器学习 · 计算机科学 2019-06-21 Joseph Bethge , Haojin Yang , Marvin Bornstein , Christoph Meinel

In this paper, we propose a low-power hardware for efficient deployment of binarized neural networks (BNNs) that have been trained for physiological datasets. BNNs constrain weights and feature-map to 1 bit, can pack in as many 1-bit…

信号处理 · 电气工程与系统科学 2019-03-28 Morteza Hosseini , Hirenkumar Paneliya , Uttej Kallakuri , Mohit Khatwani , Tinoosh Mohsenin

We introduce a method to train Binarized Neural Networks (BNNs) - neural networks with binary weights and activations at run-time. At training-time the binary weights and activations are used for computing the parameters gradients. During…

机器学习 · 计算机科学 2016-03-18 Matthieu Courbariaux , Itay Hubara , Daniel Soudry , Ran El-Yaniv , Yoshua Bengio

Accelerating deep neural network (DNN) inference on resource-limited devices is one of the most important barriers to ensuring a wider and more inclusive adoption. To alleviate this, DNN binary quantization for faster convolution and memory…

机器学习 · 计算机科学 2021-08-24 Meshia Cédric Oveneke

This work proposes deep network models and learning algorithms for unsupervised and supervised binary hashing. Our novel network design constrains one hidden layer to directly output the binary codes. This addresses a challenging issue in…

计算机视觉与模式识别 · 计算机科学 2016-07-19 Thanh-Toan Do , Anh-Dzung Doan , Ngai-Man Cheung

Spoken keyword spotting (KWS) deals with the identification of keywords in audio streams and has become a fast-growing technology thanks to the paradigm shift introduced by deep learning a few years ago. This has allowed the rapid embedding…

声音 · 计算机科学 2021-11-23 Iván López-Espejo , Zheng-Hua Tan , John Hansen , Jesper Jensen