English
Related papers

Related papers: Binarizing Sparse Convolutional Networks for Effic…

200 papers

Searching for a more compact network width recently serves as an effective way of channel pruning for the deployment of convolutional neural networks (CNNs) under hardware constraints. To fulfill the searching, a one-shot supernet is…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Xiu Su , Shan You , Jiyang Xie , Fei Wang , Chen Qian , Changshui Zhang , Chang Xu

In this work, we study the 1-bit convolutional neural networks (CNNs), of which both the weights and activations are binary. While being efficient, the classification accuracy of the current 1-bit CNNs is much worse compared to their…

Computer Vision and Pattern Recognition · Computer Science 2018-10-02 Zechun Liu , Baoyuan Wu , Wenhan Luo , Xin Yang , Wei Liu , Kwang-Ting Cheng

Binarized Neural Networks, a recently discovered class of neural networks with minimal memory requirements and no reliance on multiplication, are a fantastic opportunity for the realization of compact and energy efficient inference…

Emerging Technologies · Computer Science 2019-06-04 Tifenn Hirtzlin , Bogdan Penkovsky , Marc Bocquet , Jacques-Olivier Klein , Jean-Michel Portal , Damien Querlioz

In this paper, we propose a novel deep architecture tailored for 3D point cloud applications, named as SPE-Net. The embedded ``Selective Position Encoding (SPE)'' procedure relies on an attention mechanism that can effectively attend to the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Zhaofan Qiu , Yehao Li , Yu Wang , Yingwei Pan , Ting Yao , Tao Mei

Over the past few years, dictionary learning (DL)-based methods have been successfully used in various image reconstruction problems. However, traditional DL-based computed tomography (CT) reconstruction methods are patch-based and ignore…

Deep neural networks, such as the Deep-FSMN, have been widely studied for keyword spotting (KWS) applications while suffering expensive computation and storage. Therefore, network compression technologies like binarization are studied to…

Computation and Language · Computer Science 2023-02-07 Haotong Qin , Xudong Ma , Yifu Ding , Xiaoyang Li , Yang Zhang , Zejun Ma , Jiakai Wang , Jie Luo , Xianglong Liu

With the increased availability of 3D scanning technology, point clouds are moving into the focus of computer vision as a rich representation of everyday scenes. However, they are hard to handle for machine learning algorithms due to their…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Sergey Prokudin , Christoph Lassner , Javier Romero

Modern Convolutional Neural Networks (CNN) are extremely powerful on a range of computer vision tasks. However, their performance may degrade when the data is characterised by large intra-class variability caused by spatial transformations.…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Roberto Annunziata , Christos Sagonas , Jacques Calì

Recent state-of-the-art methods for point cloud processing are based on the notion of point convolution, for which several approaches have been proposed. In this paper, inspired by discrete convolution in image processing, we provide a…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Alexandre Boulch , Gilles Puy , Renaud Marlet

A well-known issue of Batch Normalization is its significantly reduced effectiveness in the case of small mini-batch sizes. When a mini-batch contains few examples, the statistics upon which the normalization is defined cannot be reliably…

Machine Learning · Computer Science 2021-03-26 Zhuliang Yao , Yue Cao , Shuxin Zheng , Gao Huang , Stephen Lin

Convolutional sparse coding (CSC) has been popularly used for the learning of shift-invariant dictionaries in image and signal processing. However, existing methods have limited scalability. In this paper, instead of convolving with a…

Computer Vision and Pattern Recognition · Computer Science 2018-06-08 Yaqing Wang , Quanming Yao , James T. Kwok , Lionel M. Ni

Convolutional neural networks (CNNs) have achieved great success in performing cognitive tasks. However, execution of CNNs requires a large amount of computing resources and generates heavy memory traffic, which imposes a severe challenge…

Hardware Architecture · Computer Science 2021-06-16 Jianlei Yang , Wenzhi Fu , Xingzhou Cheng , Xucheng Ye , Pengcheng Dai , Weisheng Zhao

The rapidly decreasing computation and memory cost has recently driven the success of many applications in the field of deep learning. Practical applications of deep learning in resource-limited hardware, such as embedded devices and smart…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Chunlei Liu , Wenrui Ding , Xin Xia , Baochang Zhang , Jiaxin Gu , Jianzhuang Liu , Rongrong Ji , David Doermann

This paper proposes to learn high-performance deep ConvNets with sparse neural connections, referred to as sparse ConvNets, for face recognition. The sparse ConvNets are learned in an iterative way, each time one additional layer is…

Computer Vision and Pattern Recognition · Computer Science 2015-12-08 Yi Sun , Xiaogang Wang , Xiaoou Tang

Sparse Subspace Clustering (SSC) is a state-of-the-art method for clustering high-dimensional data points lying in a union of low-dimensional subspaces. However, while $\ell_1$ optimization-based SSC algorithms suffer from high…

Machine Learning · Computer Science 2018-02-14 Yanxi Chen , Gen Li , Yuantao Gu

We consider the optimization of deep convolutional neural networks (CNNs) such that they provide good performance while having reduced complexity if deployed on either conventional systems utilizing spatial-domain convolution or lower…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Yoojin Choi , Mostafa El-Khamy , Jungwon Lee

Binary neural networks have attracted numerous attention in recent years. However, mainly due to the information loss stemming from the biased binarization, how to preserve the accuracy of networks still remains a critical issue. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-02-12 Mingzhu Shen , Xianglong Liu , Ruihao Gong , Kai Han

Shift neural networks reduce computation complexity by removing expensive multiplication operations and quantizing continuous weights into low-bit discrete values, which are fast and energy efficient compared to conventional neural…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Xinlin Li , Bang Liu , Yaoliang Yu , Wulong Liu , Chunjing Xu , Vahid Partovi Nia

We propose a novel scene flow estimation approach to capture and infer 3D motions from point clouds. Estimating 3D motions for point clouds is challenging, since a point cloud is unordered and its density is significantly non-uniform. Such…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Bing Li , Cheng Zheng , Silvio Giancola , Bernard Ghanem

Spectral Clustering (SC) is one of the most widely used methods for data clustering. It first finds a low-dimensonal embedding $U$ of data by computing the eigenvectors of the normalized Laplacian matrix, and then performs k-means on…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Canyi Lu , Shuicheng Yan , Zhouchen Lin
‹ Prev 1 8 9 10 Next ›