English
Related papers

Related papers: Binarizing Sparse Convolutional Networks for Effic…

200 papers

This paper addresses the problem of learning a sparse structure Bayesian network from high-dimensional discrete data. Compared to continuous Bayesian networks, learning a discrete Bayesian network is a challenging problem due to the large…

Machine Learning · Computer Science 2022-09-27 Nazanin Shajoonnezhad , Amin Nikanjam

Feature encoding is essential for point cloud analysis. In this paper, we propose a novel point convolution operator named Shell Point Convolution (SPConv) for shape encoding and local context learning. Specifically, SPConv splits 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Yuyan Li , Chuanmao Fan , Xu Wang , Ye Duan

In this paper, we show that extending the butterfly operations from the FFT algorithm to a general Butterfly Transform (BFT) can be beneficial in building an efficient block structure for CNN designs. Pointwise convolutions, which we refer…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Keivan Alizadeh Vahid , Anish Prabhu , Ali Farhadi , Mohammad Rastegari

Reconstruction tasks in computer vision aim fundamentally to recover an undetermined signal from a set of noisy measurements. Examples include super-resolution, image denoising, and non-rigid structure from motion, all of which have seen…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Nathaniel Chodosh , Simon Lucey

The functional and structural representation of the brain as a complex network is marked by the fact that the comparison of noisy and intrinsically correlated high-dimensional structures between experimental conditions or groups shuns…

Neurons and Cognition · Quantitative Biology 2013-10-25 Tommaso Furlanello , Marco Cristoforetti , Cesare Furlanello , Giuseppe Jurman

It is challenging to bridge the performance gap between Binary CNN (BCNN) and Floating point CNN (FCNN). We observe that, this performance gap leads to substantial residuals between intermediate feature maps of BCNN and FCNN. To minimize…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Jianming Ye , Shiliang Zhang , Jingdong Wang

Deep neural networks (DNNs) can be made hardware-efficient by reducing the numerical precision of the weights and activations of the network and by improving the network's resilience to noise. However, this gain in efficiency often comes at…

Convolutional neural networks (CNNs) are reported to be overparametrized. The search for optimal (minimal) and sufficient architecture is an NP-hard problem as the hyperparameter space for possible network configurations is vast. Here, we…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Tin Barisin , Illia Horenko

Graphical modelling techniques based on sparse selection have been applied to infer complex networks in many fields, including biology and medicine, engineering, finance, and social sciences. One structural feature of some of the networks…

Statistics Theory · Mathematics 2020-03-03 Annaliza McGillivray , Abbas Khalili , David A. Stephens

Deep learning with 3D data has progressed significantly since the introduction of convolutional neural networks that can handle point order ambiguity in point cloud data. While being able to achieve good accuracies in various scene…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Zhiyuan Zhang , Binh-Son Hua , Sai-Kit Yeung

This paper tackles the problem of training a deep convolutional neural network of both low-bitwidth weights and activations. Optimizing a low-precision network is very challenging due to the non-differentiability of the quantizer, which may…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Bohan Zhuang , Jing Liu , Mingkui Tan , Lingqiao Liu , Ian Reid , Chunhua Shen

This paper presents a novel Fully Binary Point Cloud Transformer (FBPT) model which has the potential to be widely applied and expanded in the fields of robotics and mobile devices. By compressing the weights and activations of a 32-bit…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Zhixing Hou , Yuzhang Shang , Yan Yan

Compressed Neural Networks have the potential to enable deep learning across new applications and smaller computational environments. However, understanding the range of learning tasks in which such models can succeed is not well studied.…

Machine Learning · Computer Science 2023-08-10 Matt Gorbett , Hossein Shirazi , Indrakshi Ray

Convolution is a central operation in Convolutional Neural Networks (CNNs), which applies a kernel to overlapping regions shifted across the image. However, because of the strong correlations in real-world image data, convolutional kernels…

Convolutional neural networks (CNNs) have been tremendously successful in solving imaging inverse problems. To understand their success, an effective strategy is to construct simpler and mathematically more tractable convolutional sparse…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Tianlin Liu , Anadi Chaman , David Belius , Ivan Dokmanić

Efficiency and robustness are increasingly needed for applications on 3D point clouds, with the ubiquitous use of edge devices in scenarios like autonomous driving and robotics, which often demand real-time and reliable responses. The paper…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Zhuo Su , Max Welling , Matti Pietikäinen , Li Liu

Recently, various convolutions based on continuous or discrete kernels for point cloud processing have been widely studied, and achieve impressive performance in many applications, such as shape classification, scene segmentation and so on.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Dengsheng Chen , Haowen Deng , Jun Li , Duo Li , Yao Duan , Kai Xu

Convolutional neural networks (CNNs) have shown great capability of solving various artificial intelligence tasks. However, the increasing model size has raised challenges in employing them in resource-limited applications. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Hongyang Gao , Zhengyang Wang , Shuiwang Ji

Subspace clustering methods based on data self-expression have become very popular for learning from data that lie in a union of low-dimensional linear subspaces. However, the applicability of subspace clustering has been limited because…

Computer Vision and Pattern Recognition · Computer Science 2019-05-02 Junjian Zhang , Chun-Guang Li , Chong You , Xianbiao Qi , Honggang Zhang , Jun Guo , Zhouchen Lin

For steganalysis, many studies showed that convolutional neural network has better performances than the two-part structure of traditional machine learning methods. However, there are still two problems to be resolved: cutting down signal…

Multimedia · Computer Science 2018-07-31 Ru Zhang , Feng Zhu , Jianyi Liu , Gongshen Liu