English
Related papers

Related papers: SBNet: Sparse Blocks Network for Fast Inference

200 papers

To accelerate deep CNN models, this paper proposes a novel spatially adaptive framework that can dynamically generate pixel-wise sparsity according to the input image. The sparse scheme is pixel-wise refined, regional adaptive under a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Chen Tang , Wenyu Sun , Zhuqing Yuan , Yongpan Liu

3D scenes are dominated by a large number of background points, which is redundant for the detection task that mainly needs to focus on foreground objects. In this paper, we analyze major components of existing sparse 3D CNNs and find that…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Jianhui Liu , Yukang Chen , Xiaoqing Ye , Zhuotao Tian , Xiao Tan , Xiaojuan Qi

Despite strong empirical performance for image classification, deep neural networks are often regarded as ``black boxes'' and they are difficult to interpret. On the other hand, sparse convolutional models, which assume that a signal can be…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Xili Dai , Mingyang Li , Pengyuan Zhai , Shengbang Tong , Xingjian Gao , Shao-Lun Huang , Zhihui Zhu , Chong You , Yi Ma

Object segmentation and structure localization are important steps in automated image analysis pipelines for microscopy images. We present a convolution neural network (CNN) based deep learning architecture for segmentation of objects in…

Computer Vision and Pattern Recognition · Computer Science 2019-01-24 Shan E Ahmed Raza , Linda Cheung , Muhammad Shaban , Simon Graham , David Epstein , Stella Pelengaris , Michael Khan , Nasir M. Rajpoot

Generally, convolutional neural networks (CNNs) process data on a regular grid, e.g. data generated by ordinary cameras. Designing CNNs for sparse and irregularly spaced input data is still an open research problem with numerous…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Abdelrahman Eldesokey , Michael Felsberg , Fahad Shahbaz Khan

Convolutional Neural Networks (CNNs) can provide accurate object classification. They can be extended to perform object detection by iterating over dense or selected proposed object regions. However, the runtime of such detectors scales as…

Computer Vision and Pattern Recognition · Computer Science 2014-04-08 Forrest Iandola , Matt Moskewicz , Sergey Karayev , Ross Girshick , Trevor Darrell , Kurt Keutzer

In this paper, we present a robust method for scene recognition, which leverages Convolutional Neural Networks (CNNs) features and Sparse Coding setting by creating a new representation of indoor scenes. Although CNNs highly benefited the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-28 Guilherme Nascimento , Camila Laranjeira , Vinicius Braz , Anisio Lacerda , Erickson R. Nascimento

Convolutional Neural Networks (CNNs) filter the input data using a series of spatial convolution operators with compactly supported stencils and point-wise nonlinearities. Commonly, the convolution operators couple features from all…

Numerical Analysis · Computer Science 2018-10-04 Eran Treister , Lars Ruthotto , Michal Sharoni , Sapir Zafrani , Eldad Haber

Recurrent Neural Networks (RNNs) are used in state-of-the-art models in domains such as speech recognition, machine translation, and language modelling. Sparsity is a technique to reduce compute and memory requirements of deep learning…

Machine Learning · Computer Science 2017-11-09 Sharan Narang , Eric Undersander , Gregory Diamos

Sparse coding can learn good robust representation to noise and model more higher-order representation for image classification. However, the inference algorithm is computationally expensive even though the supervised signals are used to…

Computer Vision and Pattern Recognition · Computer Science 2015-01-06 Jun Li , Heyou Chang , Jian Yang

In the era of artificial intelligence, convolutional neural networks (CNNs) are emerging as a powerful technique for computational imaging. They have shown superior quality for reconstructing fine textures from badly-distorted images and…

Neural and Evolutionary Computing · Computer Science 2021-04-20 Chao-Tsung Huang

Sparse voxel-based 3D convolutional neural networks (CNNs) are widely used for various 3D vision tasks. Sparse voxel-based 3D CNNs create sparse non-empty voxels from the 3D input and perform 3D convolution operations on them only. We…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Yu-Qi Yang , Peng-Shuai Wang , Yang Liu

Pillar-based 3D object detection has gained traction in self-driving technology due to its speed and accuracy facilitated by the artificial densification of pillars for GPU-friendly processing. However, dense pillar processing fundamentally…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Seongmin Park , Minjae Lee , Junwon Choi , Jungwook Choi

Reconstruction tasks in computer vision aim fundamentally to recover an undetermined signal from a set of noisy measurements. Examples include super-resolution, image denoising, and non-rigid structure from motion, all of which have seen…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Nathaniel Chodosh , Simon Lucey

Convolutional neural networks (CNNs) have seen extensive applications in scientific data analysis, including in neutrino telescopes. However, the data from these experiments present numerous challenges to CNNs, such as non-regular geometry,…

High Energy Physics - Experiment · Physics 2023-08-02 Felix J. Yu , Jeffrey Lazar , Carlos A. Argüelles

We proposed a new Convolution Neural Network implementation optimized for sparse 3D data inference. This implementation uses NanoVDB as the data structure to store the sparse tensor. It leaves a relatively small memory footprint while…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Fangjun Zhou , Anyong Mao , Eftychios Sifakis

Deep neural networks have emerged as powerful tools for learning operators defined over infinite-dimensional function spaces. However, existing theories frequently encounter difficulties related to dimensionality and limited…

Machine Learning · Computer Science 2026-05-12 Jianfei Li , Shuo Huang , Han Feng , Ding-Xuan Zhou , Gitta Kutyniok

The Deep Convolutional Neural Networks (CNNs) have obtained a great success for pattern recognition, such as recognizing the texts in images. But existing CNNs based frameworks still have several drawbacks: 1) the traditaional pooling…

Computer Vision and Pattern Recognition · Computer Science 2020-01-20 Zhao Zhang , Zemin Tang , Zheng Zhang , Yang Wang , Jie Qin , Meng Wang

Convolutional neural network inference on video data requires powerful hardware for real-time processing. Given the inherent coherence across consecutive frames, large parts of a video typically change little. By skipping identical image…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Mathias Parger , Chengcheng Tang , Christopher D. Twigg , Cem Keskin , Robert Wang , Markus Steinberger

Convolutional neural networks are designed for dense data, but vision data is often sparse (stereo depth, point clouds, pen stroke, etc.). We present a method to handle sparse depth data with optional dense RGB, and accomplish depth…

Computer Vision and Pattern Recognition · Computer Science 2018-09-03 Maximilian Jaritz , Raoul de Charette , Emilie Wirbel , Xavier Perrotton , Fawzi Nashashibi