English
Related papers

Related papers: Training Bit Fully Convolutional Network for Fast …

200 papers

We propose a simple two-step approach for speeding up convolution layers within large convolutional neural networks based on tensor decomposition and discriminative fine-tuning. Given a layer, we use non-linear least squares to compute a…

Computer Vision and Pattern Recognition · Computer Science 2015-04-27 Vadim Lebedev , Yaroslav Ganin , Maksim Rakhuba , Ivan Oseledets , Victor Lempitsky

The convolution computation is widely used in many fields, especially in CNNs. Because of the rapid growth of the training data in CNNs, GPUs have been used for the acceleration, and memory-efficient algorithms are focused because of thier…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-02 Qiong Chang , Masaki Onishi , Tsutomu Maruyama

This paper tackles the problem of training a deep convolutional neural network of both low-bitwidth weights and activations. Optimizing a low-precision network is very challenging due to the non-differentiability of the quantizer, which may…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Bohan Zhuang , Jing Liu , Mingkui Tan , Lingqiao Liu , Ian Reid , Chunhua Shen

Successfully tracking the human body is an important perceptual challenge for robots that must work around people. Existing methods fall into two broad categories: geometric tracking and direct pose estimation using machine learning. While…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Weilin Wan , Aaron Walsman , Dieter Fox

In this paper, we exploit a Fully Convolutional Network (FCN) to analyze the audio data of spontaneous speech for dementia detection. A fully convolutional network accommodates speech samples with varying lengths, thus enabling us to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-18 Youxiang Zhu , Xiaohui Liang

Binarized neural networks, or BNNs, show great promise in edge-side applications with resource limited hardware, but raise the concerns of reduced accuracy. Motivated by the complex neural networks, in this paper we introduce complex…

Neural and Evolutionary Computing · Computer Science 2021-04-21 Yanfei Li , Tong Geng , Ang Li , Huimin Yu

This paper considers a convolutional neural network transformation that reduces computation complexity and thus speedups neural network processing. Usage of convolutional neural networks (CNN) is the standard approach to image recognition…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Elena Limonova , Alexander Sheshkus , Dmitry Nikolaev

Existing approaches to train neural networks that use large images require to either crop or down-sample data during pre-processing, use small batch sizes, or split the model across devices mainly due to the prohibitively limited memory…

Image and Video Processing · Electrical Eng. & Systems 2020-03-12 Kushal Datta , Imtiaz Hossain , Sun Choi , Vikram Saletore , Kyle Ambert , William J. Godinez , Xian Zhang

The computational demands of computer vision tasks based on state-of-the-art Convolutional Neural Network (CNN) image classification far exceed the energy budgets of mobile devices. This paper proposes FixyNN, which consists of a…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Paul N. Whatmough , Chuteng Zhou , Patrick Hansen , Shreyas Kolala Venkataramanaiah , Jae-sun Seo , Matthew Mattina

Applications of Fully Convolutional Networks (FCN) in iris segmentation have shown promising advances. For mobile and embedded systems, a significant challenge is that the proposed FCN architectures are extremely computationally demanding.…

Neural and Evolutionary Computing · Computer Science 2019-09-10 Hokchhay Tann , Heng Zhao , Sherief Reda

We present a novel class of Convolutional Neural Networks called Pre-defined Filter Convolutional Neural Networks (PFCNNs), where all nxn convolution kernels with n>1 are pre-defined and constant during training. It involves a special form…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Christoph Linse , Erhardt Barth , Thomas Martinetz

This work presents and analyzes three convolutional neural network (CNN) models for efficient pixelwise classification of images. When using convolutional neural networks to classify single pixels in patches of a whole image, a lot of…

Computer Vision and Pattern Recognition · Computer Science 2015-09-14 Fabian Tschopp

Despite recent advances in multi-scale deep representations, their limitations are attributed to expensive parameters and weak fusion modules. Hence, we propose an efficient approach to fuse multi-scale deep representations, called…

Computer Vision and Pattern Recognition · Computer Science 2016-11-18 Yu Liu , Yanming Guo , Michael S. Lew

Detecting emotions directly from a speech signal plays an important role in effective human-computer interactions. Existing speech emotion recognition models require massive computational and storage resources, making them hard to implement…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-08 Arya Aftab , Alireza Morsali , Shahrokh Ghaemmaghami , Benoit Champagne

In this paper, we propose a novel Convolutional Neural Network (CNN) architecture for learning multi-scale feature representations with good tradeoffs between speed and accuracy. This is achieved by using a multi-branch network, which has…

Computer Vision and Pattern Recognition · Computer Science 2019-08-01 Chun-Fu Chen , Quanfu Fan , Neil Mallinar , Tom Sercu , Rogerio Feris

We present the first fully convolutional end-to-end solution for instance-aware semantic segmentation task. It inherits all the merits of FCNs for semantic segmentation and instance mask proposal. It performs instance mask prediction and…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Yi Li , Haozhi Qi , Jifeng Dai , Xiangyang Ji , Yichen Wei

Fully convolutional networks (FCN) has significantly improved the performance of many pixel-labeling tasks, such as semantic segmentation and depth estimation. However, it still remains non-trivial to thoroughly utilize the multi-level…

Computer Vision and Pattern Recognition · Computer Science 2018-12-05 Yunzhi Zhuge , Pingping Zhang , Huchuan Lu

Fully convolutional neural network (FCN) has been dominating the game of face detection task for a few years with its congenital capability of sliding-window-searching with shared kernels, which boiled down all the redundant calculation,…

Computer Vision and Pattern Recognition · Computer Science 2018-06-05 Guanglu Song , Yu Liu , Ming Jiang , Yujie Wang , Junjie Yan , Biao Leng

We present region-based, fully convolutional networks for accurate and efficient object detection. In contrast to previous region-based detectors such as Fast/Faster R-CNN that apply a costly per-region subnetwork hundreds of times, our…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Jifeng Dai , Yi Li , Kaiming He , Jian Sun

In this paper, we propose a fully convolutional networks for iterative non-blind deconvolution We decompose the non-blind deconvolution problem into image denoising and image deconvolution. We train a FCNN to remove noises in the gradient…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Jiawei Zhang , Jinshan Pan , Wei-Sheng Lai , Rynson Lau , Ming-Hsuan Yang