English
Related papers

Related papers: A Unifying Tensor View for Lightweight CNNs

200 papers

In order to handle modern convolutional neural networks (CNNs) efficiently, a hardware architecture of CNN inference accelerator is proposed to handle depthwise convolutions and regular convolutions, which are both essential building blocks…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Tse-Wei Chen , Wei Tao , Deyu Wang , Dongchao Wen , Kinya Osa , Masami Kato

Very deep convolutional neural networks (CNNs) have been firmly established as the primary methods for many computer vision tasks. However, most state-of-the-art CNNs are large, which results in high inference latency. Recently, depth-wise…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yihui He , Jianing Qian , Jianren Wang , Cindy X. Le , Congrui Hetang , Qi Lyu , Wenping Wang , Tianwei Yue

Inspired by the ConvNets with structured hidden representations, we propose a Tensor-based Neural Network, TCNN. Different from ConvNets, TCNNs are composed of structured neurons rather than scalar neurons, and the basic operation is neuron…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Zhenhua Chen , David Crandall

We present Shape-Tailored Deep Neural Networks (ST-DNN). ST-DNN extend convolutional networks (CNN), which aggregate data from fixed shape (square) neighborhoods, to compute descriptors defined on arbitrarily shaped regions. This is natural…

Computer Vision and Pattern Recognition · Computer Science 2021-02-18 Naeemullah Khan , Angira Sharma , Ganesh Sundaramoorthi , Philip H. S. Torr

As a fundamental part of computational healthcare, Computer Tomography (CT) and Magnetic Resonance Imaging (MRI) provide volumetric data, making the development of algorithms for 3D image analysis a necessity. Despite being computationally…

Image and Video Processing · Electrical Eng. & Systems 2023-07-26 C. I. Ugwu , S. Casarin , O. Lanz

The latest generation of Convolutional Neural Networks (CNN) have achieved impressive results in challenging benchmarks on image recognition and object detection, significantly raising the interest of the community in these methods.…

Computer Vision and Pattern Recognition · Computer Science 2014-11-06 Ken Chatfield , Karen Simonyan , Andrea Vedaldi , Andrew Zisserman

We present a novel layerwise optimization algorithm for the learning objective of Piecewise-Linear Convolutional Neural Networks (PL-CNNs), a large class of convolutional neural networks. Specifically, PL-CNNs employ piecewise linear…

Machine Learning · Computer Science 2017-03-07 Leonard Berrada , Andrew Zisserman , M. Pawan Kumar

Model pruning has become a useful technique that improves the computational efficiency of deep learning, making it possible to deploy solutions in resource-limited scenarios. A widely-used practice in relevant work assumes that a…

Machine Learning · Computer Science 2018-02-06 Jianbo Ye , Xin Lu , Zhe Lin , James Z. Wang

Existing techniques to encode spatial invariance within deep convolutional neural networks only model 2D transformation fields. This does not account for the fact that objects in a 2D space are a projection of 3D ones, and thus they have…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Sunghun Joung , Seungryong Kim , Hanjae Kim , Minsu Kim , Ig-Jae Kim , Junghyun Cho , Kwanghoon Sohn

Point clouds are unstructured and unordered data, as opposed to images. Thus, most machine learning approach developed for image cannot be directly transferred to point clouds. In this paper, we propose a generalization of discrete…

Computer Vision and Pattern Recognition · Computer Science 2020-02-20 Alexandre Boulch

Deep learning models, especially convolutional neural networks (CNNs), have shown considerable promise for biomedical signals such as EEG-based seizure detection. However, these models come with challenges, primarily due to their size and…

Machine Learning · Computer Science 2025-09-08 Mounvik K , N Harshit

Convolutional neural networks (CNNs) for biomedical image analysis are often of very large size, resulting in high memory requirement and high latency of operations. Searching for an acceptable compressed representation of the base CNN for…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Suraj Mishra , Peixian Liang , Adam Czajka , Danny Z. Chen , X. Sharon Hu

In this paper we introduce ShiftCNN, a generalized low-precision architecture for inference of multiplierless convolutional neural networks (CNNs). ShiftCNN is based on a power-of-two weight representation and, as a result, performs only…

Computer Vision and Pattern Recognition · Computer Science 2017-06-09 Denis A. Gudovskiy , Luca Rigazio

In this paper, we present an ultra lightweight system that can effectively recognize different circuit components in an image with very limited training data. Along with the system, we also release the data set we created for the task. A…

Computer Vision and Pattern Recognition · Computer Science 2020-10-02 Yingnan Ju , Yue Chen

Surface meshes are widely used shape representations and capture finer geometry data than point clouds or volumetric grids, but are challenging to apply CNNs directly due to their non-Euclidean structure. We use parallel frames on surface…

Computer Vision and Pattern Recognition · Computer Science 2020-06-15 Yuqi Yang , Shilin Liu , Hao Pan , Yang Liu , Xin Tong

Recent work has shown that convolutional networks can be substantially deeper, more accurate, and efficient to train if they contain shorter connections between layers close to the input and those close to the output. In this paper, we…

Machine Learning · Computer Science 2020-01-09 Gao Huang , Zhuang Liu , Geoff Pleiss , Laurens van der Maaten , Kilian Q. Weinberger

While convolutional neural networks (CNNs) have recently made great strides in supervised classification of data structured on a grid (e.g. images composed of pixel grids), in several interesting datasets, the relations between features can…

Machine Learning · Computer Science 2018-11-02 Shrey Gadiya , Deepak Anand , Amit Sethi

This paper proposes a deep neural network (DNN) for piece-wise planar depthmap reconstruction from a single RGB image. While DNNs have brought remarkable progress to single-image depth prediction, piece-wise planar depthmap reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2018-04-18 Chen Liu , Jimei Yang , Duygu Ceylan , Ersin Yumer , Yasutaka Furukawa

3D reconstruction from a single view image is a long-standing prob-lem in computer vision. Various methods based on different shape representations(such as point cloud or volumetric representations) have been proposed. However,the 3D shape…

Graphics · Computer Science 2020-03-10 Aihua Mao , Canglan Dai , Lin Gao , Ying He , Yong-jin Liu

We propose tensorial neural networks (TNNs), a generalization of existing neural networks by extending tensor operations on low order operands to those on high order ones. The problem of parameter learning is challenging, as it corresponds…

Machine Learning · Statistics 2018-12-11 Jiahao Su , Jingling Li , Bobby Bhattacharjee , Furong Huang