English
Related papers

Related papers: A Unifying Tensor View for Lightweight CNNs

200 papers

Tensor decomposition is one of the fundamental technique for model compression of deep convolution neural networks owing to its ability to reveal the latent relations among complex structures. However, most existing methods compress the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Bo-Shiuan Chu , Che-Rung Lee

While going deeper has been witnessed to improve the performance of convolutional neural networks (CNN), going smaller for CNN has received increasing attention recently due to its attractiveness for mobile/embedded applications. It remains…

Computer Vision and Pattern Recognition · Computer Science 2017-06-14 Zhe Li , Xiaoyu Wang , Xutao Lv , Tianbao Yang

In this paper we address the problem of representing 3D visual data with parameterized volumetric shape primitives. Specifically, we present a (two-stage) approach built around convolutional neural networks (CNNs) capable of segmenting…

Computer Vision and Pattern Recognition · Computer Science 2020-01-29 Jaka Šircelj , Tim Oblak , Klemen Grm , Uroš Petković , Aleš Jaklič , Peter Peer , Vitomir Štruc , Franc Solina

Face alignment has witnessed substantial progress in the last decade. One of the recent focuses has been aligning a dense 3D face shape to face images with large head poses. The dominant technology used is based on the cascade of…

Computer Vision and Pattern Recognition · Computer Science 2017-07-21 Amin Jourabloo , Mao Ye , Xiaoming Liu , Liu Ren

Deep neural networks (DNNs) have achieved significant success in a variety of real world applications, i.e., image classification. However, tons of parameters in the networks restrict the efficiency of neural networks due to the large model…

Machine Learning · Computer Science 2019-08-21 Yuzhe Ma , Ran Chen , Wei Li , Fanhua Shang , Wenjian Yu , Minsik Cho , Bei Yu

Convolutional Neural Networks (CNNs) can provide accurate object classification. They can be extended to perform object detection by iterating over dense or selected proposed object regions. However, the runtime of such detectors scales as…

Computer Vision and Pattern Recognition · Computer Science 2014-04-08 Forrest Iandola , Matt Moskewicz , Sergey Karayev , Ross Girshick , Trevor Darrell , Kurt Keutzer

High-dimensional data in the form of tensors are challenging for kernel classification methods. To both reduce the computational complexity and extract informative features, kernels based on low-rank tensor decompositions have been…

Machine Learning · Statistics 2023-02-17 Kirandeep Kour , Sergey Dolgov , Peter Benner , Martin Stoll , Max Pfeffer

In the last decade Convolutional Neural Networks (CNNs) have defined the state of the art for many low level image processing and restoration tasks such as denoising, demosaicking, upscaling, or inpainting. However, on-device mobile…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Bartlomiej Wronski

Recently, many view-based 3D model retrieval methods have been proposed and have achieved state-of-the-art performance. Most of these methods focus on extracting more discriminative view-level features and effectively aggregating the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Zan Gao , Yuxiang Shao , Weili Guan , Meng Liu , Zhiyong Cheng , Shengyong Chen

This work introduces a lean CNN (convolutional neural network) framework, with a drastically reduced number of fittable parameters (<81K) compared to the benchmarks in current literature, to capture the underlying low-computational cost…

Materials Science · Physics 2025-05-16 Pranoy Ray , Kamal Choudhury , Surya R. Kalidindi

Modern Convolutional Neural Network (CNN) architectures, despite their superiority in solving various problems, are generally too large to be deployed on resource constrained edge devices. In this paper, we reduce memory usage and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Marawan Gamal Abdel Hameed , Marzieh S. Tahaei , Ali Mosleh , Vahid Partovi Nia

Convolutional Neural Networks (CNNs), architectures consisting of convolutional layers, have been the standard choice in vision tasks. Recent studies have shown that Vision Transformers (VTs), architectures based on self-attention modules,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Kishaan Jeeveswaran , Senthilkumar Kathiresan , Arnav Varma , Omar Magdy , Bahram Zonooz , Elahe Arani

There is an increasing interest in applying deep learning to 3D mesh segmentation. We observe that 1) existing feature-based techniques are often slow or sensitive to feature resizing, 2) there are minimal comparative studies and 3)…

Graphics · Computer Science 2018-02-09 David George , Xianghua Xie , Gary KL Tam

It is well known that Convolutional Neural Networks (CNNs) have significant redundancy in their filter weights. Various methods have been proposed in the literature to compress trained CNNs. These include techniques like pruning weights,…

Machine Learning · Computer Science 2019-06-12 Muhammad Tayyab , Abhijit Mahalanobis

$\rm{SO}(3)$-equivariant networks are the dominant models for machine learning interatomic potentials (MLIPs). The key operation of such networks is the Clebsch-Gordan (CG) tensor product, which is computationally expensive. To accelerate…

Machine Learning · Computer Science 2026-01-14 Yuchao Lin , Cong Fu , Zachary Krueger , Haiyang Yu , Maho Nakata , Jianwen Xie , Emine Kucukbenli , Xiaofeng Qian , Shuiwang Ji

Binary neural networks have great resource and computing efficiency, while suffer from long training procedure and non-negligible accuracy drops, when comparing to the full-precision counterparts. In this paper, we propose the composite…

Machine Learning · Computer Science 2018-11-19 You Qiaoben , Zheng Wang , Jianguo Li , Yinpeng Dong , Yu-Gang Jiang , Jun Zhu

Neural networks have enabled state-of-the-art approaches to achieve incredible results on computer vision tasks such as object detection. However, such success greatly relies on costly computation resources, which hinders people with cheap…

Computer Vision and Pattern Recognition · Computer Science 2019-11-28 Chien-Yao Wang , Hong-Yuan Mark Liao , I-Hau Yeh , Yueh-Hua Wu , Ping-Yang Chen , Jun-Wei Hsieh

In this paper, we introduce Fast&Focused-Net, a novel deep neural network architecture tailored for efficiently encoding small objects into fixed-length feature vectors. Contrary to conventional Convolutional Neural Networks (CNNs),…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Ali Tofik , Roy Partha Pratim

Channel pruning can effectively reduce both computational cost and memory footprint of the original network while keeping a comparable accuracy performance. Though great success has been achieved in channel pruning for 2D image-based…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Yaomin Huang , Ning Liu , Zhengping Che , Zhiyuan Xu , Chaomin Shen , Yaxin Peng , Guixu Zhang , Xinmei Liu , Feifei Feng , Jian Tang

Deep neural networks have enjoyed remarkable success for various vision tasks, however it remains challenging to apply CNNs to domains lacking a regular underlying structures such as 3D point clouds. Towards this we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2018-09-13 Yifan Xu , Tianqi Fan , Mingye Xu , Long Zeng , Yu Qiao