English
Related papers

Related papers: KCP: Kernel Cluster Pruning for Dense Labeling Neu…

200 papers

The success of CNNs in various applications is accompanied by a significant increase in the computation and parameter storage costs. Recent efforts toward reducing these overheads involve pruning and compressing the weights of various…

Computer Vision and Pattern Recognition · Computer Science 2017-03-13 Hao Li , Asim Kadav , Igor Durdanovic , Hanan Samet , Hans Peter Graf

In this paper, we propose a compact network called CUNet (compact unsupervised network) to counter the image classification challenge. Different from the traditional convolutional neural networks learning filters by the time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2016-07-07 Le Dong , Ling He , Gaipeng Kong , Qianni Zhang , Xiaochun Cao , Ebroul Izquierdo

Deep neural networks (DNNs) have achieved great success in a wide range of computer vision areas, but the applications to mobile devices is limited due to their high storage and computational cost. Much efforts have been devoted to compress…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Yiming Hu , Jianquan Li , Xianlei Long , Shenhua Hu , Jiagang Zhu , Xingang Wang , Qingyi Gu

Convolutional Neural Networks (CNNs) have a large number of parameters and take significantly large hardware resources to compute, so edge devices struggle to run high-level networks. This paper proposes a novel method to reduce the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Athul Shibu , Abhishek Kumar , Heechul Jung , Dong-Gyu Lee

Recent advances in Artificial Intelligence (AI) on the Internet of Things (IoT)-enabled network edge has realized edge intelligence in several applications such as smart agriculture, smart hospitals, and smart factories by enabling…

Machine Learning · Computer Science 2024-01-18 Muhammad Zawish , Steven Davy , Lizy Abraham

Kernel methods have been successfully applied to the areas of pattern recognition and data mining. In this paper, we mainly discuss the issue of propagating labels in kernel space. A Kernel-Induced Label Propagation (Kernel-LP) framework by…

Computer Vision and Pattern Recognition · Computer Science 2019-06-03 Zhao Zhang , Lei Jia , Mingbo Zhao , Guangcan Liu , Meng Wang , Shuicheng Yan

Deep neural networks (DNNs) are usually over-parameterized to increase the likelihood of getting adequate initial weights by random initialization. Consequently, trained DNNs have many redundancies which can be pruned from the model to…

Machine Learning · Computer Science 2020-09-18 Lukas Enderich , Fabian Timm , Wolfram Burgard

Neural networks have achieved remarkable performance in various application domains. Nevertheless, a large number of weights in pre-trained deep neural networks prohibit them from being deployed on smartphones and embedded systems. It is…

Machine Learning · Computer Science 2023-07-19 Shibo Yao , Dantong Yu , Ioannis Koutis

From the moment Neural Networks dominated the scene for image processing, the computational complexity needed to solve the targeted tasks skyrocketed: against such an unsustainable trend, many strategies have been developed, ambitiously…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Riccardo Renzulli , Marco Grangetto

The deployment of deep convolutional neural networks (CNNs) in many real world applications is largely hindered by their high computational cost. In this paper, we propose a novel learning scheme for CNNs to simultaneously 1) reduce the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-23 Zhuang Liu , Jianguo Li , Zhiqiang Shen , Gao Huang , Shoumeng Yan , Changshui Zhang

As neural networks grow in size and complexity, inference speeds decline. To combat this, one of the most effective compression techniques -- channel pruning -- removes channels from weights. However, for multi-branch segments of a model,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Alvin Wan , Hanxiang Hao , Kaushik Patnaik , Yueyang Xu , Omer Hadad , David Güera , Zhile Ren , Qi Shan

This work explores the scope of Frequent Sequence Mining in the domain of Lossy Image Compression. The proposed work is based on the idea of clustering pixels and using the cluster identifiers in the compression. The DCT phase in JPEG is…

Image and Video Processing · Electrical Eng. & Systems 2026-01-28 Avinash Kadimisetty , Oswald C , Sivaselvan B , Alekhya Kadimisetty

Channel pruning is an important family of methods to speed up deep model's inference. Previous filter pruning algorithms regard channel pruning and model fine-tuning as two independent steps. This paper argues that combining them into a…

Computer Vision and Pattern Recognition · Computer Science 2019-01-18 Jian-Hao Luo , Jianxin Wu

Deep neural network (DNN) model compression for efficient on-device inference is becoming increasingly important to reduce memory requirements and keep user data on-device. To this end, we propose a novel differentiable k-means clustering…

Machine Learning · Computer Science 2022-02-22 Minsik Cho , Keivan A. Vahid , Saurabh Adya , Mohammad Rastegari

Recent work on deep clustering has found new promising methods also for constrained clustering problems. Their typically pairwise constraints often can be used to guide the partitioning of the data. Many problems however, feature…

Machine Learning · Computer Science 2023-05-22 Jonas K. Falkner , Lars Schmidt-Thieme

Deep Convolutional Neural Networks (CNNs) are widely employed in modern computer vision algorithms, where the input image is convolved iteratively by many kernels to extract the knowledge behind it. However, with the depth of convolutional…

Computer Vision and Pattern Recognition · Computer Science 2018-04-11 Chih-Ting Liu , Yi-Heng Wu , Yu-Sheng Lin , Shao-Yi Chien

Due to the over-parameterization of neural networks, many model compression methods based on pruning and quantization have emerged. They are remarkable in reducing the size, parameter number, and computational complexity of the model.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Yun Chu , Pu Li , Yong Bai , Zhuhua Hu , Yongqing Chen , Jiafeng Lu

State-of-the-art semantic segmentation models are characterized by high parameter counts and slow inference times, making them unsuitable for deployment in resource-constrained environments. To address this challenge, we propose…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Konstantin Ditschuneit , Johannes S. Otterbach

Clustering images according to their acquisition devices is a well-known problem in multimedia forensics, which is typically faced by means of camera Sensor Pattern Noise (SPN). Such an issue is challenging since SPN is a noise-like signal,…

Computer Vision and Pattern Recognition · Computer Science 2018-12-03 Quoc-Tin Phan , Giulia Boato , Francesco G. B. De Natale

Neural network pruning is a widely used strategy for reducing model storage and computing requirements. It allows to lower the complexity of the network by introducing sparsity in the weights. Because taking advantage of sparse matrices is…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Nathan Hubens , Matei Mancas , Bernard Gosselin , Marius Preda , Titus Zaharia