English
Related papers

Related papers: Convolutional neural networks with low-rank regula…

200 papers

Convolutional Neural Networks (CNNs) have been proven to be extremely successful at solving computer vision tasks. State-of-the-art methods favor such deep network architectures for its accuracy performance, with the cost of having massive…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Jiahui Huang , Kshitij Dwivedi , Gemma Roig

Convolutional neural networks (CNNs) are revolutionizing machine learning, but they present significant computational challenges. Recently, many FPGA-based accelerators have been proposed to improve the performance and efficiency of CNNs.…

Hardware Architecture · Computer Science 2018-04-13 Yongming Shen , Michael Ferdman , Peter Milder

With the rise of deep learning technology in practical applications, Convolutional Neural Networks (CNNs) have been able to assist humans in solving many real-world problems. To enhance the performance of CNNs, numerous network…

Machine Learning · Computer Science 2024-09-10 Qi Wang , Zijun Gao , Mingxiu Sui , Taiyuan Mei , Xiaohan Cheng , Iris Li

Deep convolution neural network has achieved great success in many artificial intelligence applications. However, its enormous model size and massive computation cost have become the main obstacle for deployment of such powerful algorithm…

Computer Vision and Pattern Recognition · Computer Science 2018-07-23 Zhezhi He , Boqing Gong , Deliang Fan

In this paper, we address the issue of how to enhance the generalization performance of convolutional neural networks (CNN) in the early learning stage for image classification. This is motivated by real-time applications that require the…

Computer Vision and Pattern Recognition · Computer Science 2018-05-11 Xishuang Dong , Hsiang-Huang Wu , Yuzhong Yan , Lijun Qian

We propose a convolutional neural network (CNN) architecture for image classification based on subband decomposition of the image using wavelets. The proposed architecture decomposes the input image spectra into multiple critically sampled…

Computer Vision and Pattern Recognition · Computer Science 2021-03-03 Pavel Sinha , Ioannis Psaromiligkos , Zeljko Zilic

Convolutional neural networks (CNNs) have shown very promising performance in recent years for different problems, including object recognition, face recognition, medical image analysis, etc. However, generally the trained CNN models are…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Roshan Reddy Yedla , Shiv Ram Dubey

Convolutional neural networks (CNNs) are used in many embedded applications, from industrial robotics and automation systems to biometric identification on mobile devices. State-of-the-art classification is typically achieved by large…

Machine Learning · Computer Science 2020-05-22 Yuan Wen , Andrew Anderson , Valentin Radu , Michael F. P. O'Boyle , David Gregg

Convolutional neural networks (CNNs) remain a central approach in image classification, but their performance depends strongly on architectural and training choices. This paper presents an empirical ablation-based study of CNN optimization…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Naser Khatti Dizabadi

Convolutional neural networks (CNN) have achieved impressive performance on the wide variety of tasks (classification, detection, etc.) across multiple domains at the cost of high computational and memory requirements. Thus, leveraging CNNs…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Pravendra Singh , Vinay Sameer Raja Kadi , Nikhil Verma , Vinay P. Namboodiri

To apply deep CNNs to mobile terminals and portable devices, many scholars have recently worked on the compressing and accelerating deep convolutional neural networks. Based on this, we propose a novel uniform channel pruning (UCP) method…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Jingfei Chang , Yang Lu , Ping Xue , Xing Wei , Zhen Wei

Tensor decomposition is one of the well-known approaches to reduce the latency time and number of parameters of a pre-trained model. However, in this paper, we propose an approach to use tensor decomposition to reduce training time of…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Mostafa Elhoushi , Ye Henry Tian , Zihao Chen , Farhan Shafiq , Joey Yiwei Li

We propose a local modelling approach using deep convolutional neural networks (CNNs) for fine-grained image classification. Recently, deep CNNs trained from large datasets have considerably improved the performance of object recognition.…

Computer Vision and Pattern Recognition · Computer Science 2015-03-02 ZongYuan Ge , Chris McCool , Conrad Sanderson , Peter Corke

We describe the class of convexified convolutional neural networks (CCNNs), which capture the parameter sharing of convolutional neural networks in a convex manner. By representing the nonlinear convolutional filters as vectors in a…

Machine Learning · Computer Science 2016-09-06 Yuchen Zhang , Percy Liang , Martin J. Wainwright

Training from scratch is the most common way to build a Convolutional Neural Network (CNN) based model. What if we can build new CNN models by reusing parts from previously build CNN models? What if we can improve a CNN model by replacing…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Rangeet Pan , Hridesh Rajan

Compressing DNNs is important for the real-world applications operating on resource-constrained devices. However, we typically observe drastic performance deterioration when changing model size after training is completed. Therefore,…

Machine Learning · Computer Science 2021-09-30 Atsushi Yaguchi , Taiji Suzuki , Shuhei Nitta , Yukinobu Sakata , Akiyuki Tanizawa

Parameter pruning is a promising approach for CNN compression and acceleration by eliminating redundant model parameters with tolerable performance degrade. Despite its effectiveness, existing regularization-based parameter pruning methods…

Machine Learning · Computer Science 2019-04-17 Huan Wang , Qiming Zhang , Yuehai Wang , Yu Lu , Haoji Hu

The emerging edge computing has promoted immense interests in compacting a neural network without sacrificing much accuracy. In this regard, low-rank tensor decomposition constitutes a powerful tool to compress convolutional neural networks…

Machine Learning · Computer Science 2020-03-02 Rui Lin , Ching-Yun Ko , Zhuolun He , Cong Chen , Yuan Cheng , Hao Yu , Graziano Chesi , Ngai Wong

Convolutional neural networks (CNNs) have succeeded in many practical applications. However, their high computation and storage requirements often make them difficult to deploy on resource-constrained devices. In order to tackle this issue,…

Machine Learning · Computer Science 2022-01-14 Tianzong Yu , Chunyuan Zhang , Yuan Wang , Meng Ma , Qi Song

The high demand for computational and storage resources severely impede the deployment of deep convolutional neural networks (CNNs) in limited-resource devices. Recent CNN architectures have proposed reduced complexity versions (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2019-10-17 Souvik Kundu , Saurav Prakash , Haleh Akrami , Peter A. Beerel , Keith M. Chugg