English
Related papers

Related papers: Tensor network compressibility of convolutional mo…

200 papers

Deep convolutional neural networks trained on large datsets have emerged as an intriguing alternative for compressing images and solving inverse problems such as denoising and compressive sensing. However, it has only recently been realized…

Machine Learning · Computer Science 2019-07-09 Reinhard Heckel

Despite the decomposition of convolutional kernels for lightweight CNNs being well studied, existing works that rely on tensor network diagrams or hyperdimensional abstraction lack geometry intuition. This work devises a new perspective by…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Jason Chun Lok Li , Rui Lin , Jiajun Zhou , Edmund Yin Mun Lam , Ngai Wong

The remarkable performance of deep Convolutional neural networks (CNNs) is generally attributed to their deeper and wider architectures, which can come with significant computational costs. Pruning neural networks has thus gained interest…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Yang He , Lingao Xiao

Convolutional neural networks (CNNs) have achieved impressive results on imbalanced image data, but they still have difficulty generalizing to minority classes and their decisions are difficult to interpret. These problems are related…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Damien Dablain , Kristen N. Jacobson , Colin Bellinger , Mark Roberts , Nitesh Chawla

Convolutional Neural Networks (CNNs) are known for requiring extensive computational resources, and quantization is among the best and most common methods for compressing them. While aggressive quantization (i.e., less than 4-bits) performs…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Shahaf E. Finder , Yair Zohav , Maor Ashkenazi , Eran Treister

Convolutional Neural Networks (CNNs) have shown strong promise for analyzing scientific data from many domains including particle imaging detectors. However, the challenge of choosing the appropriate network architecture (depth, kernel…

Computer Vision and Pattern Recognition · Computer Science 2020-01-13 Duc Hoang , Jesse Hamer , Gabriel N. Perdue , Steven R. Young , Jonathan Miller , Anushree Ghosh

Transformers have quickly shined in the computer vision world since the emergence of Vision Transformers (ViTs). The dominant role of convolutional neural networks (CNNs) seems to be challenged by increasingly effective transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Shiwei Liu , Tianlong Chen , Xiaohan Chen , Xuxi Chen , Qiao Xiao , Boqian Wu , Tommi Kärkkäinen , Mykola Pechenizkiy , Decebal Mocanu , Zhangyang Wang

CNN model is a popular method for imagery analysis, so it could be utilized to recognize handwritten digits based on MNIST datasets. For higher recognition accuracy, various CNN models with different fully connected layer sizes are…

Computer Vision and Pattern Recognition · Computer Science 2021-01-18 Mengyu Chen

Modern Convolutional Neural Network (CNN) architectures, despite their superiority in solving various problems, are generally too large to be deployed on resource constrained edge devices. In this paper, we reduce memory usage and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Marawan Gamal Abdel Hameed , Marzieh S. Tahaei , Ali Mosleh , Vahid Partovi Nia

We propose methodologies to train highly accurate and efficient deep convolutional neural networks (CNNs) for image super resolution (SR). A cascade training approach to deep learning is proposed to improve the accuracy of the neural…

Computer Vision and Pattern Recognition · Computer Science 2017-11-15 Haoyu Ren , Mostafa El-Khamy , Jungwon Lee

For image classification problems, various neural network models are commonly used due to their success in yielding high accuracies. Convolutional Neural Network (CNN) is one of the most frequently used deep learning methods for image…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Ilkay Sikdokur , Inci Baytas , Arda Yurdakul

Conventional Convolutional neural networks (CNN) are trained on large domain datasets and are hence typically over-represented and inefficient in limited class applications. An efficient way to convert such large many-class pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 K. Sai Ram , Jayanta Mukherjee , Amit Patra , Partha Pratim Das

The high demand for computational and storage resources severely impede the deployment of deep convolutional neural networks (CNNs) in limited-resource devices. Recent CNN architectures have proposed reduced complexity versions (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2019-10-17 Souvik Kundu , Saurav Prakash , Haleh Akrami , Peter A. Beerel , Keith M. Chugg

Recent work has shown that convolutional networks can be substantially deeper, more accurate, and efficient to train if they contain shorter connections between layers close to the input and those close to the output. In this paper, we…

Machine Learning · Computer Science 2020-01-09 Gao Huang , Zhuang Liu , Geoff Pleiss , Laurens van der Maaten , Kilian Q. Weinberger

When applying a convolutional kernel to an image, if the output is to remain the same size as the input then some form of padding is required around the image boundary, meaning that for each layer of convolution in a convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Calden Wloka , John K. Tsotsos

Convolutional Neural Networks (CNNs) have recently emerged as the dominant model in computer vision. If provided with enough training data, they predict almost any visual quantity. In a discrete setting, such as classification, CNNs are not…

Computer Vision and Pattern Recognition · Computer Science 2015-11-25 Deepak Pathak , Philipp Krähenbühl , Stella X. Yu , Trevor Darrell

Modern neural networks are usually highly over-parameterized. Behind the wide usage of over-parameterized networks is the belief that, if the data are simple, then the trained network will be automatically equivalent to a simple predictor.…

Machine Learning · Statistics 2025-04-14 Chenyang Zhang , Peifeng Gao , Difan Zou , Yuan Cao

This paper shows that it is possible to train large and deep convolutional neural networks (CNN) for JPEG compression artifacts reduction, and that such networks can provide significantly better reconstruction quality compared to previously…

Computer Vision and Pattern Recognition · Computer Science 2016-05-03 Pavel Svoboda , Michal Hradis , David Barina , Pavel Zemcik

Deep neural networks (DNNs), especially deep convolutional neural networks (CNNs), have emerged as the powerful technique in various machine learning applications. However, the large model sizes of DNNs yield high demands on computation…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Siyu Liao , Zhe Li , Liang Zhao , Qinru Qiu , Yanzhi Wang , Bo Yuan

Convolution kernels are the basic structural component of convolutional neural networks (CNNs). In the last years there has been a growing interest in fisheye cameras for many applications. However, the radially symmetric projection model…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Bruno Berenguel-Baeta , Maria Santos-Villafranca , Jesus Bermudez-Cameo , Alejandro Perez-Yus , Jose J. Guerrero