English
Related papers

Related papers: Pixel-Based Similarities as an Alternative to Neur…

200 papers

Convolution neural networks have achieved remarkable performance in many tasks of computing vision. However, CNN tends to bias to low frequency components. They prioritize capturing low frequency patterns which lead them fail when suffering…

Machine Learning · Computer Science 2020-07-08 Weiyu Guo , Yidong Ouyang

Recent developments in deep learning have revolutionized the paradigm of image restoration. However, its applications on real image denoising are still limited, due to its sensitivity to training data and the complex nature of real image…

Computer Vision and Pattern Recognition · Computer Science 2019-05-06 Jin Zeng , Jiahao Pang , Wenxiu Sun , Gene Cheung

Modern deep neural networks require a tremendous amount of data to train, often needing hundreds or thousands of labeled examples to learn an effective representation. For these networks to work with less data, more structure must be built…

Computer Vision and Pattern Recognition · Computer Science 2019-03-06 Reuben Feinman , Brenden M. Lake

In this work, we investigate the use of sparsity-inducing regularizers during training of Convolution Neural Networks (CNNs). These regularizers encourage that fewer connections in the convolution and fully connected layers take non-zero…

Computer Vision and Pattern Recognition · Computer Science 2014-12-04 Maxwell D. Collins , Pushmeet Kohli

This paper proposes a novel regularization approach to bias Convolutional Neural Networks (CNNs) toward utilizing edge and line features in their hidden layers. Rather than learning arbitrary kernels, we constrain the convolution layers to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Christoph Linse , Beatrice Brückner , Thomas Martinetz

Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance in many computer vision tasks over the years. However, this comes at the cost of heavy computation and memory intensive network designs, suggesting potential…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Kumara Kahatapitiya , Ranga Rodrigo

Convolutional neural network (CNN)-based feature learning has become state of the art, since given sufficient training data, CNN can significantly outperform traditional methods for various classification tasks. However, feature learning…

Machine Learning · Computer Science 2019-12-10 Minxiang Ye , Vladimir Stankovic , Lina Stankovic , Gene Cheung

Recent experiments in computer vision demonstrate texture bias as the primary reason for supreme results in models employing Convolutional Neural Networks (CNNs), conflicting with early works claiming that these networks identify objects…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Satyam Mohla , Anshul Nasery , Biplab Banerjee

An important goal in visual recognition is to devise image representations that are invariant to particular transformations. In this paper, we address this goal with a new type of convolutional neural network (CNN) whose invariance is…

Computer Vision and Pattern Recognition · Computer Science 2015-01-08 Julien Mairal , Piotr Koniusz , Zaid Harchaoui , Cordelia Schmid

Data assisted reconstruction algorithms, incorporating trained neural networks, are a novel paradigm for solving inverse problems. One approach is to first apply a classical reconstruction method and then apply a neural network to improve…

Numerical Analysis · Mathematics 2020-03-26 Yoeri E. Boink , Markus Haltmeier , Sean Holman , Johannes Schwab

Quantization of Convolutional Neural Networks (CNNs) is a common approach to ease the computational burden involved in the deployment of CNNs, especially on low-resource edge devices. However, fixed-point arithmetic is not natural to the…

Machine Learning · Computer Science 2024-06-14 Ido Ben-Yair , Gil Ben Shalom , Moshe Eliasof , Eran Treister

We present deformable unsupervised medical image registration using a randomly-initialized deep convolutional neural network (CNN) as regularization prior. Conventional registration methods predict a transformation by minimizing…

Image and Video Processing · Electrical Eng. & Systems 2019-08-05 Max-Heinrich Laves , Sontje Ihler , Tobias Ortmaier

An emerging new paradigm for solving inverse problems is via the use of deep learning to learn a regularizer from data. This leads to high-quality results, but often at the cost of provable guarantees. In this work, we show how…

Machine Learning · Computer Science 2023-11-06 Zakhar Shumaylov , Jeremy Budd , Subhadip Mukherjee , Carola-Bibiane Schönlieb

Quantized neural network (NN) with a reduced bit precision is an effective solution to reduces the computational and memory resource requirements and plays a vital role in machine learning. However, it is still challenging to avoid the…

Machine Learning · Computer Science 2020-10-23 Xiaobin Li , Hongxu Jiang , Shuangxi Huang , Fangzheng Tian

Learning-based methods especially with convolutional neural networks (CNN) are continuously showing superior performance in computer vision applications, ranging from image classification to restoration. For image classification, most…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Xiaoyu Lin

Measuring the naturalness of images is important to generate realistic images or to detect unnatural regions in images. Additionally, a method to measure naturalness can be complementary to Convolutional Neural Network (CNN) based features,…

Computer Vision and Pattern Recognition · Computer Science 2015-11-11 Hiroharu Kato , Tatsuya Harada

Deep learning algorithms have been known to be vulnerable to adversarial perturbations in various tasks such as image classification. This problem was addressed by employing several defense methods for detection and rejection of particular…

Computer Vision and Pattern Recognition · Computer Science 2017-11-07 Zhun Sun , Mete Ozay , Takayuki Okatani

Recent studies have shown that Convolutional Neural Networks (CNNs) are vulnerable to a small perturbation of input called "adversarial examples". In this work, we propose a new feedforward CNN that improves robustness in the presence of…

Machine Learning · Computer Science 2016-02-26 Jonghoon Jin , Aysegul Dundar , Eugenio Culurciello

Since the Lipschitz properties of convolutional neural networks (CNNs) are widely considered to be related to adversarial robustness, we theoretically characterize the $\ell_1$ norm and $\ell_\infty$ norm of 2D multi-channel convolutional…

Machine Learning · Computer Science 2021-08-17 Youwei Liang , Dong Huang

Several image processing tasks, such as image classification and object detection, have been significantly improved using Convolutional Neural Networks (CNN). Like ResNet and EfficientNet, many architectures have achieved outstanding…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Claudio Filipi Gonçalves dos Santos , João Paulo Papa