English
Related papers

Related papers: PatchShuffle Regularization

200 papers

Despite the success of convolutional neural networks (CNNs) in numerous computer vision tasks and their extraordinary generalization performances, several attempts to predict the generalization errors of CNNs have only been limited to a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Vamshi C. Madala , Shivkumar Chandrasekaran , Jason Bunk

The past few years have witnessed the fast development of different regularization methods for deep learning models such as fully-connected deep neural networks (DNNs) and Convolutional Neural Networks (CNNs). Most of previous methods…

Machine Learning · Computer Science 2018-11-20 Hengyue Pan , Hui Jiang , Xin Niu , Yong Dou

This paper proposes a novel regularization approach to bias Convolutional Neural Networks (CNNs) toward utilizing edge and line features in their hidden layers. Rather than learning arbitrary kernels, we constrain the convolution layers to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Christoph Linse , Beatrice Brückner , Thomas Martinetz

Over-parameterized neural network models often lead to significant performance discrepancies between training and test sets, a phenomenon known as overfitting. To address this, researchers have proposed numerous regularization techniques…

Machine Learning · Computer Science 2025-01-27 RuiZhe Jiang , Haotian Lei

In this paper, we propose a deep convolutional neural network (CNN) for anomaly detection in surveillance videos. The model is adapted from a typical auto-encoder working on video patches under the perspective of sparse combination…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Trong Nguyen Nguyen , Jean Meunier

Recent advances in convolutional neural networks(CNNs) usually come with the expense of excessive computational overhead and memory footprint. Network compression aims to alleviate this issue by training compact models with comparable…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Xin-Yu Zhang , Kai Zhao , Taihong Xiao , Ming-Ming Cheng , Ming-Hsuan Yang

Convolutional neural networks (CNNs) are commonly trained using a fixed spatial image size predetermined for a given model. Although trained on images of aspecific size, it is well established that CNNs can be used to evaluate a wide range…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Elad Hoffer , Berry Weinstein , Itay Hubara , Tal Ben-Nun , Torsten Hoefler , Daniel Soudry

Convolutional Neural Networks (CNN) are state-of-the-art models for many image classification tasks. However, to recognize cancer subtypes automatically, training a CNN on gigapixel resolution Whole Slide Tissue Images (WSI) is currently…

Computer Vision and Pattern Recognition · Computer Science 2016-03-10 Le Hou , Dimitris Samaras , Tahsin M. Kurc , Yi Gao , James E. Davis , Joel H. Saltz

This paper presents a predictive model for estimating regularization parameters of diffeomorphic image registration. We introduce a novel framework that automatically determines the parameters controlling the smoothness of diffeomorphic…

Image and Video Processing · Electrical Eng. & Systems 2022-02-08 Jian Wang , Miaomiao Zhang

Quantization of Convolutional Neural Networks (CNNs) is a common approach to ease the computational burden involved in the deployment of CNNs, especially on low-resource edge devices. However, fixed-point arithmetic is not natural to the…

Machine Learning · Computer Science 2024-06-14 Ido Ben-Yair , Gil Ben Shalom , Moshe Eliasof , Eran Treister

We propose a generalization of convolutional neural networks (CNNs) to irregular domains, through the use of a translation operator on a graph structure. In regular settings such as images, convolutional layers are designed by translating a…

Discrete Mathematics · Computer Science 2018-11-06 Bastien Pasdeloup , Vincent Gripon , Jean-Charles Vialatte , Dominique Pastor , Pascal Frossard

This paper presents a study on the use of Convolutional Neural Networks for camera relocalisation and its application to map compression. We follow state of the art visual relocalisation results and evaluate response to different data…

Computer Vision and Pattern Recognition · Computer Science 2017-03-03 Luis Contreras , Walterio Mayol-Cuevas

Due to their architecture and how they are trained, artificial neural networks are typically not robust toward pruning or shuffling layers at test time. However, such properties would be desirable for different applications, such as…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Matthias Freiberger , Peter Kun , Anders Sundnes Løvlie , Sebastian Risi

Convolutional neural networks (CNNs) have been widely used for image classification. Despite its high accuracies, CNN has been shown to be easily fooled by some adversarial examples, indicating that CNN is not robust enough for pattern…

Computer Vision and Pattern Recognition · Computer Science 2018-05-10 Hong-Ming Yang , Xu-Yao Zhang , Fei Yin , Cheng-Lin Liu

Convolutional neural networks (CNNs) often perform well, but their stability is poorly understood. To address this problem, we consider the simple prototypical problem of signal denoising, where classical approaches such as nonlinear…

Machine Learning · Computer Science 2020-06-09 Tobias Alt , Joachim Weickert , Pascal Peter

Convolutional Neural Networks (CNNs) have become the state-of-the-art in supervised learning vision tasks. Their convolutional filters are of paramount importance for they allow to learn patterns while disregarding their locations in input…

Machine Learning · Computer Science 2017-10-26 Jean-Charles Vialatte , Vincent Gripon , Grégoire Mercier

We conduct an empirical study to test the ability of Convolutional Neural Networks (CNNs) to reduce the effects of nuisance transformations of the input data, such as location, scale and aspect ratio. We isolate factors by adopting a common…

Computer Vision and Pattern Recognition · Computer Science 2016-04-29 Nikolaos Karianakis , Jingming Dong , Stefano Soatto

Convolutional neural networks (CNNs) have been recently used for a variety of histology image analysis. However, availability of a large dataset is a major prerequisite for training a CNN which limits its use by the computational pathology…

Computer Vision and Pattern Recognition · Computer Science 2018-03-07 Ruqayya Awan , Navid Alemi Koohbanani , Muhammad Shaban , Anna Lisowska , Nasir Rajpoot

Standard training techniques for neural networks involve multiple sources of randomness, e.g., initialization, mini-batch ordering and in some cases data augmentation. Given that neural networks are heavily over-parameterized in practice,…

Machine Learning · Computer Science 2021-02-08 Srinadh Bhojanapalli , Kimberly Wilber , Andreas Veit , Ankit Singh Rawat , Seungyeon Kim , Aditya Menon , Sanjiv Kumar

The convolutional neural network (CNN) is vulnerable to degraded images with even very small variations (e.g. corrupted and adversarial samples). One of the possible reasons is that CNN pays more attention to the most discriminative…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Haozhe Liu , Haoqian Wu , Weicheng Xie , Feng Liu , Linlin Shen