English
Related papers

Related papers: Avoiding Overfitting: A Survey on Regularization M…

200 papers

Image Augmentations are widely used to reduce overfitting in neural networks. However, the explainability of their benefits largely remains a mystery. We study which layers of residual neural networks (ResNets) are most affected by…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Matthew Iceland , Christopher Kanan

Increasingly more similarities between human vision and convolutional neural networks (CNNs) have been revealed in the past few years. Yet, vanilla CNNs often fall short in generalizing to adversarial or out-of-distribution (OOD) examples…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Peijie Chen , Chirag Agarwal , Anh Nguyen

We present deformable unsupervised medical image registration using a randomly-initialized deep convolutional neural network (CNN) as regularization prior. Conventional registration methods predict a transformation by minimizing…

Image and Video Processing · Electrical Eng. & Systems 2019-08-05 Max-Heinrich Laves , Sontje Ihler , Tobias Ortmaier

Machine learning methods such as convolutional neural networks (CNNs) are becoming an integral part of scientific research in many disciplines, spatial vector data often fail to be analyzed using these powerful learning methods because of…

Machine Learning · Statistics 2018-09-24 Xiongfeng Yan , Tinghua Ai

Convolutional Neural Networks (CNN) for image recognition tasks are seeing rapid advances in the available architectures and how networks are trained based on large computational infrastructure and standard datasets with millions of images.…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Thomas Cherico Wanger , Peter Frohn

While Convolutional Neural Networks (CNNs) trained for image and video super-resolution (SR) regularly achieve new state-of-the-art performance, they also suffer from significant drawbacks. One of their limitations is their lack of…

Image and Video Processing · Electrical Eng. & Systems 2020-06-16 Alice Lucas , Santiago Lopez-Tapia , Rafael Molina , Aggelos K. Katsaggelos

Normalization techniques are essential for accelerating the training and improving the generalization of deep neural networks (DNNs), and have successfully been used in various applications. This paper reviews and comments on the past,…

Machine Learning · Computer Science 2020-09-29 Lei Huang , Jie Qin , Yi Zhou , Fan Zhu , Li Liu , Ling Shao

Assisted by the availability of data and high performance computing, deep learning techniques have achieved breakthroughs and surpassed human performance empirically in difficult tasks, including object recognition, speech recognition, and…

Machine Learning · Computer Science 2019-01-23 Shaeke Salman , Xiuwen Liu

One popular strategy for image denoising is to design a generalized regularization term that is capable of exploring the implicit prior underlying data observation. Convolutional neural networks (CNN) have shown the powerful capability to…

Image and Video Processing · Electrical Eng. & Systems 2019-10-22 Peng Liu , Xiaoxiao Zhou , Junyiyang Li , El Basha Mohammad D , Ruogu Fang

The splendid success of convolutional neural networks (CNNs) in computer vision is largely attributable to the availability of massive annotated datasets, such as ImageNet and Places. However, in medical imaging, it is challenging to create…

Machine Learning · Computer Science 2021-04-13 Zongwei Zhou , Jae Y. Shin , Suryakanth R. Gurudu , Michael B. Gotway , Jianming Liang

In search of robust and generalizable machine learning models, Domain Generalization (DG) has gained significant traction during the past few years. The goal in DG is to produce models which continue to perform well when presented with data…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Aristotelis Ballas , Christos Diou

In this survey paper, we review recent uses of convolution neural networks (CNNs) to solve inverse problems in imaging. It has recently become feasible to train deep CNNs on large databases of images, and they have shown outstanding…

Image and Video Processing · Electrical Eng. & Systems 2018-09-11 Michael T. McCann , Kyong Hwan Jin , Michael Unser

Deep Neural networks are efficient and flexible models that perform well for a variety of tasks such as image, speech recognition and natural language understanding. In particular, convolutional neural networks (CNN) generate a keen…

Machine Learning · Computer Science 2018-12-20 Yesmina Jaafra , Jean Luc Laurent , Aline Deruyver , Mohamed Saber Naceur

Convolutional Neural Networks (CNNs) have recently emerged as the dominant model in computer vision. If provided with enough training data, they predict almost any visual quantity. In a discrete setting, such as classification, CNNs are not…

Computer Vision and Pattern Recognition · Computer Science 2015-11-25 Deepak Pathak , Philipp Krähenbühl , Stella X. Yu , Trevor Darrell

Convolutional Neural Networks (CNNs) define an exceptionally powerful class of models for image classification, but the theoretical background and the understanding of how invariances to certain transformations are learned is limited. In a…

Computer Vision and Pattern Recognition · Computer Science 2018-03-19 Charlotte Bunne , Lukas Rahmann , Thomas Wolf

Object localization has a vital role in any object detector, and therefore, has been the focus of attention by many researchers. In this article, a special training approach is proposed for a light convolutional neural network (CNN) to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Faraz Lotfi , Farnoosh Faraji , Hamid D. Taghirad

Despite their impressive performance, Deep Neural Networks (DNNs) typically underperform Gradient Boosting Trees (GBTs) on many tabular-dataset learning tasks. We propose that applying a different regularization coefficient to each weight…

Machine Learning · Statistics 2018-10-25 Ira Shavitt , Eran Segal

This paper presents a comparative study of a custom convolutional neural network (CNN) architecture against widely used pretrained and transfer learning CNN models across five real-world image datasets. The datasets span binary…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Mahmudul Hasan , Mabsur Fatin Bin Hossain

Inverse problems in imaging such as denoising, deblurring, superresolution (SR) have been addressed for many decades. In recent years, convolutional neural networks (CNNs) have been widely used for many inverse problem areas. Although their…

Machine Learning · Computer Science 2018-10-26 Cem Tarhan , Gozde Bozdagi Akar

Regularization is one of the crucial ingredients of deep learning, yet the term regularization has various definitions, and regularization methods are often studied separately from each other. In our work we present a systematic, unifying…

Machine Learning · Computer Science 2017-10-31 Jan Kukačka , Vladimir Golkov , Daniel Cremers