English
Related papers

Related papers: Training the Convolutional Neural Network with Sta…

200 papers

We study the recently introduced stability training as a general-purpose method to increase the robustness of deep neural networks against input perturbations. In particular, we explore its use as an alternative to data augmentation and…

Machine Learning · Computer Science 2019-11-14 Jan Laermann , Wojciech Samek , Nils Strodthoff

When optimizing convolutional neural networks (CNN) for a specific image-based task, specialists commonly overshoot the number of convolutional layers in their designs. By implication, these CNNs are unnecessarily resource intensive to…

Machine Learning · Computer Science 2022-06-23 Mats L. Richter , Julius Schöning , Anna Wiedenroth , Ulf Krumnack

In this paper we investigate the use of discriminative model learning through Convolutional Neural Networks (CNNs) for SAR image despeckling. The network uses a residual learning strategy, hence it does not recover the filtered image, but…

Computer Vision and Pattern Recognition · Computer Science 2017-05-04 G. Chierchia , D. Cozzolino , G. Poggi , L. Verdoliva

Convolutional neural networks (CNNs) have demonstrated remarkable success in vision-related tasks. However, their susceptibility to failing when inputs deviate from the training distribution is well-documented. Recent studies suggest that…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 Pradyumna Elavarthi , James Lee , Anca Ralescu

Compared with traditional seismic noise attenuation algorithms that depend on signal models and their corresponding prior assumptions, removing noise with a deep neural network is trained based on a large training set, where the inputs are…

Geophysics · Physics 2019-07-23 Siwei Yu , Jianwei Ma , Wenlong Wang

Employing deep neural networks as natural image priors to solve inverse problems either requires large amounts of data to sufficiently train expressive generative models or can succeed with no data via untrained neural networks. However,…

Machine Learning · Computer Science 2019-10-25 Oscar Leong , Wesam Sakla

Effective convolutional neural networks are trained on large sets of labeled data. However, creating large labeled datasets is a very costly and time-consuming task. Semi-supervised learning uses unlabeled data to train a model with higher…

Computer Vision and Pattern Recognition · Computer Science 2016-06-16 Mehdi Sajjadi , Mehran Javanmardi , Tolga Tasdizen

For many computer vision problems, the deep neural networks are trained and validated based on the assumption that the input images are pristine (i.e., artifact-free). However, digital images are subject to a wide range of distortions in…

Computer Vision and Pattern Recognition · Computer Science 2017-08-15 Zhuo Chen , Weisi Lin , Shiqi Wang , Long Xu , Leida Li

Convolutional networks have marked their place over the last few years as the best performing model for various visual tasks. They are, however, most suited for supervised learning from large amounts of labeled data. Previous attempts have…

Machine Learning · Computer Science 2018-12-05 Elad Hoffer , Itay Hubara , Nir Ailon

Convolutional networks have marked their place over the last few years as the best performing model for various visual tasks. They are, however, most suited for supervised learning from large amounts of labeled data. Previous attempts have…

Machine Learning · Statistics 2016-11-23 Elad Hoffer , Itay Hubara , Nir Ailon

Convolutional neural networks are witnessing wide adoption in computer vision systems with numerous applications across a range of visual recognition tasks. Much of this progress is fueled through advances in convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2018-06-06 Felix Juefei-Xu , Vishnu Naresh Boddeti , Marios Savvides

Neural Networks are function approximators that have achieved state-of-the-art accuracy in numerous machine learning tasks. In spite of their great success in terms of accuracy, their large training time makes it difficult to use them for…

Machine Learning · Computer Science 2017-04-18 Abhishek Sinha , Mausoom Sarkar , Aahitagni Mukherjee , Balaji Krishnamurthy

Deep convolutional networks have proven to be very successful in learning task specific features that allow for unprecedented performance on various computer vision tasks. Training of such networks follows mostly the supervised learning…

Machine Learning · Computer Science 2015-06-22 Alexey Dosovitskiy , Philipp Fischer , Jost Tobias Springenberg , Martin Riedmiller , Thomas Brox

In recent years, there has been an intense debate about how learning in biological neural networks (BNNs) differs from learning in artificial neural networks. It is often argued that the updating of connections in the brain relies only on…

Neurons and Cognition · Quantitative Biology 2024-04-11 Sören Christensen , Jan Kallsen

Machine learning software, deep neural networks (DNN) software in particular, discerns valuable information from a large dataset, a set of data. Outcomes of such DNN programs are dependent on the quality of both learning programs and…

Machine Learning · Computer Science 2019-11-27 Shin Nakajima

Motivated by the observation that humans can learn patterns from two given images at one time, we propose a dual pattern learning network architecture in this paper. Unlike conventional networks, the proposed architecture has two input…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Haimin Zhang , Min Xu

The conventional classification schemes -- notably multinomial logistic regression -- used in conjunction with convolutional networks (convnets) are classical in statistics, designed without consideration for the usual coupling with…

Machine Learning · Computer Science 2017-01-02 Mark Tygert , Arthur Szlam , Soumith Chintala , Marc'Aurelio Ranzato , Yuandong Tian , Wojciech Zaremba

Convolutional Neural Networks (CNNs) have become the state-of-the-art method to learn from image data. However, recent research shows that they may include a texture and colour bias in their representation, contrary to the intuition that…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Francis Brochu

As object recognition becomes an increasingly common ML task, and recent research demonstrating CNNs vulnerability to attacks and small image perturbations necessitate fully understanding the foundations of object recognition. We focus on…

Computer Vision and Pattern Recognition · Computer Science 2018-11-01 Megha Srivastava , Kalanit Grill-Spector

Material classification in natural settings is a challenge due to complex interplay of geometry, reflectance properties, and illumination. Previous work on material classification relies strongly on hand-engineered features of visual…

Computer Vision and Pattern Recognition · Computer Science 2016-09-21 Patrick Wieschollek , Hendrik P. A. Lensch