English
Related papers

Related papers: Initialization Using Perlin Noise for Training Net…

200 papers

When capturing and storing images, devices inevitably introduce noise. Reducing this noise is a critical task called image denoising. Deep learning has become the de facto method for image denoising, especially with the emergence of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Haoyu Chen , Jinjin Gu , Yihao Liu , Salma Abdel Magid , Chao Dong , Qiong Wang , Hanspeter Pfister , Lei Zhu

Artificial neural network (ANN) is a very useful tool in solving learning problems. Boosting the performances of ANN can be mainly concluded from two aspects: optimizing the architecture of ANN and normalizing the raw data for ANN. In this…

Machine Learning · Computer Science 2017-12-27 Qingjiu Zhang , Shiliang Sun

Digital security has been an active area of research interest due to the rapid adaptation of internet infrastructure, the increasing popularity of social media, and digital cameras. Due to inherent differences in working principles to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Mohammad Zunaed , Shaikh Anowarul Fattah

Deep neural networks have been widely used in image denoising during the past few years. Even though they achieve great success on this problem, they are computationally inefficient which makes them inappropriate to be implemented in mobile…

Image and Video Processing · Electrical Eng. & Systems 2021-08-05 Lu Xu , Jiawei Zhang , Xuanye Cheng , Feng Zhang , Xing Wei , Jimmy Ren

In this paper, we introduce a novel regularization method called Adversarial Noise Layer (ANL) and its efficient version called Class Adversarial Noise Layer (CANL), which are able to significantly improve CNN's generalization ability by…

Computer Vision and Pattern Recognition · Computer Science 2018-10-31 Zhonghui You , Jinmian Ye , Kunming Li , Zenglin Xu , Ping Wang

The effectiveness of training neural networks directly impacts computational costs, resource allocation, and model development timelines in machine learning applications. An optimizer's ability to train the model adequately (in terms of…

Machine Learning · Computer Science 2024-08-06 Andriy Miranskyy , Adam Sorrenti , Viral Thakar

Convergence rate of training algorithms for neural networks is heavily affected by initialization of weights. In this paper, an original algorithm for initialization of weights in backpropagation neural net is presented with application to…

Machine Learning · Computer Science 2020-04-07 Nadir Murru , Rosaria Rossini

In various Computer Vision and Signal Processing applications, noise is typically perceived as a drawback of the image capturing system that ought to be removed. We, on the other hand, claim that image noise, just as texture, is important…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Renata Khasanova , Jan Wassenberg , Jyrki Alakuijala

Low-light images suffer from severe noise and low illumination. Current deep learning models that are trained with real-world images have excellent noise reduction, but a ratio parameter must be chosen manually to complete the enhancement…

Image and Video Processing · Electrical Eng. & Systems 2020-04-23 Qingxu Fu , Xiaoguang Di , Yu Zhang

Video generation has made significant strides with the development of diffusion models; however, achieving high temporal consistency remains a challenging task. Recently, FreeInit identified a training-inference gap and introduced a method…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Chengyu Bai , Yuming Li , Zhongyu Zhao , Jintao Chen , Peidong Jia , Qi She , Ming Lu , Shanghang Zhang

Noise injection-based method has been shown to be able to improve the robustness of artificial neural networks in previous work. In this work, we propose a novel noise injection-based training scheme for better model robustness.…

Machine Learning · Computer Science 2023-05-30 Zeliang Zhang , Jinyang Jiang , Minjie Chen , Zhiyuan Wang , Yijie Peng , Zhaofei Yu

Post-training dropout based approaches achieve high sparsity and are well established means of deciphering problems relating to computational cost and overfitting in Neural Network architectures. Contrastingly, pruning at initialization is…

Neural and Evolutionary Computing · Computer Science 2022-09-07 Maham Haroon

High levels of noise usually exist in today's captured images due to the relatively small sensors equipped in the smartphone cameras, where the noise brings extra challenges to lossy image compression algorithms. Without the capacity to…

Image and Video Processing · Electrical Eng. & Systems 2022-07-25 Ka Leong Cheng , Yueqi Xie , Qifeng Chen

We apply the network Lasso to classify partially labeled data points which are characterized by high-dimensional feature vectors. In order to learn an accurate classifier from limited amounts of labeled data, we borrow statistical strength,…

Machine Learning · Computer Science 2019-03-27 Nguyen Tran , Henrik Ambos , Alexander Jung

A conditional general adversarial network (GAN) is proposed for image deblurring problem. It is tailored for image deblurring instead of just applying GAN on the deblurring problem. Motivated by that, dark channel prior is carefully picked…

Computer Vision and Pattern Recognition · Computer Science 2019-03-04 Shuang Zhang , Ada Zhen , Robert L. Stevenson

Given data with noisy labels, over-parameterized deep networks suffer overfitting mislabeled data, resulting in poor generalization. The memorization effect of deep networks shows that although the networks have the ability to memorize all…

Machine Learning · Computer Science 2024-04-30 Jingyi Wang , Xiaobo Xia , Long Lan , Xinghao Wu , Jun Yu , Wenjing Yang , Bo Han , Tongliang Liu

Convolutional Neural Networks (CNNs) inherently encode strong inductive biases, enabling effective generalization on small-scale datasets. In this paper, we propose integrating this inductive bias into ViTs, not through an architectural…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Jianqiao Zheng , Xueqian Li , Hemanth Saratchandran , Simon Lucey

Recently, convolutional neural networks (CNNs) have been widely used in image denoising. Existing methods benefited from residual learning and achieved high performance. Much research has been paid attention to optimizing the network…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Jiahong Zhang , Yonggui Zhu , Wenshu Yu , Jingning Ma

Implicit Neural Representation (INR) has emerged as an effective method for unsupervised image denoising. However, INR models are typically overparameterized; consequently, these models are prone to overfitting during learning, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Zipei Yan , Zhengji Liu , Jizhou Li

The use of unsupervised data in addition to supervised data in training discriminative neural networks has improved the performance of this clas- sification scheme. However, the best results were achieved with a training process that is…

Neural and Evolutionary Computing · Computer Science 2018-04-30 Juan Maroñas Molano , Alberto Albiol Colomer , Roberto Paredes Palacios