English
Related papers

Related papers: Spectral Wavelet Dropout: Regularization in the Wa…

200 papers

Salient object detection (SOD) in remote sensing images faces significant challenges due to large variations in object sizes, the computational cost of self-attention mechanisms, and the limitations of CNN-based extractors in capturing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Bin Wan , Runmin Cong , Xiaofei Zhou , Hao Fang , Yaoqi Sun , Sam Kwong

In recent years, Convolutional Neural Networks (CNNs) have enabled ubiquitous image processing applications. As such, CNNs require fast runtime (forward propagation) to process high-resolution visual streams in real time. This is still a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Jinlin Xiang , Shane Colburn , Arka Majumdar , Eli Shlizerman

The benefit of localized features within the regular domain has given rise to the use of Convolutional Neural Networks (CNNs) in machine learning, with great proficiency in the image classification. The use of CNNs becomes problematic…

Computer Vision and Pattern Recognition · Computer Science 2016-09-29 Michael Edwards , Xianghua Xie

Network regularization is an effective tool for incorporating structural prior knowledge to learn coherent models over networks, and has yielded provably accurate estimates in applications ranging from spatial economics to neuroimaging…

Machine Learning · Computer Science 2020-06-02 Hongyuan You , Furkan Kocayusufoglu , Ambuj K. Singh

State-of-the-art sound event detection (SED) methods usually employ a series of convolutional neural networks (CNNs) to extract useful features from the input audio signal, and then recurrent neural networks (RNNs) to model longer temporal…

We introduce a method for fast estimation of data-adapted, spatio-temporally dependent regularization parameter-maps for variational image reconstruction, focusing on total variation (TV)-minimization. Our approach is inspired by recent…

In this paper the technique for resolution and contrast enhancement of satellite geographical images based on discrete wavelet transform (DWT), stationary wavelet transform (SWT) and singular value decomposition (SVD) has been proposed. In…

Computer Vision and Pattern Recognition · Computer Science 2014-05-09 Prajakta P. Khairnar , C. A. Manjare

Deep learning-based hyperspectral image super-resolution (SR) methods have achieved great success recently. However, most existing models can not effectively explore spatial information and spectral information between bands simultaneously,…

Computer Vision and Pattern Recognition · Computer Science 2020-01-15 Qi Wang , Qiang Li , Xuelong Li

Weight decay is a simple yet powerful regularization technique that has been very widely used in training of deep neural networks (DNNs). While weight decay has attracted much attention, previous studies fail to discover some overlooked…

Machine Learning · Computer Science 2024-08-19 Zeke Xie , Zhiqiang Xu , Jingzhao Zhang , Issei Sato , Masashi Sugiyama

Despite the capacity of neural nets to learn arbitrary functions, models trained through gradient descent often exhibit a bias towards ``simpler'' functions. Various notions of simplicity have been introduced to characterize this behavior.…

Machine Learning · Computer Science 2023-06-13 Ali Gorji , Andisheh Amrollahi , Andreas Krause

In this paper, the traditional model based variational method and learning based algorithms are naturally integrated to address mixed noise removal problem. To be different from single type noise (e.g. Gaussian) removal, it is a challenge…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Faqiang Wang , Haiyang Huang , Jun Liu

Bilinear pooling of Convolutional Neural Network (CNN) features [22, 23], and their compact variants [10], have been shown to be effective at fine-grained recognition, scene categorization, texture recognition, and visual question-answering…

Computer Vision and Pattern Recognition · Computer Science 2017-07-24 Tsung-Yu Lin , Subhransu Maji

Dropout is a simple but efficient regularization technique for achieving better generalization of deep neural networks (DNNs); hence it is widely used in tasks based on DNNs. During training, dropout randomly discards a portion of the…

Neural and Evolutionary Computing · Computer Science 2020-10-22 Hiroshi Inoue

Point-cloud-based 3D object detection suffers from performance degradation when encountering data with novel domain gaps. To tackle it, the single-domain generalization (SDG) aims to generalize the detection model trained in a limited…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Shuangzhi Li , Lei Ma , Xingyu Li

Two dimensional (2D) peak finding is a common practice in data analysis for physics experiments, which is typically achieved by computing the local derivatives. However, this method is inherently unstable when the local landscape is…

Data Analysis, Statistics and Probability · Physics 2020-04-22 Han Peng , Xiang Gao , Yu He , Yiwei Li , Yuchen Ji , Chuhang Liu , Sandy A. Ekahana , Ding Pei , Zhongkai Liu , Zhixun Shen , Yulin Chen

Convolutional Neural Networks (CNN) are known to exhibit poor generalization performance under distribution shifts. Their generalization have been studied extensively, and one line of work approaches the problem from a frequency-centric…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Mehmet Kerim Yucel , Ramazan Gokberk Cinbis , Pinar Duygulu

Image deblurring is a classical computer vision problem that aims to recover a sharp image from a blurred image. To solve this problem, existing methods apply the Encode-Decode architecture to design the complex networks to make a good…

Image and Video Processing · Electrical Eng. & Systems 2021-10-13 Wenbin Zou , Mingchao Jiang , Yunchen Zhang , Liang Chen , Zhiyong Lu , Yi Wu

In neural networks, developing regularization algorithms to settle overfitting is one of the major study areas. We propose a new approach for the regularization of neural networks by the local Rademacher complexity called LocalDrop. A new…

Machine Learning · Computer Science 2021-03-02 Ziqing Lu , Chang Xu , Bo Du , Takashi Ishida , Lefei Zhang , Masashi Sugiyama

Regularizers help deep neural networks prevent feature co-adaptations. Dropout, as a commonly used regularization technique, stochastically disables neuron activations during network optimization. However, such complete feature disposal can…

Machine Learning · Computer Science 2022-01-25 Tiange Xiang , Chaoyi Zhang , Yang Song , Siqi Liu , Hongliang Yuan , Weidong Cai

Convolutional Neural Networks (CNNs) have become the state-of-the-art in supervised learning vision tasks. Their convolutional filters are of paramount importance for they allow to learn patterns while disregarding their locations in input…

Machine Learning · Computer Science 2017-10-26 Jean-Charles Vialatte , Vincent Gripon , Grégoire Mercier