English
Related papers

Related papers: Spectral Wavelet Dropout: Regularization in the Wa…

200 papers

The singular value decomposition (SVD) is a crucial tool in machine learning and statistical data analysis. However, it is highly susceptible to outliers in the data matrix. Existing robust SVD algorithms often sacrifice speed for…

Machine Learning · Statistics 2024-02-16 Sangil Han , Kyoowon Kim , Sungkyu Jung

Today, image denoising by thresholding of wavelet coefficients is a commonly used tool for 2D image enhancement. Since the data product of spectroscopic imaging surveys has two spatial and one spectral dimension, the techniques for…

Instrumentation and Methods for Astrophysics · Physics 2015-06-03 Lars Flöer , Benjamin Winkel

Convolutional neural networks (CNNs) have demonstrated gratifying results at learning discriminative features. However, when applied to unseen domains, state-of-the-art models are usually prone to errors due to domain shift. After…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Rang Meng , Xianfeng Li , Weijie Chen , Shicai Yang , Jie Song , Xinchao Wang , Lei Zhang , Mingli Song , Di Xie , Shiliang Pu

Deep learning has demonstrated remarkable achievements in medical image segmentation. However, prevailing deep learning models struggle with poor generalization due to (i) intra-class variations, where the same class appears differently in…

Image and Video Processing · Electrical Eng. & Systems 2024-08-09 Vandan Gorade , Sparsh Mittal , Debesh Jha , Rekha Singhal , Ulas Bagci

Domain generalization aims to enhance the model robustness against domain shift without accessing the target domain. Since the available source domains for training are limited, recent approaches focus on generating samples of novel…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Seogkyu Jeon , Kibeom Hong , Pilhyeon Lee , Jewook Lee , Hyeran Byun

Regularization is a set of techniques that are used to improve the generalization ability of deep neural networks. In this paper, we introduce weight compander (WC), a novel effective method to improve generalization by reparameterizing…

Machine Learning · Computer Science 2023-06-30 Rinor Cakaj , Jens Mehnert , Bin Yang

Convolutional neural networks (CNNs) have achieved exciting performance in joint segmentation of optic disc and optic cup on single-institution datasets. However, their clinical translation is hindered by two major challenges: limited…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yusong Xiao , Yuxuan Wu , Li Xiao , Gang Qu , Haiye Huo , Yu-Ping Wang

Deep neural networks face numerous challenges in hyperspectral image classification, including high-dimensional data, sparse ground object distributions, and spectral redundancy, which often lead to classification overfitting and limited…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Guandong Li , Mengxia Ye

In response to the prevalent challenge of overfitting in deep neural networks, this paper introduces Simultaneous Learning, a regularization approach drawing on principles of Transfer Learning and Multi-task Learning. We leverage auxiliary…

Domain generalization (DG), aiming at models able to work on multiple unseen domains, is a must-have characteristic of general artificial intelligence. DG based on single source domain training data is more challenging due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Qingyue Yang , Hongjing Niu , Pengfei Xia , Wei Zhang , Bin Li

In this paper, we introduce a new regularization technique for transfer learning. The aim of the proposed approach is to capture statistical relationships among convolution filters learned from a well-trained network and transfer this…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Mehmet Aygün , Yusuf Aytar , Hazım Kemal Ekenel

Cross-domain few-shot learning (CD-FSL) requires models to generalize from limited labeled samples under significant distribution shifts. While recent methods enhance adaptability through lightweight task-specific modules, they operate…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Ruixiao Shi , Fu Feng , Yucheng Xie , Jing Wang , Xin Geng

Deep learning methods, in particular trained Convolutional Neural Networks (CNNs) have recently been shown to produce compelling state-of-the-art results for single image Super-Resolution (SR). Invariably, a CNN is learned to map the low…

Computer Vision and Pattern Recognition · Computer Science 2018-02-07 Tiantong Guo , Hojjat S. Mousavi , Vishal Monga

In this work, we connect two distinct concepts for unsupervised domain adaptation: feature distribution alignment between domains by utilizing the task-specific decision boundary and the Wasserstein metric. Our proposed sliced Wasserstein…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Chen-Yu Lee , Tanmay Batra , Mohammad Haris Baig , Daniel Ulbricht

Modern neural networks (NNs) often do not generalize well in the presence of a "covariate shift"; that is, in situations where the training and test data distributions differ, but the conditional distribution of classification labels…

Machine Learning · Computer Science 2025-08-05 Sneh Pandya , Purvik Patel , Brian D. Nord , Mike Walmsley , Aleksandra Ćiprijanović

We study source-free unsupervised domain adaptation (SFUDA) for semantic segmentation, which aims to adapt a source-trained model to the target domain without accessing the source data. Many works have been proposed to address this…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Dong Zhao , Shuang Wang , Qi Zang , Licheng Jiao , Nicu Sebe , Zhun Zhong

Deep Neural Network (DNN) based super-resolution algorithms have greatly improved the quality of the generated images. However, these algorithms often yield significant artifacts when dealing with real-world super-resolution problems due to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Kangfu Mei , Shenglong Ye , Rui Huang

Convolutional neural networks (CNNs) tend to become a standard approach to solve a wide array of computer vision problems. Besides important theoretical and practical advances in their design, their success is built on the existence of…

Computer Vision and Pattern Recognition · Computer Science 2015-12-08 Adrian Popescu , Etienne Gadeski , Hervé Le Borgne

Convolutional neural network (CNN) slides a kernel over the whole image to produce an output map. This kernel scheme reduces the number of parameters with respect to a fully connected neural network (NN). While CNN has proven to be an…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Ihsan Ullah , Alfredo Petrosino

Random smoothing data augmentation is a unique form of regularization that can prevent overfitting by introducing noise to the input data, encouraging the model to learn more generalized features. Despite its success in various…

Machine Learning · Statistics 2023-05-15 Liang Ding , Tianyang Hu , Jiahang Jiang , Donghao Li , Wenjia Wang , Yuan Yao