English
Related papers

Related papers: Patch-level Neighborhood Interpolation: A General …

200 papers

How to obtain the desirable representation of a 3D shape is a key challenge in 3D shape retrieval task. Most existing 3D shape retrieval methods focus on capturing shape representation with different neural network architectures, while the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Zhaoqun Li

This paper is about regularizing deep convolutional networks (CNNs) based on an adaptive framework for transfer learning with limited training data in the target domain. Recent advances of CNN regularization in this context are commonly due…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Yang Zhong , Atsuto Maki

A critically important, ubiquitous, and yet poorly understood ingredient in modern deep networks (DNs) is batch normalization (BN), which centers and normalizes the feature maps. To date, only limited progress has been made understanding…

Machine Learning · Computer Science 2022-09-30 Randall Balestriero , Richard G. Baraniuk

Training state-of-the-art, deep neural networks is computationally expensive. One way to reduce the training time is to normalize the activities of the neurons. A recently introduced technique called batch normalization uses the…

Machine Learning · Statistics 2016-07-22 Jimmy Lei Ba , Jamie Ryan Kiros , Geoffrey E. Hinton

In this work, we propose a framework to learn a local regularization model for solving general image restoration problems. This regularizer is defined with a fully convolutional neural network that sees the image through a receptive field…

Image and Video Processing · Electrical Eng. & Systems 2021-02-12 Jean Prost , Antoine Houdard , Andrés Almansa , Nicolas Papadakis

Traditional feature encoding scheme (e.g., Fisher vector) with local descriptors (e.g., SIFT) and recent convolutional neural networks (CNNs) are two classes of successful methods for image recognition. In this paper, we propose a hybrid…

Computer Vision and Pattern Recognition · Computer Science 2017-04-26 Zhe Wang , Limin Wang , Yali Wang , Bowen Zhang , Yu Qiao

In response to the prevalent challenge of overfitting in deep neural networks, this paper introduces Simultaneous Learning, a regularization approach drawing on principles of Transfer Learning and Multi-task Learning. We leverage auxiliary…

Recent developments in deep learning have revolutionized the paradigm of image restoration. However, its applications on real image denoising are still limited, due to its sensitivity to training data and the complex nature of real image…

Computer Vision and Pattern Recognition · Computer Science 2019-05-06 Jin Zeng , Jiahao Pang , Wenxiu Sun , Gene Cheung

Regularization-based image restoration has remained an active research topic in computer vision and image processing. It often leverages a guidance signal captured in different fields as an additional cue. In this work, we present a general…

Computer Vision and Pattern Recognition · Computer Science 2016-12-21 Youngjung Kim , Hyungjoo Jung , Dongbo Min , Kwanghoon Sohn

A regularized artificial neural network (RANN) is proposed for interval-valued data prediction. The ANN model is selected due to its powerful capability in fitting linear and nonlinear functions. To meet mathematical coherence requirement…

Computation · Statistics 2018-08-22 Zebin Yang , Dennis K. J. Lin , Aijun Zhang

Graph neural networks (GNNs) have been demonstrated to perform well in graph representation learning, but always lacking in generalization capability when tackling out-of-distribution (OOD) data. Graph invariant learning methods, backed by…

Machine Learning · Computer Science 2023-12-19 Tianrui Jia , Haoyang Li , Cheng Yang , Tao Tao , Chuan Shi

Generative Adversarial Networks (GANs) are known to be difficult to train, despite considerable research effort. Several regularization techniques for stabilizing training have been proposed, but they introduce non-trivial computational…

Machine Learning · Computer Science 2020-02-20 Han Zhang , Zizhao Zhang , Augustus Odena , Honglak Lee

Recently, a variety of regularization techniques have been widely applied in deep neural networks, such as dropout, batch normalization, data augmentation, and so on. These methods mainly focus on the regularization of weight parameters to…

Machine Learning · Computer Science 2019-08-16 Qianggang Ding , Sifan Wu , Hao Sun , Jiadong Guo , Shu-Tao Xia

Image normalization, the correction for intra-volume inhomogeneities in magnetic resonance imaging (MRI) data has little significance for visual diagnosis, but is a crucial step before automated radiotherapy solutions. There are several…

Image and Video Processing · Electrical Eng. & Systems 2019-09-13 A. Simkó , T. Löfstedt , A. Garpebring , T. Nyholm , J. Jonsson

In this paper, we propose a novel regularization method for Generative Adversarial Networks, which allows the model to learn discriminative yet compact binary representations of image patches (image descriptors). We employ the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-08 Maciej Zieba , Piotr Semberecki , Tarek El-Gaaly , Tomasz Trzcinski

Graph Neural Networks (GNNs) have attracted considerable attention and have emerged as a new promising paradigm to process graph-structured data. GNNs are usually stacked to multiple layers and the node representations in each layer are…

Machine Learning · Computer Science 2020-09-25 Yihao Chen , Xin Tang , Xianbiao Qi , Chun-Guang Li , Rong Xiao

Because anomalous samples cannot be used for training, many anomaly detection and localization methods use pre-trained networks and non-parametric modeling to estimate encoded feature distribution. However, these methods neglect the impact…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Jaehyeok Bae , Jae-Han Lee , Seyun Kim

Deep Neural Networks (DNNs) thrive in recent years in which Batch Normalization (BN) plays an indispensable role. However, it has been observed that BN is costly due to the reduction operations. In this paper, we propose alleviating this…

Machine Learning · Computer Science 2018-11-05 Zhaodong Chen , Lei Deng , Guoqi Li , Jiawei Sun , Xing Hu , Xin Ma , Yuan Xie

Batch normalization (BN) is widely used in modern deep neural networks, which has been shown to represent the domain-related knowledge, and thus is ineffective for cross-domain tasks like unsupervised domain adaptation (UDA). Existing BN…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Zhiyong Huang , Kekai Sheng , Ke Li , Jian Liang , Taiping Yao , Weiming Dong , Dengwen Zhou , Xing Sun

In the past decade, sparsity-driven regularization has led to advancement of image reconstruction algorithms. Traditionally, such regularizers rely on analytical models of sparsity (e.g. total variation (TV)). However, more recent methods…

Computer Vision and Pattern Recognition · Computer Science 2018-07-04 Emrah Bostan , Ulugbek S. Kamilov , Laura Waller