English
Related papers

Related papers: Batch-Instance Normalization for Adaptively Style-…

200 papers

Batch normalization (BatchNorm) is a popular layer normalization technique used when training deep neural networks. It has been shown to enhance the training speed and accuracy of deep learning models. However, the mechanics by which…

Machine Learning · Computer Science 2025-02-14 Hermanus L. Potgieter , Coenraad Mouton , Marelie H. Davel

In this paper, we make the first attempt to apply the boundary integrated neural networks (BINNs) for the numerical solution of two-dimensional (2D) elastostatic and piezoelectric problems. BINNs combine artificial neural networks with the…

Computational Engineering, Finance, and Science · Computer Science 2023-08-03 Peijun Zhang , Chuanzeng Zhang , Yan Gu , Wenzhen Qu , Shengdong Zhao

Existing continual learning methods use Batch Normalization (BN) to facilitate training and improve generalization across tasks. However, the non-i.i.d and non-stationary nature of continual learning data, especially in the online setting,…

Machine Learning · Computer Science 2022-03-31 Quang Pham , Chenghao Liu , Steven Hoi

Blind image denoising is an important yet very challenging problem in computer vision due to the complicated acquisition process of real images. In this work we propose a new variational inference method, which integrates both noise…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Zongsheng Yue , Hongwei Yong , Qian Zhao , Lei Zhang , Deyu Meng

In this work, we aim to solve data-driven optimization problems, where the goal is to find an input that maximizes an unknown score function given access to a dataset of inputs with corresponding scores. When the inputs are high-dimensional…

Machine Learning · Computer Science 2020-01-01 Aviral Kumar , Sergey Levine

Despite impressive performance on numerous visual tasks, Convolutional Neural Networks (CNNs) --- unlike brains --- are often highly sensitive to small perturbations of their input, e.g. adversarial noise leading to erroneous decisions. We…

The privacy protection mechanism of federated learning (FL) offers an effective solution for cross-center medical collaboration and data sharing. In multi-site medical image segmentation, each medical site serves as a client of FL, and its…

Image and Video Processing · Electrical Eng. & Systems 2023-06-30 Fubao Zhu , Yanhui Tian , Chuang Han , Yanting Li , Jiaofen Nan , Ni Yao , Weihua Zhou

Image retrieval under varying illumination conditions, such as day and night images, is addressed by image preprocessing, both hand-crafted and learned. Prior to extracting image descriptors by a convolutional neural network, images are…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Tomas Jenicek , Ondřej Chum

Deep learning-based image registration approaches have shown competitive performance and run-time advantages compared to conventional image registration methods. However, existing learning-based approaches mostly require to train separate…

Image and Video Processing · Electrical Eng. & Systems 2023-03-21 Yinsong Wang , Huaqi Qiu , Chen Qin

Quantizing deep networks with adaptive bit-widths is a promising technique for efficient inference across many devices and resource constraints. In contrast to static methods that repeat the quantization process and train different models…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Ximeng Sun , Rameswar Panda , Chun-Fu Chen , Naigang Wang , Bowen Pan , Kailash Gopalakrishnan , Aude Oliva , Rogerio Feris , Kate Saenko

Batch Normalization (BN) is a common technique used to speed-up and stabilize training. On the other hand, the learnable parameters of BN are commonly used in conditional Generative Adversarial Networks (cGANs) for representing…

Machine Learning · Statistics 2019-02-27 Aliaksandr Siarohin , Enver Sangineto , Nicu Sebe

Though GAN (Generative Adversarial Networks) based technique has greatly advanced the performance of image synthesis and face translation, only few works available in literature provide region based style encoding and translation. We…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Wenshuang Liu , Wenting Chen , Linlin Shen

Retinal image of surrounding objects varies tremendously due to the changes in position, size, pose, illumination condition, background context, occlusion, noise, and nonrigid deformations. But despite these huge variations, our visual…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Saeed Reza Kheradpisheh , Mohammad Ganjtabesh , Timothée Masquelier

Convolutional neural networks (CNNs) have achieved state-of-the-art results on many visual recognition tasks. However, current CNN models still exhibit a poor ability to be invariant to spatial transformations of images. Intuitively, with…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Xu Shen , Xinmei Tian , Anfeng He , Shaoyan Sun , Dacheng Tao

Batch Normalization (BN) is a popular technique for training Deep Neural Networks (DNNs). BN uses scaling and shifting to normalize activations of mini-batches to accelerate convergence and improve generalization. The recently proposed…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Shengdong Zhang , Ehsan Nezhadarya , Homa Fashandi , Jiayi Liu , Darin Graham , Mohak Shah

In this paper, we explore the role of Instance Normalization in low-level vision tasks. Specifically, we present a novel block: Half Instance Normalization Block (HIN Block), to boost the performance of image restoration networks. Based on…

Image and Video Processing · Electrical Eng. & Systems 2022-05-03 Liangyu Chen , Xin Lu , Jie Zhang , Xiaojie Chu , Chengpeng Chen

This paper presents a normalization mechanism called Instance-Level Meta Normalization (ILM~Norm) to address a learning-to-normalize problem. ILM~Norm learns to predict the normalization parameters via both the feature feed-forward and the…

Machine Learning · Computer Science 2019-04-09 Songhao Jia , Ding-Jie Chen , Hwann-Tzong Chen

Batch Normalization (BN) has been proven to be quite effective at accelerating and improving the training of deep neural networks (DNNs). However, BN brings additional computation, consumes more memory and generally slows down the training…

Machine Learning · Computer Science 2019-05-23 Shuang Wu , Guoqi Li , Lei Deng , Liu Liu , Yuan Xie , Luping Shi

This paper presents a comprehensive evaluation of instance segmentation models with respect to real-world image corruptions as well as out-of-domain image collections, e.g. images captured by a different set-up than the training dataset.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yusuf Dalva , Hamza Pehlivan , Said Fahri Altindis , Aysegul Dundar

Batch normalization is currently the most widely used variant of internal normalization for deep neural networks. Additional work has shown that the normalization of weights and additional conditioning as well as the normalization of…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Wolfgang Fuhl , Enkelejda Kasneci