English
Related papers

Related papers: Separable Batch Normalization for Robust Facial La…

200 papers

Due to the lack of quality annotation in medical imaging community, semi-supervised learning methods are highly valued in image semantic segmentation tasks. In this paper, an advanced consistency-aware pseudo-label-based self-ensembling…

Image and Video Processing · Electrical Eng. & Systems 2024-02-12 Ziyang Wang , Tianze Li , Jian-Qing Zheng , Baoru Huang

Convolutional neural networks (CNNs) have shown promising results on several segmentation tasks in magnetic resonance (MR) images. However, the accuracy of CNNs may degrade severely when segmenting images acquired with different scanners…

Machine Learning · Statistics 2018-05-28 Neerav Karani , Krishna Chaitanya , Christian Baumgartner , Ender Konukoglu

We propose a novel visual tracking algorithm based on the representations from a discriminatively trained Convolutional Neural Network (CNN). Our algorithm pretrains a CNN using a large set of videos with tracking ground-truths to obtain a…

Computer Vision and Pattern Recognition · Computer Science 2016-01-07 Hyeonseob Nam , Bohyung Han

Batch Normalization (BN) uses mini-batch statistics to normalize the activations during training, introducing dependence between mini-batch elements. This dependency can hurt the performance if the mini-batch size is too small, or if the…

Machine Learning · Computer Science 2020-04-02 Saurabh Singh , Shankar Krishnan

Robust face detection is one of the most important pre-processing steps to support facial expression analysis, facial landmarking, face recognition, pose estimation, building of 3D facial models, etc. Although this topic has been intensely…

Computer Vision and Pattern Recognition · Computer Science 2017-01-03 Yutong Zheng , Chenchen Zhu , Khoa Luu , Chandrasekhar Bhagavatula , T. Hoang Ngan Le , Marios Savvides

Purpose: The aim of this work is to develop a neural network training framework for continual training of small amounts of medical imaging data and create heuristics to assess training in the absence of a hold-out validation or test set.…

Image and Video Processing · Electrical Eng. & Systems 2023-09-27 Sohaib Naim , Brian Caffo , Haris I Sair , Craig K Jones

The accurate detection of lesion attributes is meaningful for both the computeraid diagnosis system and dermatologists decisions. However, unlike lesion segmentation and melenoma classification, there are few deep learning methods and…

Image and Video Processing · Electrical Eng. & Systems 2019-10-22 Xinzi He , Baiying Lei , Tianfu Wang

Batch normalization (BN) is a fundamental unit in modern deep networks, in which a linear transformation module was designed for improving BN's flexibility of fitting complex data distributions. In this paper, we demonstrate properly…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Yuhui Xu , Lingxi Xie , Cihang Xie , Jieru Mei , Siyuan Qiao , Wei Shen , Hongkai Xiong , Alan Yuille

Batch Normalisation (BN) is widely used in conventional deep neural network training to harmonise the input-output distributions for each batch of data. However, federated learning, a distributed learning paradigm, faces the challenge of…

Machine Learning · Computer Science 2025-05-29 Hongyao Chen , Tianyang Xu , Xiaojun Wu , Josef Kittler

Batch normalization (BN) is a popular and ubiquitous method in deep learning that has been shown to decrease training time and improve generalization performance of neural networks. Despite its success, BN is not theoretically well…

Machine Learning · Computer Science 2022-01-21 Susanna Lange , Kyle Helfrich , Qiang Ye

In many medical image analysis applications, often only a limited amount of training data is available, which makes training of convolutional neural networks (CNNs) challenging. In this work on anatomical landmark localization, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2019-08-05 Christian Payer , Darko Štern , Horst Bischof , Martin Urschler

Deep convolutional neural network (DCNN) based supervised learning is a widely practiced approach for large-scale image classification. However, retraining these large networks to accommodate new, previously unseen data demands high…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Syed Shakib Sarwar , Aayush Ankit , Kaushik Roy

As an indispensable component, Batch Normalization (BN) has successfully improved the training of deep neural networks (DNNs) with mini-batches, by normalizing the distribution of the internal representation for each hidden layer. However,…

Computer Vision and Pattern Recognition · Computer Science 2018-03-01 Guangrun Wang , Jiefeng Peng , Ping Luo , Xinjiang Wang , Liang Lin

Convolutional Neural Networks (CNNs) have shown to be powerful medical image segmentation models. In this study, we address some of the main unresolved issues regarding these models. Specifically, training of these models on small medical…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Davood Karimi , Ali Gholipour

Learning generic and robust feature representations with data from multiple domains for the same problem is of great value, especially for the problems that have multiple datasets but none of them are large enough to provide abundant data…

Computer Vision and Pattern Recognition · Computer Science 2016-04-27 Tong Xiao , Hongsheng Li , Wanli Ouyang , Xiaogang Wang

Batch Normalization (BN) has become an out-of-box technique to improve deep network training. However, its effectiveness is limited for micro-batch training, i.e., each GPU typically has only 1-2 images for training, which is inevitable for…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Siyuan Qiao , Huiyu Wang , Chenxi Liu , Wei Shen , Alan Yuille

Facial landmark localization plays a critical role in face recognition and analysis. In this paper, we propose a novel cascaded backbone-branches fully convolutional neural network~(BB-FCN) for rapidly and accurately localizing facial…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 Lingbo Liu , Guanbin Li , Yuan Xie , Yizhou Yu , Qing Wang , Liang Lin

Batch Normalization (BN) has been a standard component in designing deep neural networks (DNNs). Although the standard BN can significantly accelerate the training of DNNs and improve the generalization performance, it has several…

Machine Learning · Computer Science 2020-10-13 Yong Guo , Qingyao Wu , Chaorui Deng , Jian Chen , Mingkui Tan

Owe to the rapid development of deep neural network (DNN) techniques and the emergence of large scale face databases, face recognition has achieved a great success in recent years. During the training process of DNN, the face features and…

Computer Vision and Pattern Recognition · Computer Science 2018-01-18 Xianbiao Qi , Lei Zhang

Batch normalization (BN) is a ubiquitous technique for training deep neural networks that accelerates their convergence to reach higher accuracy. However, we demonstrate that BN comes with a fundamental drawback: it incentivizes the model…

Machine Learning · Computer Science 2022-07-05 Saeid Asgari Taghanaki , Ali Gholami , Fereshte Khani , Kristy Choi , Linh Tran , Ran Zhang , Aliasghar Khani