English
Related papers

Related papers: Transformation, normalization and batch effect in …

200 papers

A pandemic poses particular challenges to decision-making because of the need to continuously adapt decisions to rapidly changing evidence and available data. For example, which countermeasures are appropriate at a particular stage of the…

Box-Cox power transformation is a commonly used methodology to transform the distribution of a non-normal data into a normal one. Estimation of the transformation parameter is crucial in this methodology. In this study, the estimation…

Computation · Statistics 2014-01-17 Ozgur Asar , Ozlem Ilk , Osman Dag

Transfer learning from ImageNet is the go-to approach when applying deep learning to medical images. The approach is either to fine-tune a pre-trained model or use it as a feature extractor. Most modern architecture contain batch…

Computer Vision and Pattern Recognition · Computer Science 2021-02-11 Fahdi Kanavati , Masayuki Tsuneki

The development and approval of new treatments generates large volumes of results, such as summaries of efficacy and safety. However, it is commonly overlooked that analyzing clinical study data also produces data in the form of results.…

Computers and Society · Computer Science 2022-04-22 Joana M Barros , Lukas A Widmer , Mark Baillie , Simon Wandel

Batch normalization (BN) uniformly shifts and scales the activations based on the statistics of a batch of images. However, the intensity distribution of the background pixels often dominates the BN statistics because the background…

Image and Video Processing · Electrical Eng. & Systems 2022-08-08 Junfei Xiao , Lequan Yu , Zongwei Zhou , Yutong Bai , Lei Xing , Alan Yuille , Yuyin Zhou

A significant advance in accelerating neural network training has been the development of normalization methods, permitting the training of deep models both faster and with better accuracy. These advances come with practical challenges: for…

Machine Learning · Computer Science 2019-03-05 Jasmine Collins , Johannes Balle , Jonathon Shlens

Parametric distributions are an important part of statistics. There is now a voluminous literature on different fascinating formulations of flexible distributions. We present a selective and brief overview of a small subset of these…

Statistics Theory · Mathematics 2020-05-15 Sharon X. Lee , Geoffrey J. McLachlan

Signal restoration and inverse problems are key elements in most real-world data science applications. In the past decades, with the emergence of machine learning methods, inversion of measurements has become a popular step in almost all…

Information Theory · Computer Science 2026-04-21 Deborah Pereg

Discovering patterns from data is an important task in data mining. There exist techniques to find large collections of many kinds of patterns from data very efficiently. A collection of patterns can be regarded as a summary of the data. A…

Databases · Computer Science 2007-05-23 Taneli Mielikäinen

Traditional normalization techniques (e.g., Batch Normalization and Instance Normalization) generally and simplistically assume that training and test data follow the same distribution. As distribution shifts are inevitable in real-world…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Zhiqiang Tang , Yunhe Gao , Yi Zhu , Zhi Zhang , Mu Li , Dimitris Metaxas

Training Deep Neural Networks is complicated by the fact that the distribution of each layer's inputs changes during training, as the parameters of the previous layers change. This slows down the training by requiring lower learning rates…

Machine Learning · Computer Science 2015-03-03 Sergey Ioffe , Christian Szegedy

The widespread use of Batch Normalization has enabled training deeper neural networks with more stable and faster results. However, the Batch Normalization works best using large batch size during training and as the state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Martin Kolarik , Radim Burget , Kamil Riha

The integrative analysis of multiple datasets is an important strategy in data analysis. It is increasingly popular in genomics, which enjoys a wealth of publicly available datasets that can be compared, contrasted, and combined in order to…

Methodology · Statistics 2019-11-20 Sihai Dave Zhao

In response to an increasing availability of statistically rich observational data sets, the performance and applicability of traditional Atmospheric Cherenkov Telescope analyses in the regime of systematically dominated measurement…

Instrumentation and Methods for Astrophysics · Physics 2012-12-06 Hugh Dickinson , Jan Conrad

For more than half a century, the Hough transform is ever-expanding for new frontiers. Thousands of research papers and numerous applications have evolved over the decades. Carrying out an all-inclusive survey is hardly possible and…

Computer Vision and Pattern Recognition · Computer Science 2015-02-10 Allam Shehata Hassanein , Sherien Mohammad , Mohamed Sameer , Mohammad Ehab Ragab

Deep Neural Networks (DNNs) thrive in recent years in which Batch Normalization (BN) plays an indispensable role. However, it has been observed that BN is costly due to the reduction operations. In this paper, we propose alleviating this…

Machine Learning · Computer Science 2018-11-05 Zhaodong Chen , Lei Deng , Guoqi Li , Jiawei Sun , Xing Hu , Xin Ma , Yuan Xie

Ensemble data assimilation is a problem in determining the most likely phase space trajectory of a model of an observed dynamical sys- tem as it receives inputs from measurements passing information to the model. Using methods developed in…

Chaotic Dynamics · Physics 2015-05-13 Henry D. I. Abarbanel

This paper discusses a numerical method for computing the evolution of large interacting system of quantum particles. The idea of the random batch method is to replace the total interaction of each particle with the $N-1$ other particles by…

Analysis of PDEs · Mathematics 2019-12-17 François Golse , Shi Jin , Thierry Paul

We highlight how the $L^2$ normalization required for embedding data in quantum states affects data centering, which can significantly influence quantum amplitude-encoded covariance matrices in quantum data analysis algorithms. We examine…

Quantum Physics · Physics 2025-04-02 Artur Miroszewski , Jakub Nalepa , Agata M. Wijata

Measurement error in multinomial data is a well-known and well-studied inferential problem that is encountered in many fields, including engineering, biomedical and omics research, ecology, finance, official statistics, and social sciences.…

Methodology · Statistics 2024-10-15 Matthew D. Koslovsky , Andee Kaplan , Victoria A. Terranova , Mevin B. Hooten