English
Related papers

Related papers: Removal of Batch Effects using Distribution-Matchi…

200 papers

Deep neural networks have proven to be highly effective when large amounts of data with clean labels are available. However, their performance degrades when training data contains noisy labels, leading to poor generalization on the test…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Fahimeh Fooladgar , Minh Nguyen Nhat To , Parvin Mousavi , Purang Abolmaesumi

Distributed implementations of mini-batch stochastic gradient descent (SGD) suffer from communication overheads, attributed to the high frequency of gradient updates inherent in small-batch training. Training with large batches can reduce…

Machine Learning · Statistics 2018-06-12 Lingjiao Chen , Hongyi Wang , Jinman Zhao , Dimitris Papailiopoulos , Paraschos Koutris

Diffusion, a fundamental internal mechanism emerging in many physical processes, describes the interaction among different objects. In many learning tasks with limited training samples, the diffusion connects the labeled and unlabeled data…

Machine Learning · Computer Science 2023-05-02 Tangjun Wang , Zehao Dou , Chenglong Bao , Zuoqiang Shi

Batch Normalization (BN) is extensively employed in various network architectures by performing standardization within mini-batches. A full understanding of the process has been a central target in the deep learning communities. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2020-03-30 Lei Huang , Lei Zhao , Yi Zhou , Fan Zhu , Li Liu , Ling Shao

This paper considers the evaluation of discretely distributed treatments when outcomes are only observed for a subpopulation due to sample selection or outcome attrition. For identification, we combine a selection-on-observables assumption…

Econometrics · Economics 2021-07-16 Michela Bia , Martin Huber , Lukáš Lafférs

Network analysis provides powerful tools to learn about a variety of social systems. However, most analyses implicitly assume that the considered relational data is error-free, reliable and accurately reflects the system to be analysed.…

Social and Information Networks · Computer Science 2022-01-12 Felix I. Stamm , Leonie Neuhäuser , Florian Lemmerich , Michael T. Schaub , Markus Strohmaier

Normalization methods are a central building block in the deep learning toolbox. They accelerate and stabilize training, while decreasing the dependence on manually tuned learning rate schedules. When learning from multi-modal…

Machine Learning · Computer Science 2018-10-15 Lucas Deecke , Iain Murray , Hakan Bilen

Machine learning techniques are increasingly being applied in high-energy nuclear physics data analysis thanks to their outstanding performance. One key challenge in such applications is the construction of training samples that can…

Nuclear Experiment · Physics 2025-11-14 Yan Wang , Rangrong Ma , Kaifeng Shen , Zebo Tang , Wangmei Zha

Machine learning (ML) holds great potential to advance anomaly detection (AD) in chemical processes. However, the development of ML-based methods is hindered by the lack of openly available experimental data. To address this gap, we have…

Understanding the dynamics of complex systems is a central task in many different areas ranging form biology via epidemics to economics and engineering. Unexpected behaviour of dynamic systems or even systems failure is sometimes difficult…

Optimization and Control · Mathematics 2020-06-11 Dominik Kahl , Andreas Weber , Maik Kschischo

Randomised Controlled Trials (RCTs) are the gold standard for estimating treatment effects across many fields of science. Technology companies have adopted A/B-testing methods as a modern RCT counterpart, where end-users are randomly…

Social and Information Networks · Computer Science 2024-09-20 Olivier Jeunen

Current advances in next generation sequencing techniques have allowed researchers to conduct comprehensive research on microbiome and human diseases, with recent studies identifying associations between human microbiome and health outcomes…

Methodology · Statistics 2021-06-09 Konstantin Shestopaloff , Mei Dong , Fan Gao , Wei Xu

Current deep learning models for classification tasks in computer vision are trained using mini-batches. In the present article, we take advantage of the relationships between samples in a mini-batch, using graph neural networks to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Arnab Kumar Mondal , Vineet Jain , Kaleem Siddiqi

Data-hunger and data-imbalance are two major pitfalls in many deep learning approaches. For example, on highly optimized production lines, defective samples are hardly acquired while non-defective samples come almost for free. The defects…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Ruyu Wang , Sabrina Hoppe , Eduardo Monari , Marco F. Huber

While deep neural networks show great performance on fitting to the training distribution, improving the networks' generalization performance to the test distribution and robustness to the sensitivity to input perturbations still remain as…

Machine Learning · Computer Science 2021-02-08 Jang-Hyun Kim , Wonho Choo , Hosan Jeong , Hyun Oh Song

When incrementally trained on new classes, deep neural networks are subject to catastrophic forgetting which leads to an extreme deterioration of their performance on the old classes while learning the new ones. Using a small memory…

Machine Learning · Computer Science 2022-11-15 Quentin Jodelet , Xin Liu , Tsuyoshi Murata

Ensembles over neural network weights trained from different random initialization, known as deep ensembles, achieve state-of-the-art accuracy and calibration. The recently introduced batch ensembles provide a drop-in replacement that is…

Machine Learning · Computer Science 2021-01-11 Florian Wenzel , Jasper Snoek , Dustin Tran , Rodolphe Jenatton

We study the problem of learning a mixture of multiple linear dynamical systems (LDSs) from unlabeled short sample trajectories, each generated by one of the LDS models. Despite the wide applicability of mixture models for time-series data,…

Machine Learning · Statistics 2022-05-26 Yanxi Chen , H. Vincent Poor

Batch Normalization is quite effective at accelerating and improving the training of deep models. However, its effectiveness diminishes when the training minibatches are small, or do not consist of independent samples. We hypothesize that…

Machine Learning · Computer Science 2017-03-31 Sergey Ioffe

An important problem in training deep networks with high capacity is to ensure that the trained network works well when presented with new inputs outside the training dataset. Dropout is an effective regularization technique to boost the…

Computer Vision and Pattern Recognition · Computer Science 2017-12-06 Mostafa Rahmani , George Atia