English
Related papers

Related papers: Enabling Large Batch Size Training for DNN Models …

200 papers

Pretrained language models like BERT have achieved good results on NLP tasks, but are impractical on resource-limited devices due to memory footprint. A large fraction of this footprint comes from the input embeddings with large input…

Computation and Language · Computer Science 2021-02-09 Sanqiang Zhao , Raghav Gupta , Yang Song , Denny Zhou

Deep learning typically requires training a very capable architecture using large datasets. However, many important learning problems demand an ability to draw valid inferences from small size datasets, and such problems pose a particular…

Machine Learning · Computer Science 2017-10-20 Dawit Mureja , Hyunsin Park , Chang D. Yoo

Deep learning has emerged as a powerful method for extracting valuable information from large volumes of data. However, when new training data arrives continuously (i.e., is not fully available from the beginning), incremental training…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-06 Thomas Bouvier , Bogdan Nicolae , Hugo Chaugier , Alexandru Costan , Ian Foster , Gabriel Antoniu

Motivation: A perennial challenge for biomedical researchers and clinical practitioners is to stay abreast with the rapid growth of publications and medical notes. Natural language processing (NLP) has emerged as a promising direction for…

Computation and Language · Computer Science 2021-12-16 Robert Tinn , Hao Cheng , Yu Gu , Naoto Usuyama , Xiaodong Liu , Tristan Naumann , Jianfeng Gao , Hoifung Poon

Most iterative neural network training methods use estimates of the loss function over small random subsets (or minibatches) of the data to update the parameters, which aid in decoupling the training time from the (often very large) size of…

Statistical Mechanics · Physics 2023-06-28 Jamie F. Mair , Luke Causer , Juan P. Garrahan

Training Long-Context Large Language Models (LLMs) is challenging, as hybrid training with long-context and short-context data often leads to workload imbalances. Existing works mainly use data packing to alleviate this issue, but fail to…

Machine Learning · Computer Science 2025-10-14 Yongqiang Yao , Jingru Tan , Kaihuan Liang , Feizhao Zhang , Jiahao Hu , Shuo Wu , Yazhe Niu , Ruihao Gong , Dahua Lin , Ningyi Xu

Deep learning models in recommender systems are usually trained in the batch mode, namely iteratively trained on a fixed-size window of training data. Such batch mode training of deep learning models suffers from low training efficiency,…

Information Retrieval · Computer Science 2020-09-07 Yichao Wang , Huifeng Guo , Ruiming Tang , Zhirong Liu , Xiuqiang He

The performance of deep neural networks (DNN) is very sensitive to the particular choice of hyper-parameters. To make it worse, the shape of the learning curve can be significantly affected when a technique like batchnorm is used. As a…

Machine Learning · Computer Science 2019-05-24 Hyunghun Cho , Yongjin Kim , Eunjung Lee , Daeyoung Choi , Yongjae Lee , Wonjong Rhee

Many state-of-the-art ML results have been obtained by scaling up the number of parameters in existing models. However, parameters and activations for such large models often do not fit in the memory of a single accelerator device; this…

Machine Learning · Computer Science 2021-07-23 Deepak Narayanan , Amar Phanishayee , Kaiyu Shi , Xie Chen , Matei Zaharia

Deep neural networks (DNNs) have remarkably succeeded in various image processing tasks. However, their large size and computational complexity present significant challenges for deploying them in resource-constrained environments. This…

Machine Learning · Computer Science 2025-10-07 José Medina , Amnir Hadachi , Paul Honeine , Abdelaziz Bensrhair

Deep learning has been widely used in data-intensive applications. However, training a deep neural network often requires a large data set. When there is not enough data available for training, the performance of deep learning models is…

Machine Learning · Computer Science 2020-12-02 Peng Peng , Jiugen Wang

In recent years, Dynamic Sparse Training (DST) has emerged as an alternative to post-training pruning for generating efficient models. In principle, DST allows for a more memory efficient training process, as it maintains sparsity…

Machine Learning · Computer Science 2025-02-11 Nasib Ullah , Erik Schultheis , Mike Lasby , Yani Ioannou , Rohit Babbar

Memory-based Dynamic Graph Neural Networks (MDGNNs) are a family of dynamic graph neural networks that leverage a memory module to extract, distill, and memorize long-term temporal dependencies, leading to superior performance compared to…

Machine Learning · Computer Science 2024-02-27 Junwei Su , Difan Zou , Chuan Wu

Training data memorization in NLP can both be beneficial (e.g., closed-book QA) and undesirable (personal data extraction). In any case, successful model training requires a non-trivial amount of memorization to store word spellings,…

Computation and Language · Computer Science 2021-12-03 Eugene Kharitonov , Marco Baroni , Dieuwke Hupkes

With the emergence of various molecular tasks and massive datasets, how to perform efficient training has become an urgent yet under-explored issue in the area. Data pruning (DP), as an oft-stated approach to saving training burdens,…

Machine Learning · Computer Science 2024-09-04 Dingshuo Chen , Zhixun Li , Yuyan Ni , Guibin Zhang , Ding Wang , Qiang Liu , Shu Wu , Jeffrey Xu Yu , Liang Wang

In this work, we propose a new training method for finding minimum weight norm solutions in over-parameterized neural networks (NNs). This method seeks to improve training speed and generalization performance by framing NN training as a…

Machine Learning · Statistics 2018-06-22 Yamini Bansal , Madhu Advani , David D Cox , Andrew M Saxe

When using active learning, smaller batch sizes are typically more efficient from a learning efficiency perspective. However, in practice due to speed and human annotator considerations, the use of larger batch sizes is necessary. While…

Machine Learning · Computer Science 2018-05-18 Garrett Beatty , Ethan Kochis , Michael Bloodgood

The stochastic gradient descent (SGD) method and its variants are algorithms of choice for many Deep Learning tasks. These methods operate in a small-batch regime wherein a fraction of the training data, say $32$-$512$ data points, is…

Machine Learning · Computer Science 2017-02-13 Nitish Shirish Keskar , Dheevatsa Mudigere , Jorge Nocedal , Mikhail Smelyanskiy , Ping Tak Peter Tang

Transformer models have revolutionized a wide spectrum of disciplines, especially in language processing. The recent success has proven that model size scalability is crucial for achieving superior performance metrics. However, training…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-08 Jiangtao Wang , Jan Ebert , Oleg Filatov , Stefan Kesselheim

Batch Normalization (BatchNorm) is a widely adopted technique that enables faster and more stable training of deep neural networks (DNNs). Despite its pervasiveness, the exact reasons for BatchNorm's effectiveness are still poorly…

Machine Learning · Statistics 2019-04-16 Shibani Santurkar , Dimitris Tsipras , Andrew Ilyas , Aleksander Madry