English
Related papers

Related papers: Optimizing Frequent Checkpointing via Low-Cost Dif…

200 papers

Future deep learning models will be distinguished by systems that perpetually learn through interaction, imagination, and cooperation, blurring the line between training and inference. This makes continual learning a critical challenge, as…

Machine Learning · Computer Science 2025-05-20 Truman Hickok

In this work, we propose a federated dynamical low-rank training (FeDLRT) scheme to reduce client compute and communication costs - two significant performance bottlenecks in horizontal federated learning. Our method builds upon dynamical…

Machine Learning · Computer Science 2024-06-27 Steffen Schotthöfer , M. Paul Laiu

Deep Neural Networks (DNNs) often rely on very large datasets for training. Given the large size of such datasets, it is conceivable that they contain certain samples that either do not contribute or negatively impact the DNN's…

Machine Learning · Computer Science 2020-11-10 Kashyap Chitta , Jose M. Alvarez , Elmar Haussmann , Clement Farabet

The increasing complexity of modern deep neural network models and the expanding sizes of datasets necessitate the development of optimized and scalable training methods. In this white paper, we addressed the challenge of efficiently…

Machine Learning · Computer Science 2024-04-29 Raphael Ruschel , A. S. M. Iftekhar , B. S. Manjunath , Suya You

We study the problem of distributed training of neural networks (NNs) on devices with heterogeneous, limited, and time-varying availability of computational resources. We present an adaptive, resource-aware, on-device learning mechanism,…

Machine Learning · Computer Science 2022-04-05 Martin Rapp , Ramin Khalili , Kilian Pfeiffer , Jörg Henkel

Diffusion models have recently exhibited remarkable performance on synthetic data. After a diffusion path is selected, a base model, such as UNet, operates as a denoising autoencoder, primarily predicting noises that need to be eliminated…

Artificial Intelligence · Computer Science 2023-10-11 Wenhao Li , Xiu Su , Shan You , Fei Wang , Chen Qian , Chang Xu

Massive data is often considered essential for deep learning applications, but it also incurs significant computational and infrastructural costs. Therefore, dataset pruning (DP) has emerged as an effective way to improve data efficiency by…

Machine Learning · Computer Science 2023-11-21 Yihua Zhang , Yimeng Zhang , Aochuan Chen , Jinghan Jia , Jiancheng Liu , Gaowen Liu , Mingyi Hong , Shiyu Chang , Sijia Liu

Training deep neural networks on large-scale datasets requires significant hardware resources whose costs (even on cloud platforms) put them out of reach of smaller organizations, groups, and individuals. Backpropagation, the workhorse for…

Machine Learning · Computer Science 2020-09-22 Alexander Ororbia , Ankur Mali , Daniel Kifer , C. Lee Giles

Computationally expensive training strategies make self-supervised learning (SSL) impractical for resource constrained industrial settings. Techniques like knowledge distillation (KD), dynamic computation (DC), and pruning are often used to…

Inversion and PDE-constrained optimization problems often rely on solving the adjoint problem to calculate the gradient of the objec- tive function. This requires storing large amounts of intermediate data, setting a limit to the largest…

Mathematical Software · Computer Science 2018-02-08 Navjot Kukreja , Jan Hückelheim , Michael Lange , Mathias Louboutin , Andrea Walther , Simon W. Funke , Gerard Gorman

Scale of data and scale of computation infrastructures together enable the current deep learning renaissance. However, training large-scale deep architectures demands both algorithmic improvement and careful system configuration. In this…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-21 Shang-Xuan Zou , Chun-Yen Chen , Jui-Lin Wu , Chun-Nan Chou , Chia-Chin Tsao , Kuan-Chieh Tung , Ting-Wei Lin , Cheng-Lung Sung , Edward Y. Chang

Can we modify the training data distribution to encourage the underlying optimization method toward finding solutions with superior generalization performance on in-distribution data? In this work, we approach this question for the first…

Machine Learning · Computer Science 2026-03-03 Dang Nguyen , Paymon Haddad , Eric Gan , Baharan Mirzasoleiman

Giving up and starting over may seem wasteful in many situations such as searching for a target or training deep neural networks (DNNs). Our study, though, demonstrates that resetting from a checkpoint can significantly improve…

Machine Learning · Computer Science 2025-03-14 Youngkyoung Bae , Yeongwoo Song , Hawoong Jeong

Training state-of-the-art ASR systems such as RNN-T often has a high associated financial and environmental cost. Training with a subset of training data could mitigate this problem if the subset selected could achieve on-par performance…

Machine Learning · Computer Science 2022-11-01 Ashish Mittal , Durga Sivasubramanian , Rishabh Iyer , Preethi Jyothi , Ganesh Ramakrishnan

Deep Neural Networks (DNNs) have revolutionized numerous applications, but the demand for ever more performance remains unabated. Scaling DNN computations to larger clusters is generally done by distributing tasks in batch mode using…

Machine Learning · Computer Science 2020-06-23 Tong Geng , Tianqi Wang , Ang Li , Xi Jin , Martin Herbordt

Accurate prediction of training time in distributed deep learning is crucial for resource allocation, cost estimation, and job scheduling. We observe that the floating-point precision setting is a key determinant of training time, leading…

Machine Learning · Computer Science 2026-04-20 Minchul Kang , Changyong Shin , Jinwoo Jeong , Hyunho Lee , Younghun Go , Gyeongmin Kim , Gyeongsik Yang , Chuck Yoo

While post-training quantization receives popularity mostly due to its evasion in accessing the original complete training dataset, its poor performance also stems from scarce images. To alleviate this limitation, in this paper, we leverage…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Yunshan Zhong , Mingbao Lin , Mengzhao Chen , Ke Li , Yunhang Shen , Fei Chao , Yongjian Wu , Rongrong Ji

As neural networks grow deeper and wider, learning networks with hard-threshold activations is becoming increasingly important, both for network quantization, which can drastically reduce time and energy requirements, and for creating large…

Machine Learning · Computer Science 2018-04-18 Abram L. Friesen , Pedro Domingos

The resource requirements of deep neural networks (DNNs) pose significant challenges to their deployment on edge devices. Common approaches to address this issue are pruning and mixed-precision quantization, which lead to latency and memory…

Dropout has been witnessed with great success in training deep neural networks by independently zeroing out the outputs of neurons at random. It has also received a surge of interest for shallow learning, e.g., logistic regression. However,…

Machine Learning · Computer Science 2016-12-06 Zhe Li , Boqing Gong , Tianbao Yang