English
Related papers

Related papers: Automatic Configuration for Optimal Communication …

200 papers

Performance tuning of Database Management Systems(DBMS) is both complex and challenging as it involves identifying and altering several key performance tuning parameters. The quality of tuning and the extent of performance enhancement…

Databases · Computer Science 2010-05-07 S. F. Rodd , U. P. Kulkarni

Current techniques for deep neural network (DNN) pruning often involve intricate multi-step processes that require domain-specific expertise, making their widespread adoption challenging. To address the limitation, the Only-Train-Once (OTO)…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Xidong Wu , Shangqian Gao , Zeyu Zhang , Zhenzhen Li , Runxue Bao , Yanfu Zhang , Xiaoqian Wang , Heng Huang

Bayesian optimization has become a successful tool for hyperparameter optimization of machine learning algorithms, such as support vector machines or deep neural networks. Despite its success, for large datasets, training and validating a…

Machine Learning · Computer Science 2017-03-08 Aaron Klein , Stefan Falkner , Simon Bartels , Philipp Hennig , Frank Hutter

It is not trivial to optimally learn a 3D Convolutional Neural Networks (3D ConvNets) due to high complexity and various options of the training scheme. The most common hand-tuning process starts from learning 3D ConvNets using short video…

Computer Vision and Pattern Recognition · Computer Science 2022-01-12 Zhaofan Qiu , Ting Yao , Chong-Wah Ngo , Tao Mei

Bayesian optimization (BO) is a promising approach for hyperparameter optimization of deep neural networks (DNNs), where each model training can take minutes to hours. In BO, a computationally cheap surrogate model is employed to learn the…

Machine Learning · Computer Science 2023-09-27 Romain Egele , Isabelle Guyon , Venkatram Vishwanath , Prasanna Balaprakash

Precision scaling has emerged as a popular technique to optimize the compute and storage requirements of Deep Neural Networks (DNNs). Efforts toward creating ultra-low-precision (sub-8-bit) DNNs suggest that the minimum precision required…

Machine Learning · Computer Science 2021-11-01 Reena Elangovan , Shubham Jain , Anand Raghunathan

Model-based reinforcement learning has attracted wide attention due to its superior sample efficiency. Despite its impressive success so far, it is still unclear how to appropriately schedule the important hyperparameters to achieve…

Machine Learning · Computer Science 2022-07-06 Hang Lai , Jian Shen , Weinan Zhang , Yimin Huang , Xing Zhang , Ruiming Tang , Yong Yu , Zhenguo Li

Large-batch training has been essential in leveraging large-scale datasets and models in deep learning. While it is computationally beneficial to use large batch sizes, it often requires a specially designed learning rate (LR) schedule to…

Machine Learning · Computer Science 2021-07-14 Chiheon Kim , Saehoon Kim , Jongmin Kim , Donghoon Lee , Sungwoong Kim

In this work we address the task of observing the performance of a semantic segmentation deep neural network (DNN) during online operation, i.e., during inference, which is of high importance in safety-critical applications such as…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Marvin Klingner , Andreas Bär , Marcel Mross , Tim Fingscheidt

Fine-tuning from pre-trained ImageNet models has become the de-facto standard for various computer vision tasks. Current practices for fine-tuning typically involve selecting an ad-hoc choice of hyperparameters and keeping them fixed to…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Hao Li , Pratik Chaudhari , Hao Yang , Michael Lam , Avinash Ravichandran , Rahul Bhotika , Stefano Soatto

Quantization is an effective way to reduce the memory cost of large-scale model training. However, most existing methods adopt fixed-precision policies, which ignore the fact that optimizer-state distributions vary significantly across…

Machine Learning · Computer Science 2026-04-10 Minglu Liu , Cunchen Hu , Liangliang Xu , Fengming Tang , Ruijia Wang , Fu Yu

DNN accelerators provide efficiency by leveraging reuse of activations/weights/outputs during the DNN computations to reduce data movement from DRAM to the chip. The reuse is captured by the accelerator's dataflow. While there has been…

Hardware Architecture · Computer Science 2020-09-07 Sheng-Chun Kao , Geonhwa Jeong , Tushar Krishna

Performance optimization of deep learning models is conducted either manually or through automatic architecture search, or a combination of both. On the other hand, their performance strongly depends on the target hardware and how…

Machine Learning · Computer Science 2022-09-23 Vahid Partovi Nia , Alireza Ghaffari , Mahdi Zolnouri , Yvon Savaria

Deep Neural Networks (DNNs) are intensively used to solve a wide variety of complex problems. Although powerful, such systems require manual configuration and tuning. To this end, we view DNNs as configurable systems and propose an…

Machine Learning · Computer Science 2019-04-10 Salah Ghamizi , Maxime Cordy , Mike Papadakis , Yves Le Traon

Originated from distributed learning, federated learning enables privacy-preserved collaboration on a new abstracted level by sharing the model parameters only. While the current research mainly focuses on optimizing learning algorithms and…

Machine Learning · Computer Science 2020-09-17 Cong Wang , Yuanyuan Yang , Pengzhan Zhou

Existing batch size selection approaches in distributed machine learning rely on static allocation or simplistic heuristics that fail to adapt to heterogeneous, dynamic computing environments. We present DYNAMIX, a reinforcement learning…

Machine Learning · Computer Science 2025-10-10 Yuanjun Dai , Keqiang He , An Wang

Large-scale supervised classification algorithms, especially those based on deep convolutional neural networks (DCNNs), require vast amounts of training data to achieve state-of-the-art performance. Decreasing this data requirement would…

Computer Vision and Pattern Recognition · Computer Science 2016-06-15 Maya Kabkab , Azadeh Alavi , Rama Chellappa

Training a deep neural network (DNN) requires substantial computational and memory requirements. It is common to use multiple devices to train a DNN to reduce the overall training time. There are several choices to parallelize each layer in…

Machine Learning · Computer Science 2024-07-08 Venmugil Elango

One-Shot Neural Architecture Search (NAS) algorithms often rely on training a hardware agnostic super-network for a domain specific task. Optimal sub-networks are then extracted from the trained super-network for different hardware…

Machine Learning · Computer Science 2023-08-31 Sharath Nittur Sridhar , Souvik Kundu , Sairam Sundaresan , Maciej Szankin , Anthony Sarah

In recent years, the development of specialized edge computing devices has significantly increased, driven by the growing demand for AI models. These devices, such as the NVIDIA Jetson series, must efficiently handle increased data…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-03 Ashiyana Abdul Majeed , Mahmoud Meribout