English
Related papers

Related papers: Distributed Transfer Learning with 4th Gen Intel X…

200 papers

Convolutional Neural Networks (CNNs) have shown to be powerful classification tools in tasks that range from check reading to medical diagnosis, reaching close to human perception, and in some cases surpassing it. However, the problems to…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-12-08 Jose Marques , Gabriel Falcao , Luís A. Alexandre

Modern deep learning systems like PyTorch and Tensorflow are able to train enormous models with billions (or trillions) of parameters on a distributed infrastructure. These systems require that the internal nodes have the same memory…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-01 Yifan Ding , Nicholas Botzer , Tim Weninger

Transfer learning has emerged as a powerful methodology for adapting pre-trained deep neural networks on image recognition tasks to new domains. This process consists of taking a neural network pre-trained on a large feature-rich source…

Machine Learning · Computer Science 2021-04-27 Francisco Utrera , Evan Kravitz , N. Benjamin Erichson , Rajiv Khanna , Michael W. Mahoney

In the last few years, the memory requirements to train state-of-the-art neural networks have far exceeded the DRAM capacities of modern hardware accelerators. This has necessitated the development of efficient algorithms to train these…

Machine Learning · Computer Science 2023-05-16 Siddharth Singh , Abhinav Bhatele

Heavy communication, in particular, collective operations, can become a critical performance bottleneck in scaling the training of billion-parameter neural networks to large-scale parallel systems. This paper introduces a four-dimensional…

Machine Learning · Computer Science 2024-05-15 Siddharth Singh , Prajwal Singhania , Aditya K. Ranjan , Zack Sating , Abhinav Bhatele

The ability to automatically learn task specific feature representations has led to a huge success of deep learning methods. When large training data is scarce, such as in medical imaging problems, transfer learning has been very effective.…

Computer Vision and Pattern Recognition · Computer Science 2017-04-21 Hariharan Ravishankar , Prasad Sudhakar , Rahul Venkataramani , Sheshadri Thiruvenkadam , Pavan Annangi , Narayanan Babu , Vivek Vaidya

The optimization of the transpose convolution layer for deep learning applications is achieved with the kernel segregation mechanism. However, kernel segregation has disadvantages, such as computing extra elements to obtain the output…

Machine Learning · Computer Science 2025-03-03 Vijay Srinivas Tida , Md Imran Hossen , Liqun Shan , Sai Venkatesh Chilukoti , Sonya Hsu , Xiali Hei

The introduction of deep learning and transfer learning techniques in fields such as computer vision allowed a leap forward in the accuracy of image classification tasks. Currently there is only limited use of such techniques in…

Machine Learning · Computer Science 2019-07-03 Axel Uran , Coert van Gemeren , Rosanne van Diepen , Ricardo Chavarriaga , José del R. Millán

Large-scale AI model training divides work across thousands of GPUs, then synchronizes gradients across them at each step. This incurs a significant network burden that only centralized, monolithic clusters can support, driving up…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 David McAllister , Matthew Tancik , Jiaming Song , Angjoo Kanazawa

This extended abstract explores the integration of federated learning with deep transfer hashing for distributed prediction tasks, emphasizing resource-efficient client training from evolving data streams. Federated learning allows multiple…

Machine Learning · Computer Science 2024-09-20 Manuel Röder , Frank-Michael Schleif

Transfer learning is a machine learning technique that uses previously acquired knowledge from a source domain to enhance learning in a target domain by reusing learned weights. This technique is ubiquitous because of its great advantages…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Nermeen Abou Baker , Nico Zengeler , Uwe Handmann

Deep learning models can take weeks to train on a single GPU-equipped machine, necessitating scaling out DL training to a GPU-cluster. However, current distributed DL implementations can scale poorly due to substantial parameter…

Machine Learning · Computer Science 2017-06-13 Hao Zhang , Zeyu Zheng , Shizhen Xu , Wei Dai , Qirong Ho , Xiaodan Liang , Zhiting Hu , Jinliang Wei , Pengtao Xie , Eric P. Xing

Transfer learning refers to the process of adapting a model trained on a source task to a target task. While kernel methods are conceptually and computationally simple machine learning models that are competitive on a variety of tasks, it…

Machine Learning · Computer Science 2022-11-02 Adityanarayanan Radhakrishnan , Max Ruiz Luyten , Neha Prasad , Caroline Uhler

The rapid evolution of artificial intelligence (AI) is leading to a new generation of hardware accelerators optimized for deep learning. Some of the designs of these accelerators are general enough to allow their use for other…

Computational Engineering, Finance, and Science · Computer Science 2019-12-18 Fantine Huot , Yi-Fan Chen , Robert Clapp , Carlos Boneti , John Anderson

Convolutional neural networks (CNNs) have constantly achieved better performance over years by introducing more complex topology, and enlarging the capacity towards deeper and wider CNNs. This makes the manual design of CNNs extremely…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Bin Wang , Bing Xue , Mengjie Zhang

One of the keys for deep learning to have made a breakthrough in various fields was to utilize high computing powers centering around GPUs. Enabling the use of further computing abilities by distributed processing is essential not only to…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-01 Takuya Akiba , Keisuke Fukuda , Shuji Suzuki

Most research on novel techniques for 3D Medical Image Segmentation (MIS) is currently done using Deep Learning with GPU accelerators. The principal challenge of such technique is that a single input can easily cope computing resources, and…

Machine Learning · Computer Science 2021-11-01 Josep Lluis Berral , Oriol Aranda , Juan Luis Dominguez , Jordi Torres

GPUs have been favored for training deep learning models due to their highly parallelized architecture. As a result, most studies on training optimization focus on GPUs. There is often a trade-off, however, between cost and efficiency when…

Transformer models trained on long sequences often achieve higher accuracy than short sequences. Unfortunately, conventional transformers struggle with long sequence training due to the overwhelming computation and memory requirements.…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-09 Xiao Wang , Isaac Lyngaas , Aristeidis Tsaris , Peng Chen , Sajal Dash , Mayanka Chandra Shekar , Tao Luo , Hong-Jun Yoon , Mohamed Wahib , John Gouley

Convolution layers are prevalent in many classes of deep neural networks, including Convolutional Neural Networks (CNNs) which provide state-of-the-art results for tasks like image recognition, neural machine translation and speech…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-22 Evangelos Georganas , Sasikanth Avancha , Kunal Banerjee , Dhiraj Kalamkar , Greg Henry , Hans Pabst , Alexander Heinecke