English
Related papers

Related papers: Incremental Learning Framework Using Cloud Computi…

200 papers

A major concern of deep learning models is the large amount of data that is required to build and train them, much of which is reliant on sensitive and personally identifiable information that is vulnerable to access by third parties. Ideas…

Quantum Physics · Physics 2023-10-24 Tyler Wang , Huan-Hsin Tseng , Shinjae Yoo

When deploying deep learning models to a device, it is traditionally assumed that available computational resources (compute, memory, and power) remain static. However, real-world computing systems do not always provide stable resource…

Machine Learning · Computer Science 2021-10-11 Elvis Nunez , Maxwell Horton , Anish Prabhu , Anurag Ranjan , Ali Farhadi , Mohammad Rastegari

Distributed deep learning systems (DDLS) train deep neural network models by utilizing the distributed resources of a cluster. Developers of DDLS are required to make many decisions to process their particular workloads in their chosen…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-09 Matthias Langer , Zhen He , Wenny Rahayu , Yanbo Xue

Clouds gather a vast volume of telemetry from their networked systems which contain valuable information that can help solve many of the problems that continue to plague them. However, it is hard to extract useful information from such raw…

Networking and Internet Architecture · Computer Science 2020-04-28 Behnaz Arzani , Bita Rouhani

In recent years, deep learning has made remarkable progress in a wide range of domains, with a particularly notable impact on natural language processing tasks. One of the challenges associated with training deep neural networks in the…

Machine Learning · Computer Science 2024-06-27 Hanna Mazzawi , Xavi Gonzalvo , Michael Wunder , Sammy Jerome , Benoit Dherin

Recent progress in hardware and methodology for training neural networks has ushered in a new generation of large networks trained on abundant data. These models have obtained notable gains in accuracy across many NLP tasks. However, these…

Computation and Language · Computer Science 2019-06-07 Emma Strubell , Ananya Ganesh , Andrew McCallum

Neural network models can now recognise images, understand text, translate languages, and play many human games at human or superhuman levels. These systems are highly abstracted, but are inspired by biological brains and use only…

Neurons and Cognition · Quantitative Biology 2019-03-06 Katherine R. Storrs , Nikolaus Kriegeskorte

Current Deep Learning approaches have been very successful using convolutional neural networks (CNN) trained on large graphical processing units (GPU)-based computers. Three limitations of this approach are: 1) they are based on a simple…

Neural and Evolutionary Computing · Computer Science 2017-07-17 Thomas E. Potok , Catherine Schuman , Steven R. Young , Robert M. Patton , Federico Spedalieri , Jeremy Liu , Ke-Thia Yao , Garrett Rose , Gangotree Chakma

Data loading can dominate deep neural network training time on large-scale systems. We present a comprehensive study on accelerating data loading performance in large-scale distributed training. We first identify performance and scalability…

Machine Learning · Computer Science 2020-02-20 Chih-Chieh Yang , Guojing Cong

Recently, computational modeling has shifted towards the use of deep learning, and other data-driven modeling frameworks. Although this shift in modeling holds promise in many applications like design optimization and real-time control by…

Fluid Dynamics · Physics 2021-10-11 Suraj Pawar , Omer San , Prakash Vedula , Adil Rasheed , Trond Kvamsdal

We present scalable hybrid-parallel algorithms for training large-scale 3D convolutional neural networks. Deep learning-based emerging scientific workflows often require model training with large, high-dimensional samples, which can make…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-28 Yosuke Oyama , Naoya Maruyama , Nikoli Dryden , Erin McCarthy , Peter Harrington , Jan Balewski , Satoshi Matsuoka , Peter Nugent , Brian Van Essen

The deployment of Machine Learning models in the cloud has grown among tech companies. Hardware requirements are higher when these models involve Deep Learning techniques, and the cloud providers' costs may be a barrier. We explore…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-13 Elayne Lemos , Rodrigo Oliveira , Jairson Rodrigues , Rosalvo F. Oliveira Neto

Deep neural networks have shown great success in many diverse fields. The training of these networks can take significant amounts of time, compute and energy. As datasets get larger and models become more complex, the exploration of model…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-08 Siddharth Samsi , Michael Jones , Mark M. Veillette

To support the needs of ever-growing cloud-based services, the number of servers and network devices in data centers is increasing exponentially, which in turn results in high complexities and difficulties in network optimization. To…

Networking and Internet Architecture · Computer Science 2022-03-02 Bo Li , Ting Wang , Peng Yang , Mingsong Chen , Shui Yu , Mounir Hamdi

The rising computational and energy demands of deep learning, particularly in large-scale architectures such as foundation models and large language models (LLMs), pose significant challenges to sustainability. Traditional gradient-based…

Machine Learning · Computer Science 2025-09-19 Mohammad Saleh Vahdatpour , Huaiyuan Chu , Yanqing Zhang

Theoretical and empirical evidence indicates that the depth of neural networks is crucial for their success. However, training becomes more difficult as depth increases, and training of very deep networks remains an open problem. Here we…

Machine Learning · Computer Science 2015-11-24 Rupesh Kumar Srivastava , Klaus Greff , Jürgen Schmidhuber

Automatic decision-making approaches, such as reinforcement learning (RL), have been applied to (partially) solve the resource allocation problem adaptively in the cloud computing system. However, a complete cloud resource allocation…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-08-15 Ning Liu , Zhe Li , Zhiyuan Xu , Jielong Xu , Sheng Lin , Qinru Qiu , Jian Tang , Yanzhi Wang

Deep learning methods have predominantly been applied to large artificial neural networks. Despite their state-of-the-art performance, these large networks typically do not generalize well to datasets with limited sample sizes. In this…

Machine Learning · Statistics 2016-11-17 Eric Strobl , Shyam Visweswaran

In this era of digital information explosion, an abundance of data from numerous modalities is being generated as well as archived everyday. However, most problems associated with training Deep Neural Networks still revolve around lack of…

Machine Learning · Computer Science 2019-12-30 Sravanti Addepalli , Gaurav Kumar Nayak , Anirban Chakraborty , R. Venkatesh Babu

Although deep learning approaches have stood out in recent years due to their state-of-the-art results, they continue to suffer from catastrophic forgetting, a dramatic decrease in overall performance when training with new classes added…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Francisco M. Castro , Manuel J. Marín-Jiménez , Nicolás Guil , Cordelia Schmid , Karteek Alahari