English
Related papers

Related papers: Deep Learning by Doing: The NVIDIA Deep Learning I…

200 papers

Online deep learning tackles the challenge of learning from data streams by balancing two competing goals: fast learning and deep learning. However, existing research primarily emphasizes deep learning solutions, which are more adept at…

Machine Learning · Computer Science 2025-03-24 Antonios Valkanas , Boris N. Oreshkin , Mark Coates

Deep learning has been postulated as a solution for numerous problems in different branches of science. Given the resource-intensive nature of these models, they often need to be executed on specialized hardware such graphical processing…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-15 Jose González-Abad , Álvaro López García , Valentin Y. Kozlov

Multilayered artificial neural networks are becoming a pervasive tool in a host of application fields. At the heart of this deep learning revolution are familiar concepts from applied and computational mathematics; notably, in calculus,…

History and Overview · Mathematics 2018-01-19 Catherine F. Higham , Desmond J. Higham

Driven by the dual principles of smart education and artificial intelligence technology, the online education model has rapidly emerged as an important component of the education industry. Cognitive diagnostic technology can utilize…

Artificial Intelligence · Computer Science 2025-10-28 Zhifeng Wang , Meixin Su , Yang Yang , Chunyan Zeng , Lizhi Ye

In the last decades, the computational power of GPUs has grown exponentially, allowing current deep learning (DL) applications to handle increasingly large amounts of data at a progressively higher throughput. However, network and storage…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-08 Francesco Versaci , Giovanni Busonera

MLI is an Application Programming Interface designed to address the challenges of building Machine Learn- ing algorithms in a distributed setting based on data-centric computing. Its primary goal is to simplify the development of…

We propose a framework for training neural networks that are coupled with partial differential equations (PDEs) in a parallel computing environment. Unlike most distributed computing frameworks for deep neural networks, our focus is to…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-25 Kailai Xu , Weiqiang Zhu , Eric Darve

There is a growing demand to deploy computation-intensive deep learning (DL) models on resource-constrained mobile devices for real-time intelligent applications. Equipped with a variety of processing units such as CPUs, GPUs, and NPUs, the…

Machine Learning · Computer Science 2024-05-06 Sicong Liu , Wentao Zhou , Zimu Zhou , Bin Guo , Minfan Wang , Cheng Fang , Zheng Lin , Zhiwen Yu

The field of deep learning has witnessed a remarkable shift towards extremely compute- and memory-intensive neural networks. These newer larger models have enabled researchers to advance state-of-the-art tools across a variety of fields.…

Machine Learning · Computer Science 2022-07-04 Daniel Nichols , Siddharth Singh , Shu-Huai Lin , Abhinav Bhatele

Deep reinforcement learning has led to dramatic breakthroughs in the field of artificial intelligence for the past few years. As the amount of rollout experience data and the size of neural networks for deep reinforcement learning have…

Machine Learning · Computer Science 2024-11-11 Zhihong Liu , Xin Xu , Peng Qiao , Dongsheng Li

With the development of deep learning (DL) techniques, rotating machinery intelligent diagnosis has gone through tremendous progress with verified success and the classification accuracies of many DL-based intelligent diagnosis algorithms…

Signal Processing · Electrical Eng. & Systems 2020-08-20 Zhibin Zhao , Tianfu Li , Jingyao Wu , Chuang Sun , Shibin Wang , Ruqiang Yan , Xuefeng Chen

Deep learning frameworks have been widely deployed on GPU servers for deep learning applications in both academia and industry. In training deep neural networks (DNNs), there are many standard processes or algorithms, such as convolution…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-21 Shaohuai Shi , Qiang Wang , Xiaowen Chu

With the rapid development of artificial intelligence (AI) community, education in AI is receiving more and more attentions. There have been many AI related courses in the respects of algorithms and applications, while not many courses in…

Artificial Intelligence · Computer Science 2022-07-26 Jianlei Yang , Xiaopeng Gao , Weisheng Zhao

Deep learning (DL), a new-generation of artificial neural network research, has transformed industries, daily lives and various scientific disciplines in recent years. DL represents significant progress in the ability of neural networks to…

Machine Learning · Statistics 2018-09-05 Chaopeng Shen

Decentralized learning (DL) has gained prominence for its potential benefits in terms of scalability, privacy, and fault tolerance. It consists of many nodes that coordinate without a central server and exchange millions of parameters in…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-15 Akash Dhasade , Anne-Marie Kermarrec , Rafael Pires , Rishi Sharma , Milos Vujasinovic

The proliferation of complex deep learning (DL) models has revolutionized various applications, including computer vision-based solutions, prompting their integration into real-time systems. However, the resource-intensive nature of these…

Hardware Architecture · Computer Science 2024-06-26 Tushar Prasanna Swaminathan , Christopher Silver , Thangarajah Akilan

We propose a novel framework and a solution to tackle the continual learning (CL) problem with changing network architectures. Most CL methods focus on adapting a single architecture to a new task/class by modifying its weights. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Divyam Madaan , Hongxu Yin , Wonmin Byeon , Jan Kautz , Pavlo Molchanov

Deep learning (DL) has transformed applications in a variety of domains, including computer vision, natural language processing, and tabular data analysis. The search for improved DL model accuracy has led practitioners to explore…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-10 Kabir Nagrecha

Edge intelligent applications like VR/AR and language model based chatbots have become widespread with the rapid expansion of IoT and mobile devices. However, constrained edge devices often cannot serve the increasingly large and complex…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-28 Zongshun Zhang , Ibrahim Matta

Embodied agents, such as robots and virtual characters, must continuously select actions to execute tasks effectively, solving complex sequential decision-making problems. Given the difficulty of designing such controllers manually,…

Robotics · Computer Science 2026-05-18 Pedro Santana