English
Related papers

Related papers: Scalable, Distributed AI Frameworks: Leveraging Cl…

200 papers

Artificial intelligence (AI) has witnessed a substantial breakthrough in a variety of Internet of Things (IoT) applications and services, spanning from recommendation systems to robotics control and military surveillance. This is driven by…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-30 Emna Baccour , Naram Mhaisen , Alaa Awad Abdellatif , Aiman Erbad , Amr Mohamed , Mounir Hamdi , Mohsen Guizani

With the rapid expansion of cloud computing applications, optimizing resource allocation has become crucial for improving system performance and cost efficiency. This paper proposes an intelligent resource allocation algorithm that…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-08 Yuqing Wang , Xiao Yang

As a specific category of artificial intelligence (AI), generative artificial intelligence (GenAI) generates new content that resembles what is created by humans. The rapid development of GenAI systems has created a huge amount of new data…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-11 Yun-Cheng Wang , Jintang Xue , Chengwei Wei , C. -C. Jay Kuo

Artificial intelligence (AI) has demonstrated considerable potential in the realm of medical imaging. However, the development of high-performance AI models typically necessitates training on large-scale, centralized datasets. This approach…

Cryptography and Security · Computer Science 2025-08-29 Mengyu Sun , Ziyuan Yang , Yongqiang Huang , Hui Yu , Yingyu Chen , Shuren Qi , Andrew Beng Jin Teoh , Yi Zhang

Federated learning (FL) can fully leverage large-scale terminal data while ensuring privacy and security, and is considered as a distributed alternative for the centralized machine learning. However, the issue of data heterogeneity poses…

Machine Learning · Computer Science 2025-03-27 Xianke Qiang , Zheng Chang , Ying-Chang Liang

Generative artificial intelligence (GenAI) offers various services to users through content creation, which is believed to be one of the most important components in future networks. However, training and deploying big artificial…

Networking and Internet Architecture · Computer Science 2024-01-04 Yuqing Tian , Zhaoyang Zhang , Yuzhi Yang , Zirui Chen , Zhaohui Yang , Richeng Jin , Tony Q. S. Quek , Kai-Kit Wong

The forthcoming 6G networks will embrace a new realm of AI-driven services that requires innovative network slicing strategies, namely slicing for AI, which involves the creation of customized network slices to meet Quality of service (QoS)…

Networking and Internet Architecture · Computer Science 2024-11-06 Menna Helmy , Alaa Awad Abdellatif , Naram Mhaisen , Amr Mohamed , Aiman Erbad

Modern deep learning applications require increasingly more compute to train state-of-the-art models. To address this demand, large corporations and institutions use dedicated High-Performance Computing clusters, whose construction and…

Cloud computing is an increasingly popular computing paradigm, now proving a necessity for utility computing services. Each provider offers a unique service portfolio with a range of resource configurations. Resource provisioning for cloud…

Networking and Internet Architecture · Computer Science 2016-11-17 Mohamed Abu Sharkh , Manar Jammal , Abdallah Shami , Abdelkader Ouda

With the success of deep learning techniques in a broad range of application domains, many deep learning software frameworks have been developed and are being updated frequently to adapt to new hardware features and software libraries,…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-10 Pengfei Xu , Shaohuai Shi , Xiaowen Chu

While developing artificial intelligence (AI)-based algorithms to solve problems, the amount of data plays a pivotal role - large amount of data helps the researchers and engineers to develop robust AI algorithms. In the case of building…

Machine Learning · Computer Science 2022-04-25 Amartya Bhattacharya , Manish Gawali , Jitesh Seth , Viraj Kulkarni

Cloud workloads today are typically managed in a distributed environment and processed across geographically distributed data centers. Cloud service providers have been distributing data centers globally to reduce operating costs while also…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-18 Ninad Hogade , Sudeep Pasricha

Fast-evolving artificial intelligence (AI) algorithms such as large language models have been driving the ever-increasing computing demands in today's data centers. Heterogeneous computing with domain-specific architectures (DSAs) brings…

Hardware Architecture · Computer Science 2024-03-06 Zhuoping Yang , Shixin Ji , Xingzhen Chen , Jinming Zhuang , Weifeng Zhang , Dharmesh Jani , Peipei Zhou

Deep neural networks have established themselves as one of the most promising machine learning techniques. Training such models at large scales is often parallelized, giving rise to the concept of distributed deep learning. Distributed…

Quantum Physics · Physics 2022-11-15 Lirandë Pira , Chris Ferrie

Deep learning research aims at discovering learning algorithms that discover multiple levels of distributed representations, with higher levels representing more abstract concepts. Although the study of deep learning has already led to…

Machine Learning · Computer Science 2013-06-10 Yoshua Bengio

Cloud computing environments are increasingly vulnerable to security threats such as distributed denial-of-service (DDoS) attacks and SQL injection. Traditional security mechanisms, based on rule matching and feature recognition, struggle…

Cryptography and Security · Computer Science 2025-12-11 Yuqing Wang , Xiao Yang

The conventional cloud-based large model learning framework is increasingly constrained by latency, cost, personalization, and privacy concerns. In this survey, we explore an emerging paradigm: collaborative learning between on-device small…

Machine Learning · Computer Science 2025-04-23 Chaoyue Niu , Yucheng Ding , Junhui Lu , Zhengxiang Huang , Hang Zeng , Yutong Dai , Xuezhen Tu , Chengfei Lv , Fan Wu , Guihai Chen

Scale of data and scale of computation infrastructures together enable the current deep learning renaissance. However, training large-scale deep architectures demands both algorithmic improvement and careful system configuration. In this…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-21 Shang-Xuan Zou , Chun-Yen Chen , Jui-Lin Wu , Chun-Nan Chou , Chia-Chin Tsao , Kuan-Chieh Tung , Ting-Wei Lin , Cheng-Lung Sung , Edward Y. Chang

With the rapid transformation of computer hardware and algorithms, mobile networking has evolved from low data carrying capacity and high latency to better-optimized networks, either by enhancing the digital network or using different…

Networking and Internet Architecture · Computer Science 2023-11-09 Wenbo Zhu

The rapid advancement of ML models in critical sectors such as healthcare, finance, and security has intensified the need for robust data security, model integrity, and reliable outputs. Large multimodal foundational models, while crucial…

Cryptography and Security · Computer Science 2024-12-13 Hongyang Zhang , Yue Zhao , Claudio Angione , Harry Yang , James Buban , Ahmad Farhan , Fielding Johnston , Patrick Colangelo