English
Related papers

Related papers: The infrastructure powering IBM's Gen AI model dev…

200 papers

With the increasing number of Machine and Deep Learning applications in High Energy Physics, easy access to dedicated infrastructure represents a requirement for fast and efficient R&D. This work explores different types of cloud services…

Machine Learning · Computer Science 2021-11-09 Renato Cardoso , Dejan Golubovic , Ignacio Peluaga Lozada , Ricardo Rocha , João Fernandes , Sofia Vallecorsa

Reliability in cloud AI infrastructure is crucial for cloud service providers, prompting the widespread use of hardware redundancies. However, these redundancies can inadvertently lead to hidden degradation, so called "gray failure", for AI…

Training large-scale models relies on a vast number of computing resources. For example, training the GPT-4 model (1.8 trillion parameters) requires 25000 A100 GPUs . It is a challenge to build a large-scale cluster with one type of…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-12 Si Xu , Zixiao Huang , Yan Zeng , Shengen Yan , Xuefei Ning , Quanlu Zhang , Haolin Ye , Sipei Gu , Chunsheng Shui , Zhezheng Lin , Hao Zhang , Sheng Wang , Guohao Dai , Yu Wang

The escalating cost, extended timelines, and low success rates in pharmaceutical research demand a fundamental rethinking of biotechnology R&D infrastructure. This chapter introduces the concept of the AI-Integrated Biotechnology Hub, a…

Physics and Society · Physics 2025-10-07 Alex Zhavoronkov , Chuen Yan Leung

Cloud computing is gradually gaining popularity among businesses due to its distinct advantages over self-hosted IT infrastructures. Business Intelligence (BI) is a highly resource intensive system requiring large-scale parallel processing…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-25 Hussain Al-Aqrabi , Lu Liu , Richard Hill , Nick Antonopoulos

Generative artificial intelligence (AI) technology is revolutionizing the computing industry. Not only its applications have broadened to various sectors but also poses new system design and optimization opportunities. The technology is…

Generative Artificial Intelligence (AI) has shown tremendous prospects in all aspects of technology, including design. However, due to its heavy demand on resources, it is usually trained on large computing infrastructure and often made…

Artificial Intelligence · Computer Science 2024-02-27 Sai Krishna Revanth Vuruma , Ashley Margetts , Jianhai Su , Faez Ahmed , Biplav Srivastava

The scaling up of deep neural networks has been demonstrated to be effective in improving model quality, but also encompasses several training challenges in terms of training efficiency, programmability, and resource adaptability. We…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-07 Xianyan Jia , Le Jiang , Ang Wang , Wencong Xiao , Ziji Shi , Jie Zhang , Xinyuan Li , Langshi Chen , Yong Li , Zhen Zheng , Xiaoyong Liu , Wei Lin

With the advent of ubiquitous deployment of smart devices and the Internet of Things, data sources for machine learning inference have increasingly moved to the edge of the network. Existing machine learning inference platforms typically…

Machine Learning · Computer Science 2022-08-05 Yongji Wu , Matthew Lentz , Danyang Zhuo , Yao Lu

Training an effective Machine learning (ML) model is an iterative process that requires effort in multiple dimensions. Vertically, a single pipeline typically includes an initial ETL (Extract, Transform, Load) of raw datasets, a model…

Machine Learning · Computer Science 2024-01-31 Dachi Chen , Weitian Ding , Chen Liang , Chang Xu , Junwei Zhang , Majd Sakr

Influenced by the great success of deep learning via cloud computing and the rapid development of edge chips, research in artificial intelligence (AI) has shifted to both of the computing paradigms, i.e., cloud computing and edge computing.…

Deep learning (DL), a form of machine learning, is becoming increasingly popular in several application domains. As a result, cloud-based Deep Learning as a Service (DLaaS) platforms have become an essential infrastructure in many…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-18 Scott Boag , Parijat Dube , Kaoutar El Maghraoui , Benjamin Herta , Waldemar Hummer , K. R. Jayaram , Rania Khalaf , Vinod Muthusamy , Michael Kalantar , Archit Verma

Machine Learning (ML) is driving a revolution in the way scientists design, develop, and deploy data-intensive software. However, the adoption of ML presents new challenges for the computing infrastructure, particularly in terms of…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-19 Lucio Anderlini , Matteo Barbetti , Giulio Bianchini , Diego Ciangottini , Stefano Dal Pra , Diego Michelotto , Carmelo Pellegrino , Rosa Petrini , Alessandro Pascolini , Daniele Spiga

Cloud infrastructure is the cornerstone of the modern IT industry. However, managing this infrastructure effectively requires considerable manual effort from the DevOps engineering team. We make a case for developing AI agents powered by…

Artificial Intelligence · Computer Science 2025-06-17 Zhenning Yang , Archit Bhatnagar , Yiming Qiu , Tongyuan Miao , Patrick Tser Jern Kon , Yunming Xiao , Yibo Huang , Martin Casado , Ang Chen

The collaboration of large artificial intelligence (AI) models in mobile edge networks has emerged as a promising paradigm to meet the growing demand for intelligent services at the network edge. By enabling multiple devices to…

Networking and Internet Architecture · Computer Science 2026-02-17 Peichun Li , Liping Qian , Dusit Niyato , Shiwen Mao , Yuan Wu

Scientific research increasingly depends on robust and scalable IT infrastructures to support complex computational workflows. With the proliferation of services provided by research infrastructures, NRENs, and commercial cloud providers,…

Artificial intelligence (AI) has the potential to transform healthcare by supporting more accurate diagnoses and personalized treatments. However, its adoption in practice remains constrained by fragmented data sources, strict privacy…

Software Engineering · Computer Science 2026-02-16 Mira Raheem , Amal Elgammal , Michael Papazoglou , Bernd Krämer , Neamat El-Tazi

The surging development of Artificial Intelligence-Generated Content (AIGC) marks a transformative era of the content creation and production. Edge servers promise attractive benefits, e.g., reduced service delay and backhaul traffic load,…

Machine Learning · Computer Science 2024-09-10 Yuxin Liang , Peng Yang , Yuanyuan He , Feng Lyu

Generative artificial intelligence (AI) is rapidly transforming medical imaging by enabling capabilities such as data synthesis, image enhancement, modality translation, and spatiotemporal modeling. This review presents a comprehensive and…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Xuanru Zhou , Cheng Li , Shuqiang Wang , Ye Li , Tao Tan , Hairong Zheng , Shanshan Wang

The exponential growth of big data has transformed how large organisations leverage information to drive innovation, optimise processes, and maintain competitive advantages. However, managing and extracting insights from vast, heterogeneous…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-09 Fathima Nuzla Ismail , Abira Sengupta , Shanika Amarasoma