English
Related papers

Related papers: The infrastructure powering IBM's Gen AI model dev…

200 papers

The rapid scaling of large language model training requires distributing GPU resources across multiple data center buildings and regions. We refer to such paradigm as "scale-across" training. As infrastructure expands, the system design…

Artificial intelligence (AI), especially deep learning, requires vast amounts of data for training, testing, and validation. Collecting these data and the corresponding annotations requires the implementation of imaging biobanks that…

Artificial Intelligence · Computer Science 2022-01-21 P. M. A van Ooijen , Erfan Darzidehkalani , Andre Dekker

Recognizing the tremendous improvements that the integration of generative AI can bring to intelligent transportation systems, this article explores the integration of generative AI technologies in vehicular networks, focusing on their…

Networking and Internet Architecture · Computer Science 2023-04-24 Ruichen Zhang , Ke Xiong , Hongyang Du , Dusit Niyato , Jiawen Kang , Xuemin Shen , H. Vincent Poor

Modern organizations manage their data with a wide variety of specialized cloud database engines (e.g., Aurora, BigQuery, etc.). However, designing and managing such infrastructures is hard. Developers must consider many possible designs…

Databases · Computer Science 2024-07-31 Geoffrey X. Yu , Ziniu Wu , Ferdi Kossmann , Tianyu Li , Markos Markakis , Amadou Ngom , Samuel Madden , Tim Kraska

Systems for training massive deep learning models (billions of parameters) today assume and require specialized "hyper-clusters": hundreds or thousands of GPUs wired with specialized high-bandwidth interconnects such as NV-Link and…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-16 Sanjith Athlur , Nitika Saran , Muthian Sivathanu , Ramachandran Ramjee , Nipun Kwatra

The field of engineering is shaped by the tools and methods used to solve problems. Optimization is one such class of powerful, robust, and effective engineering tools proven over decades of use. Within just a few years, generative…

Computational Engineering, Finance, and Science · Computer Science 2025-12-02 Lyle Regenwetter , Cyril Picard , Amin Heyrani Nobari , Akash Srivastava , Faez Ahmed

Training large-scale artificial intelligence (AI) models demands significant computational power and energy, leading to increased carbon footprint with potential environmental repercussions. This paper delves into the challenges of training…

Machine Learning · Computer Science 2024-02-07 Jieming Bian , Lei Wang , Shaolei Ren , Jie Xu

Deep Learning, driven by neural networks, has led to groundbreaking advancements in Artificial Intelligence by enabling systems to learn and adapt like the human brain. These models have achieved remarkable results, particularly in…

Machine Learning · Computer Science 2025-06-02 Paritosh Ranjan , Surajit Majumder , Prodip Roy

As a current trend in Artificial Intelligence (AI), large foundation models are increasingly employed as the core of AI services. However, even after training, serving such models at scale remains a challenging task due to their heavy…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-17 Tingyang Sun , Ting He , I-Hong Hou

Recent developments in Generative AI, Computer Vision, and Natural Language Processing have led to an increased integration of AI models into various products. This widespread adoption of AI requires significant efforts in deploying these…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-23 Kamil Kojs

Artificial intelligence in construction increasingly depends on structured representations such as Building Information Models and knowledge graphs, yet early-stage building designs are predominantly created as flexible…

Computation · Statistics 2026-01-26 Jun Xiao , Qiong Wang , Yihui Li , Zhexuan Yu , Hao Zhou , Borong Lin

Generative systems have a significant potential to synthesize innovative design alternatives. Still, most of the common systems that have been adopted in design require the designer to explicitly define the specifications of the procedures…

Machine Learning · Computer Science 2019-04-03 Ardavan Bidgoli , Pedro Veloso

Over the past decade, machine learning model complexity has grown at an extraordinary rate, as has the scale of the systems training such large models. However there is an alarmingly low hardware utilization (5-20%) in large scale AI…

Hardware Architecture · Computer Science 2022-11-14 Newsha Ardalani , Saptadeep Pal , Puneet Gupta

The principled design and discovery of biologically- and physically-informed models of neuronal dynamics has been advancing since the mid-twentieth century. Recent developments in artificial intelligence (AI) have accelerated this progress.…

Neurons and Cognition · Quantitative Biology 2021-12-24 Mahta Ramezanian Panahi , Germán Abrevaya , Jean-Christophe Gagnon-Audet , Vikram Voleti , Irina Rish , Guillaume Dumas

Self-driving cars and autonomous vehicles are revolutionizing the automotive sector, shaping the future of mobility altogether. Although the integration of novel technologies such as Artificial Intelligence (AI) and Cloud/Edge computing…

Software Engineering · Computer Science 2020-09-25 Sorin Grigorescu , Tiberiu Cocias , Bogdan Trasnea , Andrea Margheri , Federico Lombardi , Leonardo Aniello

Applications that fuse machine learning and simulation can benefit from the use of multiple computing resources, with, for example, simulation codes running on highly parallel supercomputers and AI training and inference tasks on…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-04 Logan Ward , J. Gregory Pauloski , Valerie Hayot-Sasson , Ryan Chard , Yadu Babuji , Ganesh Sivaraman , Sutanay Choudhury , Kyle Chard , Rajeev Thakur , Ian Foster

For over a century, the electric grid has relied on a single statistical assumption: \emph{load diversity}, the principle that the uncorrelated demands of millions of small consumers produce a smooth, predictable aggregate. AI training data…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-06 Noman Bashir , Rob Sherwood , Le Xie , Minlan Yu

If AI is a foundational general-purpose technology, we should anticipate that demand for AI compute -- and energy -- will continue to grow. The Sun is by far the largest energy source in our solar system, and thus it warrants consideration…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-02 Blaise Agüera y Arcas , Travis Beals , Maria Biggs , Jessica V. Bloom , Thomas Fischbacher , Konstantin Gromov , Urs Köster , Rishiraj Pravahan , James Manyika

This article introduces a model-driven engineering (MDE) integrated development environment (IDE) for Data-Intensive Cloud Applications (DIA) with iterative quality enhancements. As part of the H2020 DICE project (ICT-9-2014, id 644869), a…

Software Engineering · Computer Science 2017-09-20 Marc Gil , Christophe Joubert , Ismael Torres

Recent advances in artificial intelligence research have led to a profusion of studies that apply deep learning to problems in image analysis and natural language processing among others. Additionally, the availability of open-source…