English
Related papers

Related papers: Compute at Scale: A Broad Investigation into the D…

200 papers

We propose a disruptive paradigm to actively place and schedule TWhrs of parallel AI jobs strategically on the grid, at distributed, grid-aware high performance compute data centers (HPC) capable of using their massive power and energy load…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-08 Scott C Evans , Nathan Dahlin , Ibrahima Ndiaye , Sachini Piyoni Ekanayake , Alexander Duncan , Blake Rose , Hao Huang

Thanks to the availability of massive amounts of data, computing resources, and advanced algorithms, AI has entered nearly every sector. This has sparked significant investment and interest, particularly in building data centers with the…

Artificial Intelligence · Computer Science 2025-11-25 Pandu Devarakota , Nicolas Tsesmetzis , Faruk O. Alpak , Apurva Gala , Detlef Hohl

Today, data is growing at a tremendous rate and, according to the International Data Corporation, it is expected to reach 175 zettabytes by 2025. The International Data Corporation also forecasts that more than 150B devices will be…

Databases · Computer Science 2021-07-09 Valentina Janev

Scale-out workloads like media streaming or Web search serve millions of users and operate on a massive amount of data, and hence, require enormous computational power. As the number of users is increasing and the size of data is expanding,…

Hardware Architecture · Computer Science 2018-08-16 Pouya Esmaili-Dokht , Mohammad Bakhshalipour , Behnam Khodabandeloo , Pejman Lotfi-Kamran , Hamid Sarbazi-Azad

The very DNA of AI architecture presents conflicting paths: centralized cloud-based models (Software-as-a-Service) versus decentralized edge AI (local processing on consumer devices). This paper analyzes the competitive battleground across…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-17 Rhea Pritham Marpu , Kevin J McNamara , Preeti Gupta

Computing power, or "compute," is crucial for the development and deployment of artificial intelligence (AI) capabilities. As a result, governments and companies have started to leverage compute as a means to govern AI. For example,…

Previous literature has proposed that the companies operating data centers enforce government regulations on AI companies. Using a new dataset of 775 non-U.S. data center projects, this paper estimates how often data centers could be…

Computers and Society · Computer Science 2026-05-05 Aris Richardson , Haley Yi , Michelle Nie , Simon Wisdom , Casey Price , Ruben Weijers , Steven Veld , Mauricio Baker

In recent years, cloud computing has been widely used. Cloud computing refers to the centralized computing resources, users through the access to the centralized resources to complete the calculation, the cloud computing center will return…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-28 Yifan Zhang , Bo Liu , Yulu Gong , Jiaxin Huang , Jingyu Xu , Weixiang Wan

Data centers are growing rapidly, creating the pressing need for the development of critical infrastructure build out to support these resource-intensive large loads. Their immense consumption of electricity and, often, freshwater,…

Systems and Control · Electrical Eng. & Systems 2026-01-26 Maria Vabson , Muhy Eddin Zater , Amir Sajadi , Kyri Baker , Bri-Mathias Hodge

Data-centric AI is at the center of a fundamental shift in software engineering where machine learning becomes the new software, powered by big data and computing infrastructure. Here software engineering needs to be re-thought where data…

Machine Learning · Computer Science 2022-12-27 Steven Euijong Whang , Yuji Roh , Hwanjun Song , Jae-Gil Lee

Decades of research in artificial intelligence (AI) have produced formidable technologies that are providing immense benefit to industry, government, and society. AI systems can now translate across multiple languages, identify objects in…

Computers and Society · Computer Science 2019-08-08 Yolanda Gil , Bart Selman

Demand for AI accelerators is rapidly increasing rack power density, with projections approaching 1MW per deployment by 2027. This poses a major challenge for datacenter power delivery designers. As power densities increase, a datacenter…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-18 Grant Wilkins , Fiodar Kazhamiaka , Alok Gautam Kumbhare , Chaojie Zhang , Ricardo Bianchini

Alibaba has China's largest e-commerce platform. To support its diverse businesses, Alibaba has its own large-scale data centers providing the computing foundation for a wide variety of software applications. Among these applications, deep…

Machine Learning · Computer Science 2019-09-25 Wei Zhang , Wei Wei , Lingjie Xu , Lingling Jin , Cheng Li

Data collection is pervasively bound to our digital lifestyle. A recent study by the IDC reports that the growth of the data created and replicated in 2020 was even higher than in the previous years due to pandemic-related confinements to…

Human-Computer Interaction · Computer Science 2024-11-20 Paula Pereira , Jácome Cunha , João P. Fernandes

The rapid expansion of hyperscale data centers, primarily driven by cloud computing and generative AI is placing growing pressure on electricity systems, land, and climate-sensitive infrastructure. While existing maps document where data…

Physics and Society · Physics 2026-02-04 Milan Janosov

Now we live in an era of big data, and big data applications are becoming more and more pervasive. How to benchmark data center computer systems running big data applications (in short big data systems) is a hot topic. In this paper, we…

Performance · Computer Science 2013-07-31 Zhen Jia , Runlin Zhou , Chunge Zhu , Lei Wang , Wanling Gao , Yingjie Shi , Jianfeng Zhan , Lixin Zhang

This report estimates the potential number of digital minds, defined as AI systems exhibiting observable traits such as agency, personality, and intelligence, in the coming decades. It employs two complementary approaches: first, examining…

Computers and Society · Computer Science 2026-01-21 Derek Shiller

Over the Eight decades, computing paradigms have shifted from large, centralized systems to compact, distributed architectures, leading to the rise of the Distributed Computing Continuum (DCC). In this model, multiple layers such as cloud,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-10 Praveen Kumar Donta , Qiyang Zhang , Schahram Dustdar

The world of computing is in rapid transition, now dominated by a world of smartphones and cloud services, with profound implications for the future of advanced scientific computing. Simply put, high-performance computing (HPC) is at an…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-08 Daniel Reed , Dennis Gannon , Jack Dongarra

Machine learning is a computational process. To that end, it is inextricably tied to computational power - the tangible material of chips and semiconductors that the algorithms of machine intelligence operate on. Most obviously,…

Artificial Intelligence · Computer Science 2018-03-28 Tim Hwang