English
Related papers

Related papers: Scaling Intelligence: Designing Data Centers for N…

200 papers

The rapid adoption of Large Language Models (LLMs) has raised significant environmental concerns. Unlike the one-time cost of training, LLM inference occurs continuously and dominates the AI energy footprint. Yet most sustainability studies…

Machine Learning · Computer Science 2026-04-08 Hemang Jain , Shailender Goyal , Divyansh Pandey , Karthik Vaidhyanathan

As large language models (LLMs) continue to scale, the high power consumption of AI accelerators in datacenters presents significant challenges, substantially increasing the total cost of ownership (TCO) for cloud service providers (CSPs)…

Machine Learning · Computer Science 2025-08-26 Jiwoo Kim , Joonhyung Lee , Gunho Park , Byeongwook Kim , Se Jung Kwon , Dongsoo Lee , Youngjoo Lee

Large language models (LLMs) have revolutionized the state-of-the-art of many different natural language processing tasks. Although serving LLMs is computationally and memory demanding, the rise of Small Language Models (SLMs) offers new…

Computation and Language · Computer Science 2025-08-11 Pol G. Recasens , Yue Zhu , Chen Wang , Eun Kyung Lee , Olivier Tardieu , Alaa Youssef , Jordi Torres , Josep Ll. Berral

Edge computing enables real-time data processing closer to its source, thus improving the latency and performance of edge-enabled AI applications. However, traditional AI models often fall short when dealing with complex, dynamic tasks that…

Networking and Internet Architecture · Computer Science 2025-07-02 Haoxiang Luo , Yinqiu Liu , Ruichen Zhang , Jiacheng Wang , Gang Sun , Dusit Niyato , Hongfang Yu , Zehui Xiong , Xianbin Wang , Xuemin Shen

Large Language Models (LLMs) process every token through all layers of a transformer stack, causing wasted computation on simple queries and insufficient flexibility for harder ones that need deeper reasoning. Adaptive-depth methods can…

Computation and Language · Computer Science 2026-05-20 Ahmed Heakl , Martin Gubri , Salman Khan , Sangdoo Yun , Seong Joon Oh

The adoption of Large Language Models (LLMs) for code generation in data science offers substantial potential for enhancing tasks such as data manipulation, statistical analysis, and visualization. However, the effectiveness of these models…

Software Engineering · Computer Science 2024-11-20 Nathalia Nascimento , Everton Guimaraes , Sai Sanjna Chintakunta , Santhosh Anitha Boominathan

The scaling law for large language models (LLMs) depicts that the path towards machine intelligence necessitates training at large scale. Thus, companies continuously build large-scale GPU clusters, and launch training jobs that span over…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-22 Guoliang He , Youhe Jiang , Wencong Xiao , Kaihua Jiang , Shuguang Wang , Jun Wang , Zixian Du , Zhuo Jiang , Xinlei Zhang , Binhang Yuan , Eiko Yoneki

Large Language Models (LLMs) have emerged as powerful tools for natural language processing tasks, revolutionizing the field with their ability to understand and generate human-like text. In this paper, we present a comprehensive survey of…

Hardware Architecture · Computer Science 2024-09-06 Nikoletta Koilia , Christoforos Kachris

As the parameter size of Large Language Models (LLMs) continues to expand, there is an urgent need to address the scarcity of high-quality data. In response, existing research has attempted to make a breakthrough by incorporating Federated…

Machine Learning · Computer Science 2024-10-31 Chaochao Chen , Xiaohua Feng , Yuyuan Li , Lingjuan Lyu , Jun Zhou , Xiaolin Zheng , Jianwei Yin

Large Artificial Intelligence Models (LAMs) powered by massive datasets, extensive parameter scales, and extensive computational resources, leading to significant transformations across various industries. Yet, their practical deployment on…

Machine Learning · Computer Science 2026-04-22 Xianke Qiang , Hongda Liu , Xinran Zhang , Zheng Chang , Ying-Chang Liang

Robust workflow composition is critical for effective agent performance, yet progress in Large Language Model (LLM) planning and reasoning is hindered by a scarcity of scalable evaluation data. This work introduces NL2Flow, a fully…

Artificial Intelligence · Computer Science 2025-10-16 Jungkoo Kang

Modern GPU software stacks demand developers who can anticipate performance bottlenecks before ever launching a kernel; misjudging floating-point workloads upstream can derail tuning, scheduling, and even hardware procurement. Yet despite…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-05 Gregory Bolet , Giorgis Georgakoudis , Konstantinos Parasyris , Harshitha Menon , Niranjan Hasabnis , Kirk W. Cameron , Gal Oren

With the advent of large language models (LLMs), in both the open source and proprietary domains, attention is turning to how to exploit such artificial intelligence (AI) systems in assisting complex scientific tasks, such as material…

Human-Computer Interaction · Computer Science 2024-01-26 Yongtao Liu , Marti Checa , Rama K. Vasudevan

With the rapid development of large language models (LLMs) and the growing demand for personalized content, recommendation systems have become critical in enhancing user experience and driving engagement. Collaborative filtering algorithms,…

Artificial Intelligence · Computer Science 2024-12-30 Haowei Yang , Longfei Yun , Jinghan Cao , Qingyi Lu , Yuming Tu

Utilizing large language models (LLMs) for tool planning has emerged as a promising avenue for developing general AI systems, where LLMs automatically schedule external tools (e.g., vision models) to tackle complex tasks based on task…

Artificial Intelligence · Computer Science 2025-07-15 Duo Wu , Jinghe Wang , Yuan Meng , Yanning Zhang , Le Sun , Zhi Wang

Large language models (LLMs) are a special class of pretrained language models obtained by scaling model size, pretraining corpus and computation. LLMs, because of their large size and pretraining on large volumes of text data, exhibit…

Computation and Language · Computer Science 2023-10-20 Katikapalli Subramanyam Kalyan

The rapid adoption of artificial intelligence (AI) and large language models (LLMs) is transforming financial analytics by enabling natural language interfaces for reporting, decision support, and automated reasoning. However, limited…

Information Retrieval · Computer Science 2026-05-12 Jianan Liu , Jing Yang , Xianyou Li , Weiran Yan , Yichao Wu , Penghao Liang , Mengwei Yuan

Large Language Models (LLMs) represent a significant stride toward Artificial General Intelligence. As scaling laws underscore the potential of increasing model sizes, the academic community has intensified its investigations into LLMs with…

Due to the advantages of hypergraphs in modeling high-order relationships in complex systems, they have been applied to higher-order clustering, hypergraph neural networks and computer vision. These applications rely heavily on access to…

Social and Information Networks · Computer Science 2025-10-15 Bingqiao Gu , Jiale Zeng , Xingqin Qi , Dong Li

Droplet-based microfluidic devices have substantial promise as cost-effective alternatives to current assessment tools in biological research. Moreover, machine learning models that leverage tabular data, including input design parameters…

Artificial Intelligence · Computer Science 2024-11-12 Dinh-Nguyen Nguyen , Raymond Kai-Yu Tong , Ngoc-Duy Dinh