English
Related papers

Related papers: Switching Efficiency: A Novel Framework for Dissec…

200 papers

This position paper challenges the "scaling fundamentalism" dominating AI research, where unbounded growth in model size and computation has led to unsustainable environmental impacts and widening resource inequality. We argue that LLM…

Machine Learning · Computer Science 2025-11-04 David McCoy , Yulun Wu , Zachary Butzin-Dozier

The popularization of cloud computing has raised concerns over the energy consumption that takes place in data centers. In addition to the energy consumed by servers, the energy consumed by large numbers of network devices emerges as a…

Networking and Internet Architecture · Computer Science 2016-11-17 Lin Wang , Fa Zhang , Jordi Arjona Aroca , Athanasios V. Vasilakos , Kai Zheng , Chenying Hou , Dan Li , Zhiyong Liu

The development of large-scale foundation models, particularly Large Language Models (LLMs), is constrained by significant computational and memory bottlenecks. These challenges elevate throughput optimization from a mere engineering task…

Machine Learning · Computer Science 2026-03-31 Mayank Jha

The performance of Machine Learning (ML) and Deep Learning (DL)-based Intrusion Detection and Prevention Systems (IDS/IPS) is critically dependent on the relevance and quality of the datasets used for training and evaluation. However,…

Cryptography and Security · Computer Science 2025-11-18 Adrita Rahman Tori , Khondokar Fida Hasan

Edge intelligence delivers low-latency inference, yet most edge analytics remain hard-coded and must be redeployed as conditions change. When data patterns shift or new questions arise, engineers often need to write new scripts and push…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-14 Chinmaya Kumar Dehury , Siddharth Singh Kushwaha , Qiyang Zhang , Alaa Saleh , Praveen Kumar Donta

Quantifying structural stress in transaction networks requires metrics that capture structural organization beyond transaction volume alone. In this work, we introduce the Inefficiency Metric, a deterministic indicator designed to…

Physics and Society · Physics 2026-05-27 Deep Nath , Paolo Tasca , Nikhil Vadgama , Marco Alberto Javarone

As AI inference scales to billions of queries and emerging reasoning and agentic workflows increase token demand, reliable estimates of per-query energy use are increasingly important for capacity planning, emissions accounting, and…

Distributed deep learning (DL) has become prevalent in recent years to reduce training time by leveraging multiple computing devices (e.g., GPUs/TPUs) due to larger models and datasets. However, system scalability is limited by…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-04 Zhenheng Tang , Shaohuai Shi , Wei Wang , Bo Li , Xiaowen Chu

The increasing complexity of neural networks poses a significant barrier to the deployment of distributed machine learning (ML) on resource-constrained devices, such as federated learning (FL). Split learning (SL) offers a promising…

Machine Learning · Computer Science 2025-08-19 Zehang Lin , Zheng Lin , Miao Yang , Jianhao Huang , Yuxin Zhang , Zihan Fang , Xia Du , Zhe Chen , Shunzhi Zhu , Wei Ni

On edge devices, data scarcity occurs as a common problem where transfer learning serves as a widely-suggested remedy. Nevertheless, transfer learning imposes a heavy computation burden to resource-constrained edge devices. Existing task…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-07 Zimu Zheng , Qiong Chen , Chuang Hu , Dan Wang , Fangming Liu

In this paper, we propose a resource allocation framework for federated learning (FL) in integrated sensing and communication (ISAC) systems, where we consider not only the reliability of model transfer through communication, but also the…

Signal Processing · Electrical Eng. & Systems 2026-05-13 Lai Jiang , Kaitao Meng , Murat Temiz , Christos Masouros

Recent advancements in large language models have demonstrated that extended inference through techniques can markedly improve performance, yet these gains come with increased computational costs and the propagation of inherent biases found…

Computation and Language · Computer Science 2025-02-10 Edward Hong Wang , Cynthia Xin Wen

The increase and rapid growth of data produced by scientific instruments, the Internet of Things (IoT), and social media is causing data transfer performance and resource consumption to garner much attention in the research community. The…

Performance · Computer Science 2023-09-29 Hasibul Jamil , Lavone Rodolph , Jacob Goldverg , Tevfik Kosar

Conventional latency metrics are formulated based on a broad definition of traditional monolithic services, and hence lack the capacity to address the complexities inherent in modern services and distributed computing paradigms.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-02 Theodoros Theodoropoulos , John Violos , Antonios Makris , Konstantinos Tserpes

Adjusting the latency, power, and accuracy of natural language understanding models is a desirable objective of an efficient architecture. This paper proposes an efficient Transformer architecture that adjusts the inference computational…

Computation and Language · Computer Science 2024-09-20 Sajjad Kachuee , Mohammad Sharifkhani

Large language models (LLMs) increasingly rely on long-context processing, but expanding context windows introduces substantial computational and financial costs. Existing context reduction approaches, including retrieval and memory…

Computation and Language · Computer Science 2026-05-25 Binqi Shen , Lier Jin , Hanyu Cai , Lan Hu , Yuting Xin

Large-scale artificial intelligence models are transforming industries and redefining human machine collaboration. However, continued scaling exposes critical limitations in hardware, including constraints on computation, bandwidth, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-21 Yuankai Fan , Qizhen Weng , Xuelong Li

In this work, a new energy-efficiency performance metric is proposed for MIMO (multiple input multiple output) point-to-point systems. In contrast with related works on energy-efficiency, this metric translates the effects of using finite…

Networking and Internet Architecture · Computer Science 2018-04-09 Vineeth S. Varma , Samson Lasaulce , Merouane Debbah , Salah Eddine Elayoubi

Rapid growth in AI-driven data center loads is creating significant challenges for transmission grid interconnection. This paper proposes robust and risk-aware frameworks to quantify transmission capacity as firm and flexible capacities. We…

Systems and Control · Electrical Eng. & Systems 2026-04-13 Shaoze Li , Bohang Fang , Cong Chen

The integration of wireless communications and Large Language Models (LLMs) is poised to unlock ubiquitous intelligent services, yet deploying them in wireless edge-device collaborative environments presents a critical trade-off between…

Information Theory · Computer Science 2025-08-18 Rui Bao , Nan Xue , Yaping Sun , Zhiyong Chen