中文
相关论文

相关论文: Large-Scale Network Utility Maximization via GPU-A…

200 篇论文

Fine-tuning pre-trained large language models (LLMs) with limited hardware presents challenges due to GPU memory constraints. Various distributed fine-tuning methods have been proposed to alleviate memory constraints on GPU. However,…

人工智能 · 计算机科学 2024-04-18 Taeho Kim , Yanming Wang , Vatshank Chaturvedi , Lokesh Gupta , Seyeon Kim , Yongin Kwon , Sangtae Ha

Efficient massive/ultra-massive multiple-input multiple-output (MIMO) detection algorithms with satisfactory performance and low complexity are critical to meet the high throughput and ultra-low latency requirements in 5G and beyond…

信息论 · 计算机科学 2023-01-10 Hengtao He , Alva Kosasih , Xianghao Yu , Jun Zhang , S. H. Song , Wibowo Hardjawana , Khaled B. Letaief

Energy system optimization models are increasing in scope and resolution, yielding large and challenging linear programs. For a long time, the standard way to address such problems has relied on shared-memory interior-point methods (IPM),…

High-performance GPU kernels are essential for efficient LLM deployment, yet optimizing them remains expertise-intensive. Recent LLM-based code generation makes automatic GPU operator generation promising, but operator optimization remains…

计算与语言 · 计算机科学 2026-05-29 Yining Zhang , Mingyang Yi , Chen Wang , Xuwen Xiang , Tianhe Jia , Zedong Dan , Chengqing Zong , Yue Wang

This work presents a GPU-accelerated solver for the unit commitment (UC) problem in large-scale power grids. The solver uses the Primal-Dual Hybrid Gradient (PDHG) algorithm to efficiently solve the relaxed linear subproblem, achieving…

最优化与控制 · 数学 2025-12-09 Hussein Sharadga , Javad Mohammadi

Energy consumption is a main issue of concern in wireless networks. Energy minimization increases the time that networks' nodes work properly without recharging or substituting batteries. Another criterion for network performance is data…

信息论 · 计算机科学 2010-12-13 Amirmahdi Khodaian , Babak H. Khalaj

We introduce FastGraph, a novel GPU-optimized k-nearest neighbor algorithm specifically designed to accelerate graph construction in low-dimensional spaces (2-10 dimensions), critical for high-performance graph neural networks. Our method…

分布式、并行与集群计算 · 计算机科学 2025-11-14 Aarush Agarwal , Raymond He , Jan Kieseler , Matteo Cremonesi , Shah Rukh Qasim

Large language model (LLM) serving is fundamentally limited by inefficient hardware utilization. Autoregressive (AR) decoding underutilizes GPUs due to its strictly sequential execution, while diffusion LLMs (DLLMs) improve throughput by…

分布式、并行与集群计算 · 计算机科学 2026-05-26 Chiyue Wei , Cong Guo , Bowen Duan , Junyao Zhang , Haoxuan Shan , Yifei Wang , Yangjie Zhou , Hai "Helen" Li , Danyang Zhuo , Yiran Chen

BATS (BATched Sparse) codes are a class of efficient random linear network coding variation that has been studied for multihop wireless networks mostly in scenarios of a single communication flow. Towards sophisticated multi-flow network…

信息论 · 计算机科学 2021-09-16 Yanyan Dong , Sheng Jin , Yanzuo Chen , Shenghao Yang , Hoover H. F. Yin

Branch-and-Bound (B&B) algorithms are time intensive tree-based exploration methods for solving to optimality combinatorial optimization problems. In this paper, we investigate the use of GPU computing as a major complementary way to speed…

分布式、并行与集群计算 · 计算机科学 2012-08-21 Melab Nouredine , Imen Chakroun , Mezmaz Mohand , Daniel Tuyttens

The network utility maximization problem (NUM) for multi-path is a problem which is non-strictly convex and non-separable. Using Jensen's inequality, we approximate the NUM to a strictly convex and separable problem which can be solved…

最优化与控制 · 数学 2013-01-07 Phuong L. Vo , Anh T. Le , Choong S. Hong

We consider the system-wide utility maximization problem in the downlink of a cell-free massive multiple-input multiple-output (MIMO) system whereby a very large number of access points (APs) simultaneously serve a group of users.…

信号处理 · 电气工程与系统科学 2020-09-22 Muhammad Farooq , Hien Quoc Ngo , Een-Kee Hong , Le-Nam Tran

We introduce a distributed resource allocation framework for the Quantum Internet that relies on feedback-based, fully decentralized coordination to serve multiple co-existing applications. We develop quantum network control algorithms…

Advanced channel reservation is emerging as an important feature of ultra high-speed networks requiring the transfer of large files. Applications include scientific data transfers and database backup. In this paper, we present two new,…

网络与互联网体系结构 · 计算机科学 2007-11-05 Reuven Cohen , Niloofar Fazlollahi , David Starobinski

Serverless Large Language Models (LLMs) have emerged as a cost-effective solution for deploying AI services by enabling a 'pay-as-you-go' pricing model through GPU resource sharing. However, cold-start latency, especially the model loading…

分布式、并行与集群计算 · 计算机科学 2025-12-02 Wenbin Zhu , Zhaoyan Shen , Zili Shao , Hongjun Dai , Feng Chen

In this paper we solve on GPUs massive problems with large amount of data, which are not appropriate for solution with the SIMD technology. For the given problem we consider a three-level parallelization. The multithreading of CPU is used…

分布式、并行与集群计算 · 计算机科学 2014-02-18 Natalya Litvinenko

In the acceleration of deep neural network training, the GPU has become the mainstream platform. GPUs face substantial challenges on GNNs, such as workload imbalance and memory access irregularities, leading to underutilized hardware.…

机器学习 · 计算机科学 2024-03-20 Hongwu Peng , Xi Xie , Kaustubh Shivdikar , MD Amit Hasan , Jiahui Zhao , Shaoyi Huang , Omer Khan , David Kaeli , Caiwen Ding

Gaussian and quadratic approximations of message passing algorithms on graphs have attracted considerable recent attention due to their computational simplicity, analytic tractability, and wide applicability in optimization and statistical…

信息论 · 计算机科学 2026-03-12 Sundeep Rangan , Alyson K. Fletcher , Vivek K. Goyal , Evan Byrne , Philip Schniter

We introduce a novel algorithm for solving network utility maximization (NUM) problems that arise in resource allocation schemes over networks with known safety-critical constraints, where the constraints form an arbitrary convex and…

最优化与控制 · 数学 2024-05-21 Berkay Turan , Spencer Hutchinson , Mahnoosh Alizadeh

Distributed network utility maximization (NUM) has received an increasing intensity of interest over the past few years. Distributed solutions (e.g., the primal-dual gradient method) have been intensively investigated under fading channels.…

信息论 · 计算机科学 2015-03-17 Junting Chen , Vincent K. N. Lau , Yong Cheng