English
Related papers

Related papers: Research on Low-Latency Inference and Training Eff…

200 papers

Recent advancements in large language models (LLMs) have enabled their use as agents for planning complex tasks. Existing methods typically rely on a thought-action-observation (TAO) process to enhance LLM performance, but these approaches…

Artificial Intelligence · Computer Science 2025-04-18 Zheng Wang , Shu Xian Teo , Jun Jie Chew , Wei Shi

Presently with technology node scaling, an accurate prediction model at early design stages can significantly reduce the design cycle. Especially during logic synthesis, predicting cell congestion due to improper logic combination can…

Machine Learning · Computer Science 2021-11-12 Amur Ghose , Vincent Zhang , Yingxue Zhang , Dong Li , Wulong Liu , Mark Coates

Sequential recommender systems have become increasingly important in real-world applications that model user behavior sequences to predict their preferences. However, existing sequential recommendation methods predominantly rely on…

Information Retrieval · Computer Science 2025-06-05 Enze Liu , Bowen Zheng , Xiaolei Wang , Wayne Xin Zhao , Jinpeng Wang , Sheng Chen , Ji-Rong Wen

The demand for efficient processing of deep neural networks (DNNs) on embedded devices is a significant challenge limiting their deployment. Exploiting sparsity in the network's feature maps is one of the ways to reduce its inference…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Matteo Grimaldi , Darshan C. Ganji , Ivan Lazarevich , Sudhakar Sah

Generative AI (GenAI) is expected to play a pivotal role in enabling autonomous optimization in future wireless networks. Within the ORAN architecture, Large Language Models (LLMs) can be specialized to generate xApps and rApps by…

Artificial Intelligence · Computer Science 2025-08-21 Sarat Ahmad , Zeinab Nezami , Maryam Hafeez , Syed Ali Raza Zaidi

While Large Language Models (LLMs) have revolutionized artificial intelligence, fine-tuning LLMs is extraordinarily computationally expensive, preventing smaller businesses and research teams with limited GPU resources from engaging with…

Machine Learning · Computer Science 2025-08-26 Daniel Frees , Aditri Bhagirath , Moritz Bolling

Multi-access edge computing (MEC) is seen as a vital component of forthcoming 6G wireless networks, aiming to support emerging applications that demand high service reliability and low latency. However, ensuring the ultra-reliable and…

Systems and Control · Electrical Eng. & Systems 2024-05-08 Arian Ahmadi , Anders Høst-Madsen , Zixiang Xiong

Network performance modeling presents important challenges in modern computer networks due to increasing complexity, scale, and diverse traffic patterns. While traditional approaches like queuing theory and packet-level simulation have…

Networking and Internet Architecture · Computer Science 2024-12-10 Shourya Verma , Simran Kadadi , Swathi Jayaprakash , Arpan Kumar Mahapatra , Ishaan Jain

Accurate traffic prediction is essential for Intelligent Transportation Systems (ITS), yet current methods struggle with the inherent complexity and non-linearity of traffic dynamics, making it difficult to integrate spatial and temporal…

Machine Learning · Computer Science 2025-07-02 Ruiyuan Jiang , Dongyao Jia , Eng Gee Lim , Pengfei Fan , Yuli Zhang , Shangbo Wang

Deploying large language model (LLM) inference at scale requires jointly selecting base models, provisioning heterogeneous GPUs, configuring parallelism, and distributing workloads under tight latency, accuracy, and budget constraints.…

Machine Learning · Computer Science 2026-04-10 Jiaming Cheng , Duong Tung Nguyen

While Graph Neural Networks (GNNs) recently became powerful tools in graph learning tasks, considerable efforts have been spent on improving GNNs' structural encoding ability. A particular line of work proposed subgraph GNNs that use…

Machine Learning · Computer Science 2023-10-31 Lecheng Kong , Jiarui Feng , Hao Liu , Dacheng Tao , Yixin Chen , Muhan Zhang

Large language models (LLMs) have demonstrated significant potential in code generation tasks. However, there remains a performance gap between open-source and closed-source models. To address this gap, existing approaches typically…

Computation and Language · Computer Science 2025-04-18 Weijie Lv , Xuan Xia , Sheng-Jun Huang

Graph Neural Networks (GNNs) have shown great success in many applications such as recommendation systems, molecular property prediction, traffic prediction, etc. Recently, CPU-FPGA heterogeneous platforms have been used to accelerate many…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-23 Yi-Chien Lin , Bingyi Zhang , Viktor Prasanna

Large scale graph optimization problems arise in many fields. This paper presents an extensible, high performance framework (named OpenGraphGym-MG) that uses deep reinforcement learning and graph embedding to solve large graph optimization…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-25 Weijian Zheng , Dali Wang , Fengguang Song

Modern recommender systems aim to deeply understand users' complex preferences through their past interactions. While deep collaborative filtering approaches using Graph Neural Networks (GNNs) excel at capturing user-item relationships,…

Information Retrieval · Computer Science 2025-06-03 Yangqin Jiang , Yuhao Yang , Lianghao Xia , Da Luo , Kangyi Lin , Chao Huang

Large language model (LLM) training and finetuning are often bottlenecked by limited GPU memory. While existing projection-based optimization methods address this by projecting gradients into a lower-dimensional subspace to reduce optimizer…

Machine Learning · Computer Science 2024-06-26 Aashiq Muhamed , Oscar Li , David Woodruff , Mona Diab , Virginia Smith

Large language models (LLMs) commonly struggle with specialized or emerging topics which are rarely seen in the training corpus. Graph-based retrieval-augmented generation (GraphRAG) addresses this by structuring domain knowledge as a graph…

Information Retrieval · Computer Science 2025-06-05 Zhefan Wang , Huanjun Kong , Jie Ying , Wanli Ouyang , Nanqing Dong

This study proposes a hybrid deep-learning-metaheuristic framework with a bi-level architecture for road network design problems (NDPs). We train a graph neural network (GNN) to approximate the solution of the user equilibrium (UE) traffic…

Neural and Evolutionary Computing · Computer Science 2023-12-12 Bahman Madadi , Goncalo Homem de Almeida Correia

Graph Neural Networks (GNNs) are powerful deep learning models to generate node embeddings on graphs. When applying deep GNNs on large graphs, it is still challenging to perform training in an efficient and scalable way. We propose a novel…

Machine Learning · Computer Science 2020-10-08 Hanqing Zeng , Hongkuan Zhou , Ajitesh Srivastava , Rajgopal Kannan , Viktor Prasanna

In modern GPU inference, cache efficiency remains a major bottleneck, and heuristic policies such as \textsc{LRU} can perform far worse than the offline optimum. Existing learning-based caching systems improve hit rates mainly through…