English
Related papers

Related papers: DEER: Deep Runahead for Instruction Prefetching on…

200 papers

Far-memory systems, where applications store less-active data in more energy-efficient memory media, are increasingly adopted by data centers. However, applications are bottlenecked by on-demand data fetching from far- to local-memory. We…

Operating Systems · Computer Science 2025-10-07 Yutong Huang , Zhiyuan Guo , Yiying Zhang

Large-scale networked services rely on deep soft-ware stacks and microservice orchestration, which increase instruction footprints and create frontend stalls that inflate tail latency and energy. We revisit instruction prefetching for these…

Machine Learning · Computer Science 2025-11-26 Zerui Bao , Di Zhu , Liu Jiang , Shiqi Sheng , Ziwei Wang , Haoyun Zhang

Efficiency, as a critical practical challenge for LLM-driven agentic and reasoning systems, is increasingly constrained by the inherent latency of autoregressive (AR) decoding. Speculative decoding mitigates this cost through a draft-verify…

Machine Learning · Computer Science 2025-12-18 Zicong Cheng , Guo-Wei Yang , Jia Li , Zhijie Deng , Meng-Hao Guo , Shi-Min Hu

The development of large-scale foundation models, particularly Large Language Models (LLMs), is constrained by significant computational and memory bottlenecks. These challenges elevate throughput optimization from a mere engineering task…

Machine Learning · Computer Science 2026-03-31 Mayank Jha

We present procedures that exploit mobility prediction and prefetching to enhance offloading of traffic from mobile networks to WiFi hotspots, for both delay tolerant and delay sensitive traffic. We evaluate the procedures in terms of the…

Networking and Internet Architecture · Computer Science 2013-06-14 Vasilios A. Siris , Dimitrios Kalyvas

Recent breakthroughs in deep learning and artificial intelligence technologies have enabled numerous mobile applications. While traditional computation paradigms rely on mobile sensing and cloud computing, deep learning implemented on…

Machine Learning · Computer Science 2019-04-22 Yunbin Deng

Although benefits from caching in US HEP are well-known, current caching strategies are not adaptive i.e they do not adapt to changing cache access patterns. Newer developments such as the High-Luminosity - Large Hadron Collider (HL-LHC),…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-24 Venkat Sai Suman Lamba Karanam , Sarat Sasank Barla , Byrav Ramamurthy , Derek Weitzel

Instruction tuning has emerged as a critical paradigm for improving the capabilities and alignment of large language models (LLMs). However, existing iterative model-aware data selection methods incur significant computational overhead, as…

Machine Learning · Computer Science 2025-05-13 Xiaotian Lin , Yanlin Qi , Yizhang Zhu , Themis Palpanas , Chengliang Chai , Nan Tang , Yuyu Luo

The rapid growth of deep learning models has increased the demand for efficient distributed training strategies. Fully sharded approaches like ZeRO-3 and FSDP partition model parameters across GPUs and apply optimizations such as…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-20 Masahiro Tanaka , Du Li , Umesh Chand , Ali Zafar , Haiying Shen , Olatunji Ruwase

Data prefetching, i.e., the act of predicting application's future memory accesses and fetching those that are not in the on-chip caches, is a well-known and widely-used approach to hide the long latency of memory accesses. The fruitfulness…

Hardware Architecture · Computer Science 2020-09-03 Mohammad Bakhshalipour , Mehran Shakerinava , Fatemeh Golshan , Ali Ansari , Pejman Lotfi-Karman , Hamid Sarbazi-Azad

Constant envelope (CE) precoding design is of great interest for massive multiuser multi-input multi-output systems because it can significantly reduce hardware cost and power consumption. However, existing CE precoding algorithms are…

Signal Processing · Electrical Eng. & Systems 2020-06-30 Yunfeng He , Hengtao , He , Chao-Kai Wen , Shi Jin

Recent information retrieval (IR) models are pre-trained and instruction-tuned on massive datasets and tasks, enabling them to perform well on a wide range of tasks and potentially generalize to unseen tasks with instructions. However,…

Information Retrieval · Computer Science 2024-10-15 Weiwei Sun , Zhengliang Shi , Jiulong Wu , Lingyong Yan , Xinyu Ma , Yiding Liu , Min Cao , Dawei Yin , Zhaochun Ren

Pretraining on large-scale datasets can boost the performance of object detectors while the annotated datasets for object detection are hard to scale up due to the high labor cost. What we possess are numerous isolated filed-specific…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Jing Hao , Song Chen , Xiaodi Wang , Shumin Han

Mobile edge computing (MEC) is essential for next-generation mobile network applications that prioritize various performance metrics, including delays and energy consumption. However, conventional single-objective scheduling solutions…

Networking and Internet Architecture · Computer Science 2023-07-28 Ning Yang , Junrui Wen , Meng Zhang , Ming Tang

Many hardware structures in today's high-performance out-of-order processors do not scale in an efficient way. To address this, different solutions have been proposed that build execution schedules in an energy-efficient manner. Issue time…

Hardware Architecture · Computer Science 2021-09-08 Andreas Diavastos , Trevor E. Carlson

Modern deployments of Large Language Models (LLMs) increasingly require serving multiple models with diverse architectures, sizes, and specialization on shared, heterogeneous hardware. This setting introduces new challenges for resource…

Artificial Intelligence · Computer Science 2026-05-20 Mert Yildiz , Pietro Spadaccino , Alexey Rolich , Francesca Cuomo , Andrea Baiocchi

Data prefetching--loading data into the cache before it is requested--is essential for reducing I/O overhead and improving database performance. While traditional prefetchers focus on sequential patterns, recent learning-based approaches,…

Databases · Computer Science 2025-10-14 Farzaneh Zirak , Farhana Choudhury , Renata Borovica-Gajic

Modern Language Models (LMs) are capable of following long and complex instructions that enable a large and diverse set of user requests. While Information Retrieval (IR) models use these LMs as the backbone of their architectures,…

Information Retrieval · Computer Science 2024-05-08 Orion Weller , Benjamin Chang , Sean MacAvaney , Kyle Lo , Arman Cohan , Benjamin Van Durme , Dawn Lawrie , Luca Soldaini

Due to their on-body and ubiquitous nature, wearables can generate a wide range of unique sensor data creating countless opportunities for deep learning tasks. We propose DeepWear, a deep learning (DL) framework for wearable devices to…

Computers and Society · Computer Science 2021-01-14 Mengwei Xu , Feng Qian , Mengze Zhu , Feifan Huang , Saumay Pushp , Xuanzhe Liu

Owing to the resource-constrained feature of Internet of Things (IoT) devices, offloading tasks from IoT devices to the nearby mobile edge computing (MEC) servers can not only save the energy of IoT devices but also reduce the response time…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-01 Zeinab Akhavan , Mona Esmaeili , Babak Badnava , Mohammad Yousefi , Xiang Sun , Michael Devetsikiotis , Payman Zarkesh-Ha