English
Related papers

Related papers: FM-Delta: Fault Management Packet Compression

200 papers

Memory bandwidth is known to be a performance bottleneck for FPGA accelerators, especially when they deal with large multi-dimensional data-sets. A large body of work focuses on reducing of off-chip transfers, but few authors try to improve…

Hardware Architecture · Computer Science 2024-01-23 Corentin Ferry , Nicolas Derumigny , Steven Derrien , Sanjay Rajopadhye

In the era of advanced technologies, mobile devices are equipped with computing and sensing capabilities that gather excessive amounts of data. These amounts of data are suitable for training different learning models. Cooperated with…

Machine Learning · Computer Science 2020-04-07 Muhammad Asad , Ahmed Moustafa , Takayuki Ito , Muhammad Aslam

Federated learning has attracted growing interest as it preserves the clients' privacy. As a variant of federated learning, federated transfer learning utilizes the knowledge from similar tasks and thus has also been intensively studied.…

Machine Learning · Computer Science 2022-09-13 Feng Wang , M. Cenk Gursoy , Senem Velipasalar

Fine-tuning is the process of adapting the pre-trained large language models (LLMs) for downstream tasks. Due to substantial parameters, fine-tuning LLMs on mobile devices demands considerable memory resources, and suffers from high…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-17 Songge Zhang , Guoliang Cheng , Xinyu Huang , Zuguang Li , Wen Wu , Lingyang Song , Xuemin Shen

Phase change memory (PCM) has recently emerged as a promising technology to meet the fast growing demand for large capacity memory in computer systems, replacing DRAM that is impeded by physical limitations. Multi-level cell (MLC) PCM…

Hardware Architecture · Computer Science 2017-11-27 Seyed Mohammad Seyedzadeh , Alex K. Jones , Rami Melhem

Communication in poor network environment is always a difficult problem, since troubles such as bit errors and packet loss may often occur. It is generally believed that it is impossible to transmit data both accurately and efficiently in…

Networking and Internet Architecture · Computer Science 2022-10-20 Ye Tianyi

Currently, the dominating constraint in many high performance computing applications is data capacity and bandwidth, in both inter-node communications and even more-so in on-node data motion. A new approach to address this limitation is to…

Numerical Analysis · Mathematics 2024-07-03 Alyson Fox , James Diffenderfer , Jeffrey Hittinger , Geoffrey Sanders , Peter Lindstrom

Communication efficiency is of importance for wireless federated learning systems. In this paper, we propose a communication-efficient strategy for federated learning over multiple-input multiple-output (MIMO) multiple access channels…

Information Theory · Computer Science 2022-06-14 Yo-Seb Jeon , Mohammad Mohammadi Amiri , Namyoon Lee

As an enhanced version of massive machine-type communication in 5G, massive communication has emerged as one of the six usage scenarios anticipated for 6G, owing to its potential in industrial internet-of-things and smart metering. Driven…

Information Theory · Computer Science 2025-04-17 Yutao Chen , Wei Chen

In frequency-division duplex (FDD) massive multiple-input multiple-output (MIMO) systems, the growing number of base station antennas leads to prohibitive feedback overhead for downlink channel state information (CSI). To address this…

Signal Processing · Electrical Eng. & Systems 2024-06-25 Yifan Ma , Hengtao He , Shenghui Song , Jun Zhang , Khaled B. Letaief

Federated learning (FL) is a popular distributed machine learning (ML) paradigm, but is often limited by significant communication costs and edge device computation capabilities. Federated Split Learning (FSL) preserves the parallel model…

Information Theory · Computer Science 2023-02-14 Yujia Mu , Cong Shen

Transformers have emerged as the backbone of large language models (LLMs). However, generation remains inefficient due to the need to store in memory a cache of key-value representations for past tokens, whose size scales linearly with the…

Computation and Language · Computer Science 2024-07-24 Piotr Nawrot , Adrian Łańcucki , Marcin Chochowski , David Tarjan , Edoardo M. Ponti

Large Language Models (LLMs) need to adapt to the continuous changes in data, tasks, and user preferences. Due to their massive size and the high costs associated with training, LLMs are not suitable for frequent retraining. However,…

Computation and Language · Computer Science 2024-12-11 Dongfang Li , Zetian Sun , Xinshuo Hu , Baotian Hu , Min Zhang

This work proposes a mixed learning-based and optimization-based approach to the weighted-sum-rates beamforming problem in a multiple-input multiple-output (MIMO) wireless network. The conventional methods, i.e., the fractional programming…

Information Theory · Computer Science 2026-01-07 Jianhang Zhu , Tsung-Hui Chang , Liyao Xiang , Kaiming Shen

Designing encoding and decoding circuits to reliably send messages over many uses of a noisy channel is a central problem in communication theory. When studying the optimal transmission rates achievable with asymptotically vanishing error…

Quantum Physics · Physics 2024-11-07 Matthias Christandl , Alexander Müller-Hermes

The demand for deploying large language models(LLMs) on mobile devices continues to increase, driven by escalating data security concerns and cloud costs. However, network bandwidth and memory limitations pose challenges for deploying…

Machine Learning · Computer Science 2024-07-02 Songwei Liu , Chao Zeng , Lianqiang Li , Chenqian Yan , Lean Fu , Xing Mei , Fangmin Chen

In this paper, a communication-efficient multi-processor compressed sensing framework based on the approximate message passing algorithm is proposed. We perform lossy compression on the data being communicated between processors, resulting…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-01-19 Puxiao Han , Junan Zhu , Ruixin Niu , Dror Baron

A low-latency and energy-efficient tensor algebra accelerator design must optimize how data movement and operations are scheduled (i.e., mapped) in the accelerator architecture. A key mapping optimization is fusion, meaning holding data…

Hardware Architecture · Computer Science 2026-05-05 Tanner Andrulis , Michael Gilbert , Vivienne Sze , Joel S. Emer

Contention resolution addresses the problem of coordinating access to a shared channel. Time proceeds in slots, and a packet transmission can be made in any slot. A packet is successfully sent if no other packet is also transmitted during…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-28 Michael A. Bender , Jeremy T. Fineman , Seth Gilbert , John Kuszmaul , Maxwell Young

Quantum data locking is a quantum communication primitive that allows the use of a short secret key to encrypt a much longer message. It guarantees information-theoretical security against an adversary with limited quantum memory. Here we…

Quantum Physics · Physics 2021-06-02 Zixin Huang , Pieter Kok , Cosmo Lupo