English
Related papers

Related papers: Design and Analysis of Hardware-limited Non-unifor…

200 papers

Transformer-based architectures have become the de-facto standard models for a wide range of Natural Language Processing tasks. However, their memory footprint and high latency are prohibitive for efficient deployment and inference on…

Machine Learning · Computer Science 2021-09-28 Yelysei Bondarenko , Markus Nagel , Tijmen Blankevoort

Transformer-based large language models (LLMs) have achieved remarkable success as model sizes continue to grow, yet their deployment remains challenging due to significant computational and memory demands. Quantization has emerged as a…

Machine Learning · Computer Science 2024-11-26 Yu Zhang , Mingzi Wang , Lancheng Zou , Wulong Liu , Hui-Ling Zhen , Mingxuan Yuan , Bei Yu

Quantization is essential for reducing the computational cost and memory usage of deep neural networks, enabling efficient inference on low-precision hardware. Despite the growing adoption of uniform and floating-point quantization schemes,…

Machine Learning · Statistics 2026-05-19 Mehmet Aktukmak , Daniel Huang , Ke Ding

The measurement-based architecture is a paradigm of quantum computing, relying on the entanglement of a cluster of qubits and the measurements of a subset of it, conditioning the state of the unmeasured output qubits. While methods to map…

Quantum Physics · Physics 2024-11-20 Sebastiano Corli , Enrico Prati

One-bit quantization with time-varying sampling thresholds has recently found significant utilization potential in statistical signal processing applications due to its relatively low power consumption and low implementation cost. In…

Information Theory · Computer Science 2023-03-20 Arian Eamaz , Farhang Yeganegi , Deanna Needell , Mojtaba Soltanalian

There have been a number of studies on sparse signal recovery from one-bit quantized measurements. Nevertheless, little attention has been paid to the choice of the quantization thresholds and its impact on the signal recovery performance.…

Information Theory · Computer Science 2013-05-21 Jun Fang , Yanning Shen , Hongbin Li

Many LLM applications require only narrow capabilities, yet standard post-training quantization (PTQ) methods allocate precision without considering the target task. This can waste bits on layers that are less relevant to the task signal…

Computation and Language · Computer Science 2026-05-19 Amit LeVi , Raz Lapid , Rom Himelstein , Chaim Baskin , Ravid Shwartz Ziv , Avi Mendelson

As large language models (LLMs) grow in size and deployment scale, quantization has become an essential technique for reducing memory footprint and improving inference efficiency. However, existing quantization toolkits often lack…

Machine Learning · Computer Science 2025-12-01 Dong Liu , Yanxuan Yu

Graph signals arise in various applications, ranging from sensor networks to social media data. The high-dimensional nature of these signals implies that they often need to be compressed in order to be stored and transmitted. The common…

Signal Processing · Electrical Eng. & Systems 2021-10-26 Pei Li , Nir Shlezinger , Haiyang Zhang , Baoyun Wang , Yonina C. Eldar

Measurement-device-independent (MDI) quantum information processing tasks are important subroutines in quantum information science because they are robust against any type of measurement imperfections. In this work, we propose a framework…

Quantum Physics · Physics 2024-10-28 Chenxu Li , Mingze Xu , Hao Dai , Xiongfeng Ma

Current quantum annealing (QA) hardware suffers from practical limitations such as finite temperature, sparse connectivity, small qubit numbers, and control error. We propose new algorithms for mapping boolean constraint satisfaction…

Quantum Physics · Physics 2016-03-11 Zhengbing Bian , Fabian Chudak , Robert Israel , Brad Lackey , William G. Macready , Aidan Roy

Mixed-precision quantization can potentially achieve the optimal tradeoff between performance and compression rate of deep neural networks, and thus, have been widely investigated. However, it lacks a systematic method to determine the…

Machine Learning · Computer Science 2021-02-23 Huanrui Yang , Lin Duan , Yiran Chen , Hai Li

This paper studies a downlink multi-user multiple-input multiple-output (MU-MIMO) system, where the precoding matrix is computed at a baseband unit (BBU) and then transmitted to the remote antenna array over a limited-capacity digital…

Signal Processing · Electrical Eng. & Systems 2026-03-02 Yasaman Khorsandmanesh , Alva Kosasih , Emil Björnson , Joakim Jaldén

Randomized benchmarking is a useful scheme for evaluation the average fidelity of a noisy quantum circuit. However, it is insensitive to the unitary error. Here, we propose a method of randomized benchmarking in which a unitary t-design is…

Quantum Physics · Physics 2017-12-13 Linxi Zhang , Chuanghua Zhu , Changxing Pei

Quantum unitary synthesis addresses the problem of translating abstract quantum algorithms into sequences of hardware-executable quantum gates. Solving this task exactly is infeasible in general due to the exponential growth of the…

Quantum Physics · Physics 2026-02-19 Lukas Theißinger , Thore Gerlach , David Berghaus , Christian Bauckhage

We present BayesQ, an uncertainty-guided post-training quantization framework that is the first to optimize quantization under the posterior expected loss. BayesQ fits a lightweight Gaussian posterior over weights (diagonal Laplace by…

Machine Learning · Computer Science 2025-11-13 Ismail Lamaakal , Chaymae Yahyati , Yassine Maleh , Khalid El Makkaoui , Ibrahim Ouahbi

Quantization is critical for efficiently deploying large language models (LLMs). Yet conventional methods remain hardware-agnostic, limited to bit-width constraints, and do not account for intrinsic circuit characteristics such as the…

Hardware Architecture · Computer Science 2025-11-18 Rohan Juneja , Shivam Aggarwal , Safeen Huda , Tulika Mitra , Li-Shiuan Peh

It has been well known that the achievable rate of multiuser multiple-input multiple-output systems with limited feedback is severely degraded by quantization errors when the number of feedback bits is not sufficient. To overcome such a…

Information Theory · Computer Science 2024-07-09 Wentao Zhou , Di Zhang , Merouane Debbah , Inkyu Lee

In this paper we study multi-task oriented communication system via studying analog encoding method for multiple estimation tasks. The basic idea is to utilize the correlation among interested information required by different tasks and the…

Information Theory · Computer Science 2023-05-18 Chenmin Sha , Shidong Zhou

Obtaining digital representations of multivariate continuous-time (CT) signals is a challenge encountered in many signal processing systems. In practice, these signals are often acquired to extract some underlying information, i.e., for a…

Information Theory · Computer Science 2021-10-18 Peter Neuhaus , Nir Shlezinger , Meik Dörpinghaus , Yonina C. Eldar , Gerhard Fettweis