English
Related papers

Related papers: Hardware Implementation of Task-based Quantization…

200 papers

We consider the problem of recovering a high-dimensional structured signal from independent Gaussian linear measurements each of which is quantized to $b$ bits. Our interest is in linear approaches to signal recovery, where "linear" means…

Information Theory · Computer Science 2016-07-12 Martin Slawski , Ping Li

In Large Language Models (LLMs), the number of parameters has grown exponentially in the past few years, e.g., from 1.5 billion parameters in GPT-2 to 175 billion in GPT-3 to possibly more than trillion in higher versions. This raises a…

Computation and Language · Computer Science 2026-01-06 Mahmoud Elgenedy

Characterizing complex quantum systems is a vital task in quantum information science. Quantum tomography, the standard tool used for this purpose, uses a well-designed measurement record to reconstruct quantum states and processes. It is,…

Quantum Physics · Physics 2015-12-10 Amir Kalev , Robert L. Kosut , Ivan H. Deutsch

Quantum computers may outperform classical computers on machine learning tasks. In recent years, a variety of quantum algorithms promising unparalleled potential to enhance, speed up, or innovate machine learning have been proposed. Yet,…

Neural network quantization is widely used to reduce model inference complexity in real-world deployments. However, traditional integer quantization suffers from accuracy degradation when adapting to various dynamic ranges. Recent research…

Performance · Computer Science 2023-10-30 Zhuoyi Zhang , Yunchen Zhang , Gonglei Shi , Yu Shen , Ruihao Gong , Xiaoxu Xia , Qi Zhang , Lewei Lu , Xianglong Liu

Imaging sensors digitize incoming scene light at a dynamic range of 10--12 bits (i.e., 1024--4096 tonal values). The sensor image is then processed onboard the camera and finally quantized to only 8 bits (i.e., 256 tonal values) to conform…

Image and Video Processing · Electrical Eng. & Systems 2021-12-23 Abhijith Punnappurath , Michael S. Brown

Quantized Neural Networks (QNNs) use low bit-width fixed-point numbers for representing weight parameters and activations, and are often used in real-world applications due to their saving of computation resources and reproducibility of…

Machine Learning · Computer Science 2020-09-01 Dachao Lin , Peiqin Sun , Guangzeng Xie , Shuchang Zhou , Zhihua Zhang

Quantum computation holds the promise of solving computational problems which are believed to be classically intractable. However, in practice, quantum devices are still limited by their relatively short coherence times and imperfect…

Quantum Physics · Physics 2023-12-22 Sagar Silva Pratapsi , Diogo Cruz

In this paper we present a novel approach to emulating a universal quantum computer with a classical system, one that uses a signal of bounded duration and amplitude to represent an arbitrary quantum state. The signal may be of any modality…

Quantum Physics · Physics 2021-04-27 Brian R. La Cour , Granville E. Ott

We study Sigma-Delta quantization methods coupled with appropriate reconstruction algorithms for digitizing randomly sampled low-rank matrices. We show that the reconstruction error associated with our methods decays polynomially with the…

Information Theory · Computer Science 2018-04-18 Eric Lybrand , Rayan Saab

In recent years, model quantization for face recognition has gained prominence. Traditionally, compressing models involved vast datasets like the 5.8 million-image MS1M dataset as well as extensive training times, raising the question of…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 William Gazali , Jocelyn Michelle Kho , Joshua Santoso , Williem

Model compression has gained a lot of attention due to its ability to reduce hardware resource requirements significantly while maintaining accuracy of DNNs. Model compression is especially useful for memory-intensive recurrent neural…

Machine Learning · Computer Science 2018-05-30 Dongsoo Lee , Byeongwook Kim

Recent advancements in large language models (LLMs) have shown their remarkable capacities in many NLP tasks. However, their substantial size often presents challenges for deployment. This necessitates efficient techniques for model…

Computation and Language · Computer Science 2026-05-20 Robin Baki Davidsson , Pierre Nugues

Deep learning-based autoencoders have been employed to compress and reconstruct channel state information (CSI) in frequency-division duplex systems. Practical implementations require judicious quantization of encoder outputs for digital…

Signal Processing · Electrical Eng. & Systems 2025-03-12 Manru Yin , Shengqian Han , Chenyang Yang

Due to the complexity of the space of quantum many-body states the computation of expectation values by statistical sampling is, in general, a hard task. Neural network representations of such quantum states which can be physically…

Quantum Physics · Physics 2019-12-04 Stefanie Czischek , Jan M. Pawlowski , Thomas Gasenzer , Martin Gärttner

We study the problem of approximately recovering signals on a manifold from one-bit linear measurements drawn from either a Gaussian ensemble, partial circulant ensemble, or bounded orthonormal ensemble and quantized using Sigma-Delta or…

Information Theory · Computer Science 2019-04-25 Mark Iwen , Eric Lybrand , Aaron Nelson , Rayan Saab

We consider the problem of timely tracking of a Wiener process via an energy-conserving sensor by utilizing a single bit quantization strategy under periodic sampling. Contrary to conventional single bit quantizers which only utilize the…

Information Theory · Computer Science 2025-05-05 Ismail Cosandal , Sahan Liyanaarachchi , Sennur Ulukus

One-bit quantization with time-varying sampling thresholds has recently found significant utilization potential in statistical signal processing applications due to its relatively low power consumption and low implementation cost. In…

Information Theory · Computer Science 2023-03-20 Arian Eamaz , Farhang Yeganegi , Deanna Needell , Mojtaba Soltanalian

Despite the outstanding performance of transformers in both language and vision tasks, the expanding computation and model size have increased the demand for efficient deployment. To address the heavy computation and parameter drawbacks,…

Machine Learning · Computer Science 2024-10-15 Xijie Huang , Zhiqiang Shen , Pingcheng Dong , Kwang-Ting Cheng

Quantum memory for flying optical qubits is a key enabler for a wide range of applications in quantum information science and technology. A critical figure of merit is the overall storage-and-retrieval efficiency. So far, despite the recent…

Quantum Physics · Physics 2018-02-02 P. Vernaz-Gris , K. Huang , M. Cao , A. S. Sheremet , J. Laurat