English
Related papers

Related papers: A Scaling Law for Bandwidth Under Quantization

200 papers

The underwater acoustic channel is characterized by a path loss that depends not only on the transmission distance, but also on the signal frequency. Signals transmitted from one user to another over a distance $l$ are subject to a power…

Information Theory · Computer Science 2009-03-26 Daniel E. Lucani , Muriel Médard , Milica Stojanovic

Noise-shaping quantization techniques are widely used for converting bandlimited signals from the analog to the digital domain. They work by ``shaping" the quantization noise so that it falls close to the reconstruction operator's null…

Information Theory · Computer Science 2026-05-21 Rohan Joy , Felix Krahmer , Alessandro Lupoli , Radha Ramakrishnan

Large language models (LLMs) demand substantial computational and memory resources, creating deployment challenges. Quantization-aware training (QAT) addresses these challenges by reducing model precision while maintaining performance.…

Machine Learning · Computer Science 2025-05-21 Mengzhao Chen , Chaoyi Zhang , Jing Liu , Yutao Zeng , Zeyue Xue , Zhiheng Liu , Yunshui Li , Jin Ma , Jie Huang , Xun Zhou , Ping Luo

A spectrum- and energy-efficient system is essential for millimeter wave communication systems that require large antenna arrays with power-demanding ADCs. We propose an ADC bit allocation (BA) algorithm that solves a minimum mean squared…

Information Theory · Computer Science 2017-12-07 Jinseok Choi , Junmo Sung , Brian L. Evans , Alan Gatherer

We aim at investigating the impact of low resolution digital-to-analog converters (DACs) at the transmitter and low resolution analog-to-digital converters (ADCs) at the receiver on the required bandwidth and the required signalto- noise…

Information Theory · Computer Science 2017-06-28 Hela Jedda , Amine Mezghani , Josef A. Nossek

We obtain the functional defining the price and quality of sample readings of the generalized velocities. It is shown that the optimal sampling frequency, in the sense of minimizing the functional quality and price depends on the sampling…

Optimization and Control · Mathematics 2012-01-18 V. N. Tibabishev

The estimation of the parameters of a dynamic signal, such as a sine wave, based on quantized data is customarily performed using the least-square estimator (LSE), such as the sine fit. However, the characteristics of the experiments and…

Signal Processing · Electrical Eng. & Systems 2018-04-30 Paolo Carbone , Johan Schuokens , Antonio Moschitta

We consider general multi-antenna fading channels with coarsely quantized outputs, where the channel is unknown to the transmitter and receiver. This analysis is of interest in the context of sensor network communication where low power and…

Information Theory · Computer Science 2010-10-28 Amine Mezghani , Josef A. Nossek

Due to the heavy reliance of millimeter-wave (mmWave) wireless systems on directional links, beamforming (BF) with high-dimensional arrays is essential for cellular systems in these frequencies. How to perform the array processing in a…

Information Theory · Computer Science 2019-01-28 Sourjya Dutta , C. Nicolas Barati , Aditya Dhananjay , David A. Ramirez , James F. Buckwalter , Sundeep Rangan

This paper addresses the optimal design of limited-feedback downlink multi-user spatial multiplexing systems. A multiple-antenna base-station is assumed to serve multiple single-antenna users, who quantize and feed back their channel state…

Information Theory · Computer Science 2011-12-30 Behrouz Khoshnevis , Wei Yu

This paper introduces an innovative error feedback framework designed to mitigate quantization noise in distributed graph filtering, where communications are constrained to quantized messages. It comes from error spectrum shaping techniques…

Machine Learning · Computer Science 2026-05-12 Xue Xian Zheng , Weihang Liu , Xin Lou , Stefan Vlaski , Tareq Al-Naffouri

This paper considers least-square based estimation of the amplitude and square amplitude of a quantized sine wave, done by considering random initial record phase. Using amplitude- and frequency-domain modeling techniques, it is shown that…

Signal Processing · Electrical Eng. & Systems 2018-04-23 Paolo Carbone , Johan Schoukens

The use of low-bit quantization has emerged as an indispensable technique for enabling the efficient training of large-scale models. Despite its widespread empirical success, a rigorous theoretical understanding of its impact on learning…

Machine Learning · Statistics 2026-02-17 Dechen Zhang , Junwei Su , Difan Zou

In \cite{Chandar2008}, Chandar et al studied a problem of sequential frame synchronization for a frame transmitted randomly and uniformly among $A$ slots. For a discrete memory-less channel (DMC), they showed that the frame length $N$ must…

Information Theory · Computer Science 2015-06-24 R. M. Sundaram , Devendra Jalihal , Venkatesh Ramaiyan

In machine learning, the scaling law describes how the model performance improves with the model and data size scaling up. From a learning theory perspective, this class of results establishes upper and lower generalization bounds for a…

Machine Learning · Computer Science 2025-02-14 Shihong Ding , Haihan Zhang , Hanzhen Zhao , Cong Fang

This paper focuses on channel estimation for mmWave MIMO systems with 1-bit spatial sigma-delta analog-to-digital converters (ADCs). The channel estimation performance with 1-bit spatial sigma-delta ADCs depends on the quantization noise…

Signal Processing · Electrical Eng. & Systems 2020-10-26 R. S. Prasobh Sankar , Sundeep Prabhakar Chepuri

Analog-to-digital conversion (ADC) is a key bottleneck in scaling DSP-centric receiver architectures to multiGigabit/s speeds. Recent information-theoretic results, obtained under ideal channel conditions (perfect synchronization, no…

Information Theory · Computer Science 2011-12-21 Jaspreet Singh , Upamanyu Madhow

Noise in quantum computing is countered with quantum error correction. Achieving optimal performance will require tailoring codes and decoding algorithms to account for features of realistic noise, such as the common situation where the…

Quantum Physics · Physics 2020-04-02 David K. Tuckett , Stephen D. Bartlett , Steven T. Flammia , Benjamin J. Brown

We study channel capacity when a one-bit quantizer is employed at the output of the discrete-time average-power-limited Rayleigh-fading channel. We focus on the low signal-to-noise ratio regime, where communication at very low spectral…

Information Theory · Computer Science 2011-12-23 Tobias Koch , Amos Lapidoth

In this work, the problem of signal parameter estimation from measurements acquired by a low-complexity analog-to-digital converter (ADC) with $1$-bit output resolution and an unknown quantization threshold is considered. Single-comparator…

Information Theory · Computer Science 2018-05-09 Manuel S. Stein , Shahar Bar , Josef A. Nossek , Joseph Tabrikian