English
Related papers

Related papers: Exploiting Non-uniform Quantization for Enhanced I…

200 papers

Visible light communications (VLC) are motivated by the radio-frequency (RF) spectrum crunch and fast-growing solid-state lighting technology. VLC relies on white light emitting diodes (LEDs) to provide communication and illumination…

Information Theory · Computer Science 2014-06-25 Zhenhua Yu , Arthur J. Redfern , G. Tong Zhou

The stability and convergence of an Iterative Learning Controller (ILC) may be assessed either by directly iterating the equations for a variety of inputs, or by finding the eigenvalues of the iterated system, or by forming the Z-transform…

Systems and Control · Electrical Eng. & Systems 2022-11-22 Shane Rupert Koscielniak

Vector Symbolic Architecture (VSA) is emerging in machine learning due to its efficiency, but they are hindered by issues of hyperdimensionality and accuracy. As a promising mitigation, the Low-Dimensional Computing (LDC) method…

Machine Learning · Computer Science 2025-03-18 Shijin Duan , Yejia Liu , Gaowen Liu , Ramana Rao Kompella , Shaolei Ren , Xiaolin Xu

Large pre-trained sequence models, such as transformer-based architectures, have been recently shown to have the capacity to carry out in-context learning (ICL). In ICL, a decision on a new input is made via a direct mapping of the input…

Information Theory · Computer Science 2024-01-23 Matteo Zecchin , Kai Yu , Osvaldo Simeone

Transformer-based models have gained widespread popularity in both the computer vision (CV) and natural language processing (NLP) fields. However, significant challenges arise during post-training linear quantization, leading to noticeable…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Jiun-Man Chen , Yu-Hsuan Chao , Yu-Jie Wang , Ming-Der Shieh , Chih-Chung Hsu , Wei-Fen Lin

In the Internet-of-Things (IoT) era, efficient functionality integration is essential to address the growing demands of communication, computation, and sensing. Signal-level integrated sensing, computing, and communication (Sig-ISCC) is…

Information Theory · Computer Science 2026-04-30 Paul Zheng , Yao Zhu , Xiaopeng Yuan , Yulin Hu , Anke Schmeink

We propose to improve in-context learning (ICL) by optimizing the continuous embeddings of a fixed few-shot prompt at test time. The key observation is that the log-probabilities a model assigns to its demonstrated…

Computation and Language · Computer Science 2026-05-25 Baturay Saglam , Dionysis Kalogerias

Label noise has been broadly observed in real-world datasets. To mitigate the negative impact of overfitting to label noise for deep models, effective strategies (\textit{e.g.}, re-weighting, or loss rectification) have been broadly applied…

Machine Learning · Computer Science 2026-03-19 Haoliang Sun , Qi Wei , Lei Feng , Yupeng Hu , Fan Liu , Hehe Fan , Yilong Yin

Decentralized large language model (LLM) inference networks can pool heterogeneous compute to scale serving, but they require lightweight and incentive-compatible mechanisms to assess output quality. Prior work introduced cost-aware Proof…

Machine Learning · Computer Science 2026-03-05 Arther Tian , Alex Ding , Frank Chen , Simon Wu , Aaron Chan

In the context of communication-centric integrated sensing and communication (ISAC), the orthogonal frequency division multiplexing (OFDM) waveform was proven to be optimal in minimizing ranging sidelobes when random signaling is used. A…

Signal Processing · Electrical Eng. & Systems 2025-05-06 Karim A. Said , Ibraheem Alturki , Husheng Li , Elizabeth Bentley , Lingjia Liu

The label distribution skew induced data heterogeniety has been shown to be a significant obstacle that limits the model performance in federated learning, which is particularly developed for collaborative model training over decentralized…

Machine Learning · Computer Science 2023-03-16 Jian Xu , Meiling Yang , Wenbo Ding , Shao-Lun Huang

The deep image prior showed that a randomly initialized network with a suitable architecture can be trained to solve inverse imaging problems by simply optimizing it's parameters to reconstruct a single degraded image. However, it suffers…

Image and Video Processing · Electrical Eng. & Systems 2022-01-03 Zenglin Shi , Pascal Mettes , Subhransu Maji , Cees G. M. Snoek

Finding optimal message quantization is a key requirement for low complexity belief propagation (BP) decoding. To this end, we propose a floating-point surrogate model that imitates quantization effects as additions of uniform noise, whose…

Information Theory · Computer Science 2022-08-11 Marvin Geiselhart , Ahmed Elkelesh , Jannis Clausius , Fei Liang , Wen Xu , Jing Liang , Stephan ten Brink

Zero-delay transmission of a Gaussian source over an additive white Gaussian noise (AWGN) channel is considered in the presence of an additive Gaussian interference signal. The mean squared error (MSE) distortion is minimized under an…

Information Theory · Computer Science 2016-04-15 Morteza Varasteh , Deniz Gündüz , Ertem Tuncel

Class Incremental Learning (CIL) aims to sequentially acquire knowledge of new classes without forgetting previously learned ones. Despite recent progress, current CIL methods still exhibit significant performance gaps compared to their…

Machine Learning · Computer Science 2025-09-29 Zihuan Qiu , Yi Xu , Fanman Meng , Runtong Zhang , Linfeng Xu , Qingbo Wu , Hongliang Li

In this paper, we introduce a new channel model we term the q-ary multi-bit channel (QMBC). This channel models a memory device, where q-ary symbols (q=2^s) are stored in the form of current/voltage levels. The symbols are read in a…

Information Theory · Computer Science 2017-06-29 Rami Cohen , Netanel Raviv , Yuval Cassuto

Deep convolutional neural networks often perform poorly when faced with datasets that suffer from quantity imbalances and classification difficulties. Despite advances in the field, existing two-stage approaches still exhibit dataset bias…

Machine Learning · Computer Science 2023-03-16 Liang Xu , Yi Cheng , Fan Zhang , Bingxuan Wu , Pengfei Shao , Peng Liu , Shuwei Shen , Peng Yao , Ronald X. Xu

Optimal and suboptimal decentralized estimators in wireless sensor networks (WSNs) over orthogonal multiple-access fading channels are studied in this paper. Considering multiple-bit quantization before digital transmission, we develop…

Information Theory · Computer Science 2015-05-18 Xin Wang , Chenyang Yang

High-capacity NAND flash memories use multi-level cells (MLCs) to store multiple bits per cell and achieve high storage densities. Higher densities cause increased raw bit error rates (BERs), which demand powerful error correcting codes.…

Information Theory · Computer Science 2012-02-08 Jiadong Wang , Guiqiang Dong , Tong Zhang , Richard Wesel

In this paper, we propose a linear polarization coding scheme (LPC) combined with the phase conjugated twin signals (PCTS) technique, referred to as LPC-PCTS, for fiber nonlinearity mitigation in coherent optical orthogonal frequency…

Signal Processing · Electrical Eng. & Systems 2021-06-29 O. S. Sunish Kumar , O. A. Dobre , R. Venkatesan , S. K. Wilson , O. Omomukuyo , A. Amari , D. Chang