English
Related papers

Related papers: Rate-Distortion Properties of Single-Layer Quantiz…

200 papers

We investigate different methods for regularizing quantile regression when predicting either a subset of quantiles or the full inverse CDF. We show that minimizing an expected pinball loss over a continuous distribution of quantiles is a…

Machine Learning · Statistics 2021-02-11 Taman Narayan , Serena Wang , Kevin Canini , Maya Gupta

Random features (RFs) are a popular technique to scale up kernel methods in machine learning, replacing exact kernel evaluations with stochastic Monte Carlo estimates. They underpin models as diverse as efficient transformers (by…

Machine Learning · Statistics 2024-10-04 Isaac Reid , Stratis Markou , Krzysztof Choromanski , Richard E. Turner , Adrian Weller

Quantum computing hardware is undergoing rapid development from proof-of-principle devices to scalable machines that could eventually challenge classical supercomputers on specific tasks. On platforms with local connectivity, the transition…

Quantum Physics · Physics 2020-04-13 Adam Holmes , Sonika Johri , Gian Giacomo Guerreschi , James S. Clarke , A. Y. Matsuura

The ever increasing demands for mobile network access have resulted in a significant increase in bandwidth usage. By improving the system spectral efficiency, multi-way relay networks (MWRNs) provide promising approaches to address this…

Signal Processing · Electrical Eng. & Systems 2018-04-23 Samira Rahimian , Wuhua Zhang , Moslem Noori , Yindi Jing , Masoud Ardakani

We consider a full-duplex (FD) decode-and-forward system in which the time-switching protocol is employed by the multi-antenna relay to receive energy from the source and transmit information to the destination. The instantaneous throughput…

Information Theory · Computer Science 2016-11-17 Mohammadali Mohammadi , Batu K. Chalise , Himal A. Suraweera , Caijun Zhong , Gan Zheng , Ioannis Krikidis

A Delta-Sigma modulator that is often utilized to convert analog signals into digital signals can be modeled as a static uniform quantizer with an error feedback filter. In this paper, we present a rate-distortion analysis of quantizers…

Systems and Control · Computer Science 2017-10-11 Shuichi Ohno , Teruyuki Shiraki , M. Rizwan Tariq , Masaaki Nagahara

Interference is usually viewed as an obstacle to communication in wireless networks. This paper proposes a new strategy, compute-and-forward, that exploits interference to obtain significantly higher rates between users in a network. The…

Information Theory · Computer Science 2011-06-14 Bobak Nazer , Michael Gastpar

This paper considers a decode-and-forward (DF) multi-way massive multiple-input multiple-output (MIMO) relay system where many users exchange their data with the aid of a relay station equipped with a massive antenna array. We propose a new…

Information Theory · Computer Science 2017-04-03 Chung Duc Ho , Hien Quoc Ngo , Michail Matthaiou , Trung Q. Duong

We propose a novel mode of operation for Amplify-and-Forward relays in which the spectra of the relay input and output signals partially overlap. This partial-duplex relaying mode encompasses half-duplex and full-duplex as particular cases.…

Information Theory · Computer Science 2017-08-22 Roberto López-Valcarce , Carlos Mosquera

Recent advances in federated learning have shown that asynchronous variants can be faster and more scalable than their synchronous counterparts. However, their design does not include quantization, which is necessary in practice to deal…

Machine Learning · Computer Science 2024-10-08 Tomas Ortega , Hamid Jafarkhani

We address the problem of network quantization, that is, reducing bit-widths of weights and/or activations to lighten network architectures. Quantization methods use a rounding function to map full-precision values to the nearest quantized…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Dohyung kim , Junghyup Lee , Bumsub Ham

In a slow fading channel, how to find a cooperative diversity scheme that achieves the transmit diversity bound is still an open problem. In fact, all previously proposed amplify-and-forward (AF) and decode-and-forward (DF) schemes do not…

Information Theory · Computer Science 2007-07-16 Sheng Yang , Jean-Claude Belfiore

With the rapid growth in the use of fine-tuning for large language models (LLMs), optimizing fine-tuning while keeping inference efficient has become highly important. However, this is a challenging task as it requires improvements in all…

Computation and Language · Computer Science 2024-10-14 Changhun Lee , Jun-gyu Jin , Younghyun Cho , Eunhyeok Park

This paper is concerned with the performance of differential amplify-and-forward (D-AF) relaying for multi-node wireless communications over time-varying Rayleigh fading channels. A first-order auto-regressive model is utilized to…

Information Theory · Computer Science 2014-04-01 M. R. Avendi , Ha H. Nguyen

The complexity of large-scale 6G-and-beyond networks demands innovative approaches for multi-objective optimization over vast search spaces, a task often intractable. Quantum computing (QC) emerges as a promising technology for efficient…

Networking and Internet Architecture · Computer Science 2025-09-10 Sebastian Macaluso , Giovanni Geraci , Elías F. Combarro , Sergi Abadal , Ioannis Arapakis , Sofia Vallecorsa , Eduard Alarcón

Differential encoding and decoding can be employed to circumvent channel estimation in wireless relay networks. This article studies differential amplify-and-forward relaying using linear combining with arbitrary fixed combining weights in…

Information Theory · Computer Science 2016-11-18 M. R. Avendi , Ha H. Nguyen , Dac-Binh Ha

We introduce the Random Quadratic Form (RQF): a stochastic differential equation which formally corresponds to the gradient flow of a random quadratic functional on a sphere. While the one-point dynamics of the system is a Brownian motion…

Probability · Mathematics 2026-03-09 Maximilian Engel , Anna Shalova

Processing of multiple communication flows in wireless systems has given rise to a number of novel transmission techniques, notably the two-way relaying based on wireless network coding. Recently, a related set of techniques has emerged,…

Information Theory · Computer Science 2014-04-07 Lilian Hong

Compute and Forward (CF) is a promising relaying scheme which, instead of decoding single messages or forwarding/amplifying information at the relay, decodes linear combinations of the simultaneously transmitted messages. The current…

Information Theory · Computer Science 2017-05-23 Ori Shmuel , Asaf Cohen , Omer Gurewitz

In this paper, we study the performance of an amplify-and-forward (AF) based analog network coding (ANC) relay scheme in a multi-hop wireless network under individual power constraints. In the first part, a unicast scenario is considered.…

Information Theory · Computer Science 2012-03-23 Binyue Liu , Ning Cai