English
Related papers

Related papers: Neural Probabilistic Shaping: Joint Distribution L…

200 papers

The idea of end-to-end learning of communication systems through neural network-based autoencoders has the shortcoming that it requires a differentiable channel model. We present in this paper a novel learning algorithm which alleviates…

Information Theory · Computer Science 2019-07-02 Fayçal Ait Aoudia , Jakob Hoydis

Understanding the dynamics of neural networks in different width regimes is crucial for improving their training and performance. We present an exact solution for the learning dynamics of a one-hidden-layer linear network, with…

Machine Learning · Computer Science 2025-02-24 Yizhou Xu , Liu Ziyin

Directional beamforming will play a paramount role in 5G and beyond networks in order to combat the higher path losses incurred at millimeter wave bands. Appropriate modeling and analysis of the angles and distances between transmitters and…

This paper finds new tight finite-blocklength bounds for the best achievable lossy joint source-channel code rate, and demonstrates that joint source-channel code design brings considerable performance advantage over a separate one in the…

Information Theory · Computer Science 2014-02-05 Victoria Kostina , Sergio Verdú

Network embedding is an effective technique to learn the low-dimensional representations of nodes in networks. Real-world networks are usually with multiplex or having multi-view representations from different relations. Recently, there has…

Machine Learning · Computer Science 2022-03-08 Qifan Wang , Yi Fang , Anirudh Ravula , Ruining He , Bin Shen , Jingang Wang , Xiaojun Quan , Dongfang Liu

We consider a scenario of broadcasting information over a network of nodes connected by noiseless communication links. A source node in the network has $k$ data packets to broadcast, and it suffices that a large fraction of the network…

Information Theory · Computer Science 2019-01-23 B. R. Vinay Kumar , Navin Kashyap

Numerous neuro-symbolic approaches have recently been proposed typically with the goal of adding symbolic knowledge to the output layer of a neural network. Ideally, such losses maximize the probability that the neural network's predictions…

Machine Learning · Computer Science 2023-03-01 Kareem Ahmed , Kai-Wei Chang , Guy Van den Broeck

Bipolar modulation increases the achievable information rate of communication links with direct-detection receivers. This paper optimizes bipolar transmission with a modulator bias offset for short-reach fiber links. A neural network…

Information Theory · Computer Science 2024-07-09 Thomas Wiegart , Daniel Plabst , Norbert Hanik , Gerhard Kramer

Semantic communication systems often use an end-to-end neural network to map input data into continuous symbols. These symbols, which are essentially neural network features, usually have fixed dimensions and heavy-tailed distributions.…

Information Theory · Computer Science 2025-12-17 Hanju Yoo , Dongha Choi , Songkuk Kim , Chan-Byoung Chae , Robert W. Heath

A geometrically-shaped 256-QAM constellation, tailored to the nonlinear optical fibre channel, is experimentally demonstrated. The proposed constellation outperforms both uniform and AWGN-tailored 256-QAM, as it is designed to optimise the…

Information Theory · Computer Science 2018-11-21 E. Sillekens , D. Semrau , D. Lavery , P. Bayvel , R. I. Killey

Processing an input signal that contains arbitrary structures, e.g., superpixels and point clouds, remains a big challenge in computer vision. Linear diffusion, an effective model for image processing, has been recently integrated with deep…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Sifei Liu , Xueting Li , Varun Jampani , Shalini De Mello , Jan Kautz

We introduce for the first time the utilization of Long short-term memory (LSTM) neural network architectures for the compensation of fiber nonlinearities in digital coherent systems. We conduct numerical simulations considering either…

Signal Processing · Electrical Eng. & Systems 2020-12-16 Stavros Deligiannidis , Adonis Bogris , Charis Mesaritakis , Yannis Kopsinis

State-space models are a popular statistical framework for analysing sequential data. Within this framework, particle filters are often used to perform inference on non-linear state-space models. We introduce a new method, StateMixNN, that…

Machine Learning · Computer Science 2025-03-28 Benjamin Cox , Santiago Segarra , Victor Elvira

In this work we demonstrate a proof of concept of a fully-wireless two-node open-loop coherent distributed communication system and evaluate its performance by transmitting QPSK , 64-, and 256-QAM constellations at a symbol rate of 2 MBd…

Signal Processing · Electrical Eng. & Systems 2025-06-17 Jason M. Merlo , Jeffrey A. Nanzer

We propose an adaptive scheme for distributed learning of nonlinear functions by a network of nodes. The proposed algorithm consists of a local adaptation stage utilizing multiple kernels with projections onto hyperslabs and a diffusion…

Signal Processing · Electrical Eng. & Systems 2018-09-05 Ban-Sok Shin , Masahiro Yukawa , Renato Luis Garrido Cavalcante , Armin Dekorsy

Neuromorphic systems that learn and predict from streaming inputs hold significant promise in pervasive edge computing and its applications. In this paper, a neuromorphic system that processes spatio-temporal information on the edge is…

Emerging Technologies · Computer Science 2020-06-23 Abdullah M. Zyarah , Kevin Gomez , Dhireesha Kudithipudi

On the one hand, sign-bit shaping is a popular shaping scheme where the conditional probability of the sign bit is made non-equiprobable. On the other hand, probabilistic amplitude shaping (PAS) is a popular coding scheme, to combine…

Information Theory · Computer Science 2023-03-01 Vincent Corlay , Hamidou Dembele

Enhanced Gaussian noise models are used to demonstrate that the per-block SNR after fibre transmission varies significantly due to the variable-composition nature of modern probabilistic shaping schemes. We propose a nonlinearity-optimised…

Signal Processing · Electrical Eng. & Systems 2019-07-08 Tobias Fehenberger , Alex Alvarado

One of the main goals of 5G wireless telecommunication technology is improving energy efficiency, especially of remote sensors which should be able for example to transmit on average 1bit/s for 10 years from a single AAA battery. There will…

Information Theory · Computer Science 2016-08-16 Jarek Duda

Communication systems aided by movable antennas have been the subject of recent research due to their potentially increased spatial degrees of freedom offered by optimizing the antenna positioning at the transmitter and/or receiver. In this…