English
Related papers

Related papers: Neural Joint Source-Channel Coding

200 papers

Designing codes that combat the noise in a communication medium has remained a significant area of research in information theory as well as wireless communications. Asymptotically optimal channel codes have been developed by mathematicians…

Information Theory · Computer Science 2019-11-11 Yihan Jiang , Hyeji Kim , Himanshu Asnani , Sreeram Kannan , Sewoong Oh , Pramod Viswanath

The presence of noise is common in signal processing regardless the signal type. Deep neural networks have shown good performance in noise removal, especially on the image domain. In this work, we consider deep neural networks as a…

Machine Learning · Computer Science 2020-07-07 Leslie Casas , Attila Klimmek , Nassir Navab , Vasileios Belagiannis

Recent fast style transfer methods use a pre-trained convolutional neural network as a feature encoder and a perceptual loss network. Although the pre-trained network is used to generate responses of receptive fields effective for…

Computer Vision and Pattern Recognition · Computer Science 2018-07-05 Minseong Kim , Jongju Shin , Myung-Cheol Roh , Hyun-Chul Choi

In a decentralized and self-configuring network, the communication devices are considered as autonomous decision-makers that sense their environment and that implement optimal transmission schemes. It is essential that these autonomous…

Information Theory · Computer Science 2017-06-05 Maël Le Treust

Neural image compression methods have seen increasingly strong performance in recent years. However, they suffer orders of magnitude higher computational complexity compared to traditional codecs, which hinders their real-world deployment.…

Image and Video Processing · Electrical Eng. & Systems 2023-11-13 Yibo Yang , Stephan Mandt

We consider the image transmission problem over a noisy wireless channel via deep learning-based joint source-channel coding (DeepJSCC) along with a denoising diffusion probabilistic model (DDPM) at the receiver. Specifically, we are…

Image and Video Processing · Electrical Eng. & Systems 2024-09-23 Selim F. Yilmaz , Xueyan Niu , Bo Bai , Wei Han , Lei Deng , Deniz Gunduz

This paper proposes a novel framework for unsupervised audio source separation using a deep autoencoder. The characteristics of unknown source signals mixed in the mixed input is automatically by properly configured autoencoders implemented…

Sound · Computer Science 2014-12-24 Giljin Jang , Han-Gyu Kim , Yung-Hwan Oh

We introduce deep learning based communication methods for successive refinement of images over wireless channels. We present three different strategies for progressive image transmission with deep JSCC, with different…

Information Theory · Computer Science 2019-05-30 David Burth Kurka , Deniz Gunduz

Neural-network models of high-level brain functions such as memory recall and reasoning often rely on the presence of stochasticity. The majority of these models assumes that each neuron in the functional network is equipped with its own…

Neurons and Cognition · Quantitative Biology 2022-05-17 Jakob Jordan , Mihai A. Petrovici , Oliver Breitwieser , Johannes Schemmel , Karlheinz Meier , Markus Diesmann , Tom Tetzlaff

When a channel model is not available, the end-to-end training of encoder and decoder on a fading noisy channel generally requires the repeated use of the channel and of a feedback link. An important limitation of the approach is that…

Signal Processing · Electrical Eng. & Systems 2021-10-22 Sangwoo Park , Osvaldo Simeone , Joonhyuk Kang

End-to-end learning of communication systems enables joint optimization of transmitter and receiver, implemented as deep neural network-based autoencoders, over any type of channel and for an arbitrary performance metric. Recently, an…

Information Theory · Computer Science 2019-06-25 Mathieu Goutay , Fayçal Ait Aoudia , Jakob Hoydis

An additive noise channel is considered, in which the distribution of the noise is nonparametric and unknown. The problem of learning encoders and decoders based on noise samples is considered. For uncoded communication systems, the problem…

Information Theory · Computer Science 2021-11-17 Nir Weinberger

Distributed source coding (DSC) is the task of encoding an input in the absence of correlated side information that is only available to the decoder. Remarkably, Slepian and Wolf showed in 1973 that an encoder without access to the side…

Information Theory · Computer Science 2024-07-02 Jay Whang , Alliot Nagle , Anish Acharya , Hyeji Kim , Alexandros G. Dimakis

The secrecy performance of a source-channel model is studied in the context of lossy source compression over a noisy broadcast channel. The source is causally revealed to the eavesdropper during decoding. The fidelity of the transmission to…

Information Theory · Computer Science 2015-06-24 Eva C. Song , Paul Cuff , H. Vincent Poor

Deep learning-based image compression has made great progresses recently. However, many leading schemes use serial context-adaptive entropy model to improve the rate-distortion (R-D) performance, which is very slow. In addition, the…

Image and Video Processing · Electrical Eng. & Systems 2023-09-07 Haisheng Fu , Feng Liang , Jie Liang , Yongqiang Wang , Guohe Zhang , Jingning Han

Machine learning has the potential to become an important tool in quantum error correction as it allows the decoder to adapt to the error distribution of a quantum chip. An additional motivation for using neural networks is the fact that…

Quantum Physics · Physics 2019-09-18 Nikolas P. Breuckmann , Xiaotong Ni

Traditional source separation approaches train deep neural network models end-to-end with all the data available at once by minimizing the empirical risk on the whole training set. On the inference side, after training the model, the user…

Lifelong audio feature extraction involves learning new sound classes incrementally, which is essential for adapting to new data distributions over time. However, optimizing the model only on new data can lead to catastrophic forgetting of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-08 Xilin Jiang , Yinghao Aaron Li , Nima Mesgarani

We present a method for training a neural network to perform image denoising without access to clean training examples or access to paired noisy training examples. Our method requires only a single noisy realization of each training example…

Image and Video Processing · Electrical Eng. & Systems 2019-10-29 Nick Moran , Dan Schmidt , Yu Zhong , Patrick Coady

We present a method to separate speech signals from noisy environments in the embedding space of a neural audio codec. We introduce a new training procedure that allows our model to produce structured encodings of audio waveforms given by…

‹ Prev 1 4 5 6 7 8 10 Next ›