English
Related papers

Related papers: Infomax Neural Joint Source-Channel Coding via Adv…

200 papers

We present CLIP-NeRF, a multi-modal 3D object manipulation method for neural radiance fields (NeRF). By leveraging the joint language-image embedding space of the recent Contrastive Language-Image Pre-Training (CLIP) model, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Can Wang , Menglei Chai , Mingming He , Dongdong Chen , Jing Liao

Semantic communication has emerged as a new paradigm to facilitate the performance of integrated sensing and communication systems in 6G. However, most of the existing works mainly focus on sensing data compression to reduce the subsequent…

Signal Processing · Electrical Eng. & Systems 2026-01-21 Haotian Wang , Dan Wang , Xiaodong Xu , Chuan Huang , Hao Chen , Nan Ma

Recent studies have revealed that GNNs are vulnerable to adversarial attacks. Most existing robust graph learning methods measure model robustness based on label information, rendering them infeasible when label information is not…

Machine Learning · Computer Science 2023-06-09 Jihong Wang , Minnan Luo , Jundong Li , Ziqi Liu , Jun Zhou , Qinghua Zheng

In this paper, we present an analytical analysis of the convergence of raptor codes under joint decoding over the binary input additive white noise channel (BIAWGNC), and derive an optimization method. We use Information Content evolution…

Information Theory · Computer Science 2007-07-13 Auguste Venkiah , Charly Poulliat , David Declercq

We consider distributed image transmission over a noisy multiple access channel (MAC) using deep joint source-channel coding (DeepJSCC). It is known that Shannon's separation theorem holds when transmitting independent sources over a MAC in…

Image and Video Processing · Electrical Eng. & Systems 2023-10-10 Selim F. Yilmaz , Can Karamanli , Deniz Gunduz

An online shaping technique for high performance communication over Gaussian channels with Inter-Symbol Interference (ISI) and receiver Analog to Digital Converter (ADC) noise is presented. The technique uses online transmitter precoding…

Information Theory · Computer Science 2020-10-15 Or Levi , Dan Raphaeli

This paper proposes a new design method for a stochastic control policy using a normalizing flow (NF). In reinforcement learning (RL), the policy is usually modeled as a distribution model with trainable parameters. When this…

Robotics · Computer Science 2024-12-18 Taisuke Kobayashi , Takumi Aotani

A general method of coding over expansion is proposed,which allows one to reduce the highly non-trivial problems of coding over analog channels and compressing analog sources to a set of much simpler subproblems, coding over discrete…

Information Theory · Computer Science 2015-05-21 Hongbo Si , O. Ozan Koyluoglu , Kumar Appaiah , Sriram Vishwanath

Implicit Neural Representations have gained prominence as a powerful framework for capturing complex data modalities, encompassing a wide range from 3D shapes to images and audio. Within the realm of 3D shape representation, Neural Signed…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Amine Ouasfi , Adnane Boukhayma

The Bit-Flipping (BF) decoder, thanks to its very low computational complexity, is widely employed in post-quantum cryptographic schemes based on Moderate Density Parity Check codes in which, ultimately, decryption boils down to syndrome…

Information Theory · Computer Science 2025-06-12 Alessio Baldelli , Marco Baldi , Franco Chiaraluce , Paolo Santini

Recently, pre-trained vision-language models have been increasingly used to tackle the challenging zero-shot segmentation task. Typical solutions follow the paradigm of first generating mask proposals and then adopting CLIP to classify…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Siyu Jiao , Yunchao Wei , Yaowei Wang , Yao Zhao , Humphrey Shi

A framework is presented for unsupervised learning of representations based on infomax principle for large-scale neural populations. We use an asymptotic approximation to the Shannon's mutual information for a large neural population to…

Machine Learning · Computer Science 2017-03-13 Wentao Huang , Kechen Zhang

In this paper, we propose a new deep image compression framework called Complexity and Bitrate Adaptive Network (CBANet), which aims to learn one single network to support variable bitrate coding under different computational complexity…

Image and Video Processing · Electrical Eng. & Systems 2021-05-27 Jinyang Guo , Dong Xu , Guo Lu

This paper describes InfoGAN, an information-theoretic extension to the Generative Adversarial Network that is able to learn disentangled representations in a completely unsupervised manner. InfoGAN is a generative adversarial network that…

Machine Learning · Computer Science 2016-06-14 Xi Chen , Yan Duan , Rein Houthooft , John Schulman , Ilya Sutskever , Pieter Abbeel

Disentanglement is a highly desirable property of representation owing to its similarity to human understanding and reasoning. Many works achieve disentanglement upon information bottlenecks (IB). Despite their elegant mathematical…

Machine Learning · Computer Science 2022-04-26 Jiantao Wu , Lin Wang , Bo Yang , Fanqi Li , Chunxiuzi Liu , Jin Zhou

Neural image compression methods have seen increasingly strong performance in recent years. However, they suffer orders of magnitude higher computational complexity compared to traditional codecs, which hinders their real-world deployment.…

Image and Video Processing · Electrical Eng. & Systems 2023-11-13 Yibo Yang , Stephan Mandt

In this paper, a neural network-aided bit-interleaved coded modulation (NN-BICM) receiver is designed to mitigate the nonlinear clipping distortion in the LDPC coded direct currentbiased optical orthogonal frequency division multiplexing…

Machine Learning · Computer Science 2018-09-05 Yuan He , Ming Jiang , Chunming Zhao

While convolutional neural networks (CNNs) have achieved excellent performances in various computer vision tasks, they often misclassify with malicious samples, a.k.a. adversarial examples. Adversarial training is a popular and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Hiroki Adachi , Tsubasa Hirakawa , Takayoshi Yamashita , Hironobu Fujiyoshi , Yasunori Ishii , Kazuki Kozuka

High-level representation-guided pixel denoising and adversarial training are independent solutions to enhance the robustness of CNNs against adversarial attacks by pre-processing input data and re-training models, respectively. Most…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Yihao Huang , Qing Guo , Felix Juefei-Xu , Lei Ma , Weikai Miao , Yang Liu , Geguang Pu

We introduce Noise Recycling, a method that substantially enhances decoding performance of orthogonal channels subject to correlated noise without the need for joint encoding or decoding. The method can be used with any combination of…

Information Theory · Computer Science 2020-06-11 Alejandro Cohen , Amit Solomon , Ken R. Duffy , Muriel Médard