English
Related papers

Related papers: Lossy Common Information in a Learnable Gray-Wyner…

200 papers

Multi-view data containing complementary and consensus information can facilitate representation learning by exploiting the intact integration of multi-view features. Because most objects in real world often have underlying connections,…

Machine Learning · Computer Science 2023-08-15 Zhaoliang Chen , Lele Fu , Shunxin Xiao , Shiping Wang , Claudia Plant , Wenzhong Guo

We study the problem of deep joint source-channel coding (D-JSCC) for correlated image sources, where each source is transmitted through a noisy independent channel to the common receiver. In particular, we consider a pair of images…

Information Theory · Computer Science 2022-01-26 Sixian Wang , Ke Yang , Jincheng Dai , Kai Niu

One notable weakness of current machine learning algorithms is the poor ability of models to solve new problems without forgetting previously acquired knowledge. The Continual Learning paradigm has emerged as a protocol to systematically…

Machine Learning · Computer Science 2022-11-16 Heinke Hihn , Daniel A. Braun

Image fusion is a significant problem in many fields including digital photography, computational imaging and remote sensing, to name but a few. Recently, deep learning has emerged as an important tool for image fusion. This paper presents…

Image and Video Processing · Electrical Eng. & Systems 2020-05-19 Shuang Xu , Zixiang Zhao , Yicheng Wang , Chunxia Zhang , Junmin Liu , Jiangshe Zhang

Two familiar notions of correlation are rediscovered as the extreme operating points for distributed synthesis of a discrete memoryless channel, in which a stochastic channel output is generated based on a compressed description of the…

Information Theory · Computer Science 2016-11-18 Paul Cuff

We explore the use of FCNNs (Fully Connected Neural Networks) for designing end-to-end communication systems without taking any inspiration from existing classical communications models or error control coding. This work relies solely on…

Machine Learning · Computer Science 2024-09-10 Sudharsan Senthil , Shubham Paul , Nambi Seshadri , R. David Koilpillai

A learning task, understood as the problem of fitting a parametric model from supervised data, fundamentally requires the dataset to be large enough to be representative of the underlying distribution of the source. When data is limited,…

Machine Learning · Computer Science 2025-11-18 Leopoldo Agorio , Juan Cerviño , Miguel Calvo-Fullana , Alejandro Ribeiro , Juan Andrés Bazerque

Classical convolutional neural networks (cCNNs) are very good at categorizing objects in images. But, unlike human vision which is relatively robust to noise in images, the performance of cCNNs declines quickly as image quality worsens.…

Computer Vision and Pattern Recognition · Computer Science 2018-11-22 Till S. Hartmann

Today's deep learning methods focus on how to design the most appropriate objective functions so that the prediction results of the model can be closest to the ground truth. Meanwhile, an appropriate architecture that can facilitate…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Chien-Yao Wang , I-Hau Yeh , Hong-Yuan Mark Liao

We consider the problem of communication over a network containing a hidden and malicious adversary that can control a subset of network resources, and aims to disrupt communications. We focus on omniscient node-based adversaries, i.e., the…

Information Theory · Computer Science 2016-05-09 Peida Tian , Sidharth Jaggi , Mayank Bakshi , Oliver Kosut

Modern vision models must capture image-level context without sacrificing local detail while remaining computationally affordable. We revisit this tradeoff and advance a simple principle: decouple the roles of global reasoning and local…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Zhenyu Yang , Gensheng Pei , Tao Chen , Yichao Zhou , Tianfei Zhou , Yazhou Yao , Fumin Shen

We study a two-user cognitive interference channel (CIC) where one of the transmitters (primary) has knowledge of a linear combination (over an appropriate finite field) of the two information messages. We refer to this channel model as…

Information Theory · Computer Science 2013-01-29 Song-Nam Hong , Giuseppe Caire

Graph Neural Networks (GNNs) have received extensive research attention due to their powerful information aggregation capabilities. Despite the success of GNNs, most of them suffer from the popularity bias issue in a graph caused by a small…

Machine Learning · Computer Science 2024-08-02 Yuntao Shou , Haozhi Lan , Xiangyong Cao

While deep convolutional neural networks (CNNs) have shown a great success in single-label image classification, it is important to note that real world images generally contain multiple labels, which could correspond to different objects,…

Computer Vision and Pattern Recognition · Computer Science 2016-04-18 Jiang Wang , Yi Yang , Junhua Mao , Zhiheng Huang , Chang Huang , Wei Xu

Link prediction and node classification are two important downstream tasks of network representation learning. Existing methods have achieved acceptable results but they perform these two tasks separately, which requires a lot of…

Social and Information Networks · Computer Science 2021-03-04 Hong Huang , Yu Song , Yao Wu , Jia Shi , Xia Xie , Hai Jin

Video compression is indispensable to most video analysis systems. Despite saving transportation bandwidth, it also deteriorates downstream video understanding tasks, especially at low-bitrate settings. To systematically investigate this…

Image and Video Processing · Electrical Eng. & Systems 2024-09-24 Yuan Tian , Guo Lu , Yichao Yan , Guangtao Zhai , Li Chen , Zhiyong Gao

Deep learning has been shown to be able to recognize data patterns better than humans in specific circumstances or contexts. In parallel, quantum computing has demonstrated to be able to output complex wave functions with a few number of…

Quantum Physics · Physics 2021-08-05 Junhua Liu , Kwan Hui Lim , Kristin L. Wood , Wei Huang , Chu Guo , He-Liang Huang

Joint source-channel coding is a compelling paradigm when low-latency and low-complexity communication is required. This work proposes a theoretical framework that integrates classification and anomaly detection within the conventional…

Signal Processing · Electrical Eng. & Systems 2025-09-18 Andriy Enttsel , Weichen Wang , Mauro Mangia , Riccardo Rovatti , Deniz Gündüz

Relying on either deep models or physical models are two mainstream approaches for solving inverse sample reconstruction problems in programmable illumination computational microscopy. Solutions based on physical models possess strong…

Image and Video Processing · Electrical Eng. & Systems 2024-03-21 Ruiqing Sun , Delong Yang , Shaohui Zhang , Qun Hao

Learning concepts that are consistent with human perception is important for Deep Neural Networks to win end-user trust. Post-hoc interpretation methods lack transparency in the feature representations learned by the models. This work…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Sandareka Wickramanayake , Wynne Hsu , Mong Li Lee