English
Related papers

Related papers: CommIN: Semantic Image Communications as an Invers…

200 papers

Diffusion models have emerged as a powerful foundation model for visual generations. With an appropriate sampling process, it can effectively serve as a generative prior for solving general inverse problems. Current posterior sampling-based…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Shijie Zhou , Huaisheng Zhu , Rohan Sharma , Jiayi Chen , Ruiyi Zhang , Kaiyi Ji , Changyou Chen

End-to-end image transmission has recently become a crucial trend in intelligent wireless communications, driven by the increasing demand for high bandwidth efficiency. However, existing methods primarily optimize the trade-off between…

Image and Video Processing · Electrical Eng. & Systems 2024-08-27 Kailin Tan , Jincheng Dai , Zhenyu Liu , Sixian Wang , Xiaoqi Qin , Wenjun Xu , Kai Niu , Ping Zhang

Foundation model-based semantic transmission has recently shown great potential in wireless image communication. However, existing methods exhibit two major limitations: (i) they overlook the varying importance of semantic components for…

Image and Video Processing · Electrical Eng. & Systems 2025-09-30 Fangyu Liu , Peiwen Jiang , Wenjin Wang , Chao-Kai Wen , Shi Jin , Jun Zhang

Wireless image transmission underpins diverse networked intelligent services and becomes an increasingly critical issue. Existing works have shown that deep learning-based joint source-channel coding (JSCC) is an effective framework to…

Signal Processing · Electrical Eng. & Systems 2025-09-16 Haozhen Li , Ruide Zhang , Rongqing Zhang , Xiang Cheng

We consider distributed image transmission over a noisy multiple access channel (MAC) using deep joint source-channel coding (DeepJSCC). It is known that Shannon's separation theorem holds when transmitting independent sources over a MAC in…

Image and Video Processing · Electrical Eng. & Systems 2023-10-10 Selim F. Yilmaz , Can Karamanli , Deniz Gunduz

We introduce a diffusion-based cross-domain image translator in the absence of paired training data. Unlike GAN-based methods, our approach integrates diffusion models to learn the image translation process, allowing for more coverable…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Shilong Zou , Yuhang Huang , Renjiao Yi , Chenyang Zhu , Kai Xu

Diffusion models have emerged as the new state-of-the-art generative model with high quality samples, with intriguing properties such as mode coverage and high flexibility. They have also been shown to be effective inverse problem solvers,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Hyungjin Chung , Dohoon Ryu , Michael T. McCann , Marc L. Klasky , Jong Chul Ye

This paper proposes ControlMambaIR, a novel image restoration method designed to address perceptual challenges in image deraining, deblurring, and denoising tasks. By integrating the Mamba network architecture with the diffusion model, the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Cheng Yang , Lijing Liang , Zhixun Su

Diffusion models (DMs) have demonstrated remarkable ability to generate diverse and high-quality images by efficiently modeling complex data distributions. They have also been explored as powerful generative priors for signal recovery,…

Machine Learning · Computer Science 2025-05-28 Anqi Tang , Youming Chen , Shuchen Xue , Zhaoqiang Liu

Diffusion models are highly regarded for their controllability and the diversity of images they generate. However, class-conditional generation methods based on diffusion models often focus on more common categories. In large-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Kun Wang , Donglin Di , Tonghua Su , Lei Fan

Recent methods have shown that pre-trained diffusion models can be fine-tuned to enable generative inverse rendering by learning image-conditioned noise-to-intrinsic mapping. Despite their remarkable progress, they struggle to robustly…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Rongjia Zheng , Qing Zhang , Chengjiang Long , Wei-Shi Zheng

Remote sensing image change captioning (RSICC) aims at generating human-like language to describe the semantic changes between bi-temporal remote sensing image pairs. It provides valuable insights into environmental dynamics and land…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Xiaofei Yu , Yitong Li , Jie Ma

This paper introduces a novel approach to solve inverse problems by leveraging deep learning techniques. The objective is to infer unknown parameters that govern a physical system based on observed data. We focus on scenarios where the…

Machine Learning · Computer Science 2023-10-02 Sidney Besnard , Frédéric Jurie , Jalal M. Fadili

Diffusion inversion is a task of recovering the noise of an image in a diffusion model, which is vital for controllable diffusion image editing. At present, diffusion inversion still remains a challenging task due to the lack of viable…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Ziyue Zhang , Luxi Lin , Xiaolin Hu , Chao Chang , HuaiXi Wang , Yiyi Zhou , Rongrong Ji

While learned image compression (LIC) focuses on efficient data transmission, generative image compression (GIC) extends this framework by integrating generative modeling to produce photo-realistic reconstructed images. In this paper, we…

Image and Video Processing · Electrical Eng. & Systems 2025-05-28 Minghao Han , Weiyi You , Jinhua Zhang , Leheng Zhang , Ce Zhu , Shuhang Gu

Research in semantic communication has garnered considerable attention, particularly in the area of image transmission, where joint source-channel coding (JSCC)-based neural network (NN) modules are frequently employed. However, these…

Signal Processing · Electrical Eng. & Systems 2025-08-05 Yoon Huh , Bumjun Kim , Wan Choi

The semantic information of the image for intelligent tasks is hidden behind the pixels, and slight changes in the pixels will affect the performance of intelligent tasks. In order to preserve semantic information behind pixels for…

Image and Video Processing · Electrical Eng. & Systems 2022-08-25 Qizheng Sun , Caili Guo , Yang Yang , Jiujiu Chen , Rui Tang , Chuanhong Liu

Semantic Communication (SC) is an emerging technology aiming to surpass the Shannon limit. Traditional SC strategies often minimize signal distortion between the original and reconstructed data, neglecting perceptual quality, especially in…

Machine Learning · Computer Science 2024-08-12 Kexin Zhang , Lixin Li , Wensheng Lin , Yuna Yan , Rui Li , Wenchi Cheng , Zhu Han

This paper presents the Deep Convolution Inverse Graphics Network (DC-IGN), a model that learns an interpretable representation of images. This representation is disentangled with respect to transformations such as out-of-plane rotations…

Computer Vision and Pattern Recognition · Computer Science 2015-06-23 Tejas D. Kulkarni , Will Whitney , Pushmeet Kohli , Joshua B. Tenenbaum

A blind compressive sensing algorithm is proposed to reconstruct hyperspectral images from spectrally-compressed measurements.The wavelength-dependent data are coded and then superposed, mapping the three-dimensional hyperspectral datacube…

Computer Vision and Pattern Recognition · Computer Science 2015-10-28 Xin Yuan , Tsung-Han Tsai , Ruoyu Zhu , Patrick Llull , David Brady , Lawrence Carin