English
Related papers

Related papers: MISC: Ultra-low Bitrate Image Semantic Compression…

200 papers

Recent advancements in neural compression have surpassed traditional codecs in PSNR and MS-SSIM measurements. However, at low bit-rates, these methods can introduce visually displeasing artifacts, such as blurring, color shifting, and…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Daxin Li , Yuanchao Bai , Kai Wang , Junjun Jiang , Xianming Liu

In recent years, layered image compression is demonstrated to be a promising direction, which encodes a compact representation of the input image and apply an up-sampling network to reconstruct the image. To further improve the quality of…

Image and Video Processing · Electrical Eng. & Systems 2021-02-02 Trinh Man Hoang , Jinjia Zhou , Yibo Fan

Existing learning-based stereo image codec adopt sophisticated transformation with simple entropy models derived from single image codecs to encode latent representations. However, those entropy models struggle to effectively capture the…

Image and Video Processing · Electrical Eng. & Systems 2025-02-11 Xinjie Zhang , Shenyuan Gao , Zhening Liu , Jiawei Shao , Xingtong Ge , Dailan He , Tongda Xu , Yan Wang , Jun Zhang

Semantic communication, rather than on a bit-by-bit recovery of the transmitted messages, focuses on the meaning and the goal of the communication itself. In this paper, we propose a novel semantic image coding scheme that preserves the…

Information Theory · Computer Science 2024-02-23 Francesco Pezone , Osman Musa , Giuseppe Caire , Sergio Barbarossa

The emerging semantic compression has been receiving increasing research efforts most recently, capable of achieving high fidelity restoration during compression, even at extremely low bitrates. However, existing semantic compression…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Shengxi Li , Zifu Zhang , Mai Xu , Lai Jiang , Yufan Liu , Ce Zhu

Compressive imaging is an emerging application of compressed sensing, devoted to acquisition, encoding and reconstruction of images using random projections as measurements. In this paper we propose a novel method to provide a scalable…

Information Theory · Computer Science 2013-10-07 Diego Valsesia , Enrico Magli

Multimodal semantic communication has great potential to enhance downstream task performance by integrating complementary information across modalities. This paper introduces ProMSC-MIS, a novel Prompt-based Multimodal Semantic…

Multimedia · Computer Science 2025-08-28 Haoshuo Zhang , Yufei Bo , Meixia Tao

Semantic communications has received growing interest since it can remarkably reduce the amount of data to be transmitted without missing critical information. Most existing works explore the semantic encoding and transmission for text and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Danlan Huang , Feifei Gao , Xiaoming Tao , Qiyuan Du , Jianhua Lu

Learned image compression (LIC) techniques have achieved remarkable progress; however, effectively integrating high-level semantic information remains challenging. In this work, we present a \underline{S}emantic-\underline{E}nhanced…

Applications · Statistics 2025-04-03 Haisheng Fu , Jie Liang , Zhenman Fang , Jingning Han

Semantic compression, a compression scheme where the distortion metric, typically MSE, is replaced with semantic fidelity metrics, tends to become more and more popular. Most recent semantic compression schemes rely on the foundation model…

Image and Video Processing · Electrical Eng. & Systems 2024-12-09 Tom Bachard , Thomas Maugey

Deep learning based image compressed sensing (CS) has achieved great success. However, existing CS systems mainly adopt a fixed measurement matrix to images, ignoring the fact the optimal measurement numbers and bases are different for…

Image and Video Processing · Electrical Eng. & Systems 2023-07-12 Bowen Zhang , Zhijin Qin , Geoffrey Ye Li

In recent years, image compression for high-level vision tasks has attracted considerable attention from researchers. Given that object information in images plays a far more crucial role in downstream tasks than background information,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Chengjie Dai , Tiantian Song , Hui Tang , Fangdong Chen , Bowei Yang , Guanghua Song

Underwater communication is essential for environmental monitoring, marine biology research, and underwater exploration. Traditional underwater communication faces limitations like low bandwidth, high latency, and susceptibility to noise,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Weilong Chen , Wenxuan Xu , Haoran Chen , Xinran Zhang , Zhijin Qin , Yanru Zhang , Zhu Han

While recent neural codecs achieve strong performance at low bitrates when optimized for perceptual quality, their effectiveness deteriorates significantly under ultra-low bitrate conditions. To mitigate this, generative compression methods…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Chuqin Zhou , Xiaoyue Ling , Yunuo Chen , Jincheng Dai , Guo Lu , Wenjun Zhang

Lossless image compression is required in various applications to reduce storage or transmission costs of images, while requiring the reconstructed images to have zero information loss compared to the original. Existing lossless image…

Information Theory · Computer Science 2024-09-12 Samar Agnihotri , Renu Rameshan , Ritwik Ghosal

This study presents a new lossy image compression method that utilizes the multi-scale features of natural images. Our model consists of two networks: multi-scale lossy autoencoder and parallel multi-scale lossless coder. The multi-scale…

Machine Learning · Statistics 2018-05-17 Ken Nakanishi , Shin-ichi Maeda , Takeru Miyato , Daisuke Okanohara

Lossy image compression has been studied extensively in the context of typical loss functions such as RMSE, MS-SSIM, etc. However, compression at low bitrates generally produces unsatisfying results. Furthermore, the availability of massive…

Image and Video Processing · Electrical Eng. & Systems 2019-06-26 Ashutosh Bhown , Soham Mukherjee , Sean Yang , Shubham Chandak , Irena Fischer-Hwang , Kedar Tatwawadi , Judith Fan , Tsachy Weissman

Traditional video codecs optimized for pixel fidelity collapse at ultra-low bitrates and produce severe artifacts. This failure arises from a fundamental misalignment between pixel accuracy and human perception. We propose a semantic video…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Lingdong Wang , Guan-Ming Su , Divya Kothandaraman , Tsung-Wei Huang , Mohammad Hajiesmaili , Ramesh K. Sitaraman

We propose a general method for semantic representation of images and other data using progressive coding. Semantic coding allows for specific pieces of information to be selectively encoded into a set of measurements that can be highly…

Signal Processing · Electrical Eng. & Systems 2023-09-29 Eva Riherd , Raghu Mudumbai , Weiyu Xu

Lossy compression algorithms aim to compactly encode images in a way which enables to restore them with minimal error. We show that a key limitation of existing algorithms is that they rely on error measures that are extremely sensitive to…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Tamar Rott Shaham , Tomer Michaeli