English
Related papers

Related papers: MLIC: Multi-Reference Entropy Model for Learned Im…

200 papers

Dense pixel-specific representation learning at scale has been bottlenecked due to the unavailability of large-scale multi-view datasets. Current methods for building effective pretraining datasets heavily rely on annotated 3D meshes, point…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Kalyani Marathe , Mahtab Bigverdi , Nishat Khan , Tuhin Kundu , Patrick Howe , Sharan Ranjit S , Anand Bhattad , Aniruddha Kembhavi , Linda G. Shapiro , Ranjay Krishna

Large Language models (LLMs) have demonstrated impressive in-context learning (ICL) capabilities, where a LLM makes predictions for a given test input together with a few input-output pairs (demonstrations). Nevertheless, the inclusion of…

Computation and Language · Computer Science 2024-03-13 Yichuan Li , Xiyao Ma , Sixing Lu , Kyumin Lee , Xiaohu Liu , Chenlei Guo

Using special tokens (e.g., gist, memory, or compressed tokens) to compress context information is a common practice for large language models (LLMs). However, existing approaches often neglect that position encodings inherently induce…

Computation and Language · Computer Science 2025-09-29 Runsong Zhao , Xin Liu , Xinyu Liu , Pengcheng Huang , Chunyang Xiao , Tong Xiao , Jingbo Zhu

For learned image compression, the autoregressive context model is proved effective in improving the rate-distortion (RD) performance. Because it helps remove spatial redundancies among latent representations. However, the decoding process…

Image and Video Processing · Electrical Eng. & Systems 2021-04-02 Dailan He , Yaoyan Zheng , Baocheng Sun , Yan Wang , Hongwei Qin

Real-world applications require the classification model to adapt to new classes without forgetting old ones. Correspondingly, Class-Incremental Learning (CIL) aims to train a model with limited memory size to meet this requirement. Typical…

Machine Learning · Computer Science 2023-02-17 Da-Wei Zhou , Qi-Wei Wang , Han-Jia Ye , De-Chuan Zhan

In Learned Video Compression (LVC), improving inter prediction, such as enhancing temporal context mining and mitigating accumulated errors, is crucial for boosting rate-distortion performance. Existing LVCs mainly focus on mining the…

Image and Video Processing · Electrical Eng. & Systems 2025-10-29 Wei Jiang , Junru Li , Kai Zhang , Li Zhang

Learned image compression (LIC) has reached a comparable coding gain with traditional hand-crafted methods such as VVC intra. However, the large network complexity prohibits the usage of LIC on resource-limited embedded systems. Network…

Image and Video Processing · Electrical Eng. & Systems 2022-05-31 Heming Sun , Lu Yu , Jiro Katto

Recent work has shown that learned image compression strategies can outperform standard hand-crafted compression algorithms that have been developed over decades of intensive research on the rate-distortion trade-off. With growing…

Image and Video Processing · Electrical Eng. & Systems 2021-11-04 Felipe Codevilla , Jean Gabriel Simard , Ross Goroshin , Chris Pal

Recent learned image compression (LIC) leverages Mamba-style state-space models (SSMs) for global receptive fields with linear complexity. However, the standard Mamba adopts content-agnostic, predefined raster (or multi-directional) scans…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yunuo Chen , Zezheng Lyu , Bing He , Hongwei Hu , Qi Wang , Yuan Tian , Li Song , Wenjun Zhang , Guo Lu

Image compression aims to reduce the information redundancy in images. Most existing neural image compression methods rely on side information from hyperprior or context models to eliminate spatial redundancy, but rarely address the channel…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Lin Liu , Mingming Zhao , Shanxin Yuan , Wenlong Lyu , Wengang Zhou , Houqiang Li , Yanfeng Wang , Qi Tian

We present a novel compression algorithm for reducing the storage of LiDAR sensor data streams. Our model exploits spatio-temporal relationships across multiple LiDAR sweeps to reduce the bitrate of both geometry and intensity values.…

Image and Video Processing · Electrical Eng. & Systems 2021-01-12 Sourav Biswas , Jerry Liu , Kelvin Wong , Shenlong Wang , Raquel Urtasun

Image-based single-modality compression learning approaches have demonstrated exceptionally powerful encoding and decoding capabilities in the past few years , but suffer from blur and severe semantics loss at extremely low bitrates. To…

Image and Video Processing · Electrical Eng. & Systems 2023-04-27 Xuhao Jiang , Weimin Tan , Tian Tan , Bo Yan , Liquan Shen

In this paper, a unified transformation method in learned image compression(LIC) is proposed from the perspective of modulation. Firstly, the quantization in LIC is considered as a generalized channel with additive uniform noise. Moreover,…

Image and Video Processing · Electrical Eng. & Systems 2024-03-13 Youneng Bao , Fangyang Meng , Wen Tan , Chao Li , Yonghong Tian , Yongsheng Liang

Implicit neural representation (INR) can describe the target scenes with high fidelity using a small number of parameters, and is emerging as a promising data compression technique. However, limited spectrum coverage is intrinsic to INR,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Runzhao Yang , Tingxiong Xiao , Yuxiao Cheng , Jinli Suo , Qionghai Dai

Deep learning systems have been reported to achieve state-of-the-art performances in many applications, and a key is the existence of well trained classifiers on benchmark datasets. As a main-stream loss function, the cross entropy can…

Machine Learning · Computer Science 2022-09-22 Jirong Yi , Qiaosheng Zhang , Zhen Chen , Qiao Liu , Wei Shao

Learned image compression has recently shown the potential to outperform the standard codecs. State-of-the-art rate-distortion (R-D) performance has been achieved by context-adaptive entropy coding approaches in which hyperprior and…

Image and Video Processing · Electrical Eng. & Systems 2021-01-01 Mohammad Akbari , Jie Liang , Jingning Han , Chengjie Tu

While raw images exhibit advantages over sRGB images (e.g., linearity and fine-grained quantization level), they are not widely used by common users due to the large storage requirements. Very recent works propose to compress raw images by…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Yufei Wang , Yi Yu , Wenhan Yang , Lanqing Guo , Lap-Pui Chau , Alex Kot , Bihan Wen

Metric learning is a fundamental problem in computer vision whereby a model is trained to learn a semantically useful embedding space via ranking losses. Traditionally, the effectiveness of a ranking loss depends on the minibatch size, and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Thalaiyasingam Ajanthan , Matt Ma , Anton van den Hengel , Stephen Gould

In deep learning, embeddings are widely used to represent categorical entities such as words, apps, and movies. An embedding layer maps each entity to a unique vector, causing the layer's memory requirement to be proportional to the number…

Machine Learning · Computer Science 2022-03-22 Niketan Pansare , Jay Katukuri , Aditya Arora , Frank Cipollone , Riyaaz Shaik , Noyan Tokgozoglu , Chandru Venkataraman

Deep learning has revolutionized many computer vision fields in the last few years, including learning-based image compression. In this paper, we propose a deep semantic segmentation-based layered image compression (DSSLIC) framework in…

Computer Vision and Pattern Recognition · Computer Science 2019-04-22 Mohammad Akbari , Jie Liang , Jingning Han