English
Related papers

Related papers: Information-computation trade-offs in non-linear t…

200 papers

Recently, many neural network-based image compression methods have shown promising results superior to the existing tool-based conventional codecs. However, most of them are often trained as separate models for different target bit rates,…

Image and Video Processing · Electrical Eng. & Systems 2022-11-09 Jooyoung Lee , Seyoon Jeong , Munchurl Kim

Models for image representation learning are typically designed for either recognition or generation. Various forms of contrastive learning help models learn to convert images to embeddings that are useful for classification, detection, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Matthew Gwilliam , Xiao Wang , Xuefeng Hu , Zhenheng Yang

In-context learning (ICL) enables large language models (LLMs) to adapt to new tasks without weight updates by learning from demonstration sequences. While ICL shows strong empirical performance, its internal representational mechanisms are…

Computation and Language · Computer Science 2025-10-07 Jiachen Jiang , Yuxin Dong , Jinxin Zhou , Zhihui Zhu

Dimensionality reduction techniques are fundamental for analyzing and visualizing high-dimensional data. With established methods like t-SNE and PCA presenting a trade-off between representational power and interpretability. This paper…

Machine Learning · Computer Science 2025-04-25 Erik Bergh

Storing and transmitting LiDAR point cloud data is essential for many AV applications, such as training data collection, remote control, cloud services or SLAM. However, due to the sparsity and unordered structure of the data, it is…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Till Beemelmanns , Yuchen Tao , Bastian Lampe , Lennart Reiher , Raphael van Kempen , Timo Woopen , Lutz Eckstein

A new run length encoding algorithm for lossless data compression that exploits positional redundancy by representing data in a two-dimensional model of concentric circles is presented. This visual transform enables detection of runs (each…

Data Structures and Algorithms · Computer Science 2021-07-30 Pranav Venkatram

We consider lossless compression based on statistical data modeling followed by prediction-based encoding, where an accurate statistical model for the input data leads to substantial improvements in compression. We propose DZip, a…

Machine Learning · Computer Science 2020-09-21 Mohit Goyal , Kedar Tatwawadi , Shubham Chandak , Idoia Ochoa

Lossy image compression networks aim to minimize the latent entropy of images while adhering to specific distortion constraints. However, optimizing the neural network can be challenging due to its nature of learning quantized latent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Yingwen Zhang , Meng Wang , Xihua Sheng , Peilin Chen , Junru Li , Li Zhang , Shiqi Wang

Perceptual image compression has shown strong potential for producing visually appealing results at low bitrates, surpassing classical standards and pixel-wise distortion-oriented neural methods. However, existing methods typically improve…

Image and Video Processing · Electrical Eng. & Systems 2025-02-21 Hao Wei , Yanhui Zhou , Yiwen Jia , Chenyang Ge , Saeed Anwar , Ajmal Mian

The extensive adoption of Deep Neural Networks has led to their increased utilization in challenging scientific visualization tasks. Recent advancements in building compressed data models using implicit neural representations have shown…

Machine Learning · Computer Science 2025-10-20 Abhay Kumar Dwivedi , Shanu Saklani , Soumya Dutta

Learned image compression sits at the intersection of machine learning and image processing. With advances in deep learning, neural network-based compression methods have emerged. In this process, an encoder maps the image to a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Fabien Allemand , Attilio Fiandrotti , Sumanta Chaudhuri , Alaa Eddine Mazouz

Neural image compression, necessary in various machine-to-machine communication scenarios, suffers from its heavy encode-decode structures and inflexibility in switching between different compression levels. Consequently, it raises…

Image and Video Processing · Electrical Eng. & Systems 2025-05-15 Yu Mao , Jingzong Li , Jun Wang , Hong Xu , Tei-Wei Kuo , Nan Guan , Chun Jason Xue

Recently, learned image compression methods have outperformed traditional hand-crafted ones including BPG. One of the keys to this success is learned entropy models that estimate the probability distribution of the quantized latent…

Image and Video Processing · Electrical Eng. & Systems 2022-07-22 Jun-Hyuk Kim , Byeongho Heo , Jong-Seok Lee

Implicit neural representations (INRs) recently achieved great success in image representation and compression, offering high visual quality and fast rendering speeds with 10-1000 FPS, assuming sufficient GPU resources are available.…

Image and Video Processing · Electrical Eng. & Systems 2024-07-10 Xinjie Zhang , Xingtong Ge , Tongda Xu , Dailan He , Yan Wang , Hongwei Qin , Guo Lu , Jing Geng , Jun Zhang

In the context of lossy compression, Blau & Michaeli (2019) adopt a mathematical notion of perceptual quality and define the information rate-distortion-perception function, generalizing the classical rate-distortion tradeoff. We consider…

Information Theory · Computer Science 2021-12-23 George Zhang , Jingjing Qian , Jun Chen , Ashish Khisti

Data assimilation is crucial in a wide range of applications, but it often faces challenges such as high computational costs due to data dimensionality and incomplete understanding of underlying mechanisms. To address these challenges, this…

Machine Learning · Computer Science 2024-03-26 Zhuoyuan Li , Bin Dong , Pingwen Zhang

Neural compression is the application of neural networks and other machine learning methods to data compression. Recent advances in statistical machine learning have opened up new possibilities for data compression, allowing compression…

Machine Learning · Computer Science 2023-08-22 Yibo Yang , Stephan Mandt , Lucas Theis

Decoding remote sensing images to achieve high perceptual quality, particularly at low bitrates, remains a significant challenge. To address this problem, we propose the invertible neural network-based remote sensing image compression…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Junhui Li , Xingsong Hou

Many common types of data can be represented as functions that map coordinates to signal values, such as pixel locations to RGB values in the case of an image. Based on this view, data can be compressed by overfitting a compact neural…

Machine Learning · Computer Science 2023-10-31 Zongyu Guo , Gergely Flamich , Jiajun He , Zhibo Chen , José Miguel Hernández-Lobato

We propose a new simple approach for image compression: instead of storing the RGB values for each pixel of an image, we store the weights of a neural network overfitted to the image. Specifically, to encode an image, we fit it with an MLP…

Image and Video Processing · Electrical Eng. & Systems 2021-04-13 Emilien Dupont , Adam Goliński , Milad Alizadeh , Yee Whye Teh , Arnaud Doucet