English
Related papers

Related papers: Learning Efficient Coding of Natural Images with M…

200 papers

Prediction is a fundamental capability of all living organisms, and has been proposed as an objective for learning sensory representations. Recent work demonstrates that in primate visual systems, prediction is facilitated by neural…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Xueyan Niu , Cristina Savin , Eero P. Simoncelli

Implicit Neural Representations (INRs) aim to parameterize discrete signals through implicit continuous functions. However, formulating each image with a separate neural network~(typically, a Multi-Layer Perceptron (MLP)) leads to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Wenyong Zhou , Taiqiang Wu , Zhengwu Liu , Yuxin Cheng , Chen Zhang , Ngai Wong

Implicit Neural Representations (INRs) are widely used to encode data as continuous functions, enabling the visualization of large-scale multivariate scientific simulation data with reduced memory usage. However, existing INR-based methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Hyunsoo Son , Jeonghyun Noh , Suemin Jeon , Chaoli Wang , Won-Ki Jeong

Multilinear Compressive Learning (MCL) is an efficient signal acquisition and learning paradigm for multidimensional signals. The level of signal compression affects the detection or classification performance of a MCL model, with higher…

Computer Vision and Pattern Recognition · Computer Science 2021-09-06 Dat Thanh Tran , Moncef Gabbouj , Alexandros Iosifidis

Displaying the large number of bands in a hyper- spectral image (HSI) on a trichromatic monitor is important for HSI processing and analysis system. The visualized image shall convey as much information as possible from the original HSI and…

Computer Vision and Pattern Recognition · Computer Science 2017-12-06 Danping Liao , Yuntao Qian , Yuan Yan Tang

Classical metric and non-metric multidimensional scaling (MDS) variants are widely known manifold learning (ML) methods which enable construction of low dimensional representation (projections) of high dimensional data inputs. However,…

Data Analysis, Statistics and Probability · Physics 2014-06-16 Denis Horvath , Jozef Ulicny , Branislav Brutovsky

Analyzing high-dimensional data with manifold learning algorithms often requires searching for the nearest neighbors of all observations. This presents a computational bottleneck in statistical manifold learning when observations of…

Machine Learning · Computer Science 2022-03-11 Fan Cheng , Anastasios Panagiotelis , Rob J Hyndman

Recently, the Multilinear Compressive Learning (MCL) framework was proposed to efficiently optimize the sensing and learning steps when working with multidimensional signals, i.e. tensors. In Compressive Learning in general, and in MCL in…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Dat Thanh Tran , Moncef Gabbouj , Alexandros Iosifidis

The recently proposed Multilinear Compressive Learning (MCL) framework combines Multilinear Compressive Sensing and Machine Learning into an end-to-end system that takes into account the multidimensional structure of the signals when…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Dat Thanh Tran , Moncef Gabbouj , Alexandros Iosifidis

Human observers can learn to recognize new categories of images from a handful of examples, yet doing so with artificial ones remains an open challenge. We hypothesize that data-efficient recognition is enabled by representations which make…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Olivier J. Hénaff , Aravind Srinivas , Jeffrey De Fauw , Ali Razavi , Carl Doersch , S. M. Ali Eslami , Aaron van den Oord

Recent advancements in deep learning-based image compression are notable. However, prevalent schemes that employ a serial context-adaptive entropy model to enhance rate-distortion (R-D) performance are markedly slow. Furthermore, the…

Applications · Statistics 2024-03-25 Haisheng Fu , Feng Liang , Jie Liang , Zhenman Fang , Guohe Zhang , Jingning Han

Masking strategies commonly employed in natural language processing are still underexplored in vision tasks such as concept learning, where conventional methods typically rely on full images. However, using masked images diversifies…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Yuwei Sun , Lu Mi , Ippei Fujisawa , Ruiqiao Mei , Jimin Chen , Siyu Zhu , Ryota Kanai

This paper investigates, from information theoretic grounds, a learning problem based on the principle that any regularity in a given dataset can be exploited to extract compact features from data, i.e., using fewer bits than needed to…

Machine Learning · Statistics 2018-11-14 Matías Vera , Leonardo Rey Vega , Pablo Piantanida

Recent work has shown that learned image compression strategies can outperform standard hand-crafted compression algorithms that have been developed over decades of intensive research on the rate-distortion trade-off. With growing…

Image and Video Processing · Electrical Eng. & Systems 2021-11-04 Felipe Codevilla , Jean Gabriel Simard , Ross Goroshin , Chris Pal

A fundamental cognitive process is the ability to map value and identity onto objects as we learn about them. Exactly how such mental constructs emerge and what kind of space best embeds this mapping remains incompletely understood. Here we…

Neurons and Cognition · Quantitative Biology 2019-05-31 Evelyn Tang , Marcelo G. Mattar , Chad Giusti , Sharon L. Thompson-Schill , Danielle S. Bassett

Self-supervised learning (SSL) plays a central role in molecular representation learning. Yet, many recent innovations in masking-based pretraining are introduced as heuristics and lack principled evaluation, obscuring which design choices…

Machine Learning · Computer Science 2025-12-09 Jiannan Yang , Veronika Thost , Tengfei Ma

To date a number of studies have shown that receptive field shapes of early sensory neurons can be reproduced by optimizing coding efficiency of natural stimulus ensembles. A still unresolved question is whether the efficient coding…

Neurons and Cognition · Quantitative Biology 2014-03-18 Wiktor Mlynarski

Image compression emerges as a pivotal tool in the efficient handling and transmission of digital images. Its ability to substantially reduce file size not only facilitates enhanced data storage capacity but also potentially brings…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Justin Yang , Zhihao Duan , Andrew Peng , Yuning Huang , Jiangpeng He , Fengqing Zhu

Self-supervised learning (SSL) has shown impressive results in downstream classification tasks. However, there is limited work in understanding their failure modes and interpreting their learned representations. In this paper, we study the…

Machine Learning · Computer Science 2023-12-14 Neha Kalibhat , Kanika Narang , Hamed Firooz , Maziar Sanjabi , Soheil Feizi

We propose an end-to-end learned image compression codec wherein the analysis transform is jointly trained with an object classification task. This study affirms that the compressed latent representation can predict human perceptual…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Chen-Hsiu Huang , Ja-Ling Wu