English
Related papers

Related papers: Minimum Description Length codes are critical

200 papers

Approximation of the optimal two-part MDL code for given data, through successive monotonically length-decreasing two-part MDL codes, has the following properties: (i) computation of each step may take arbitrarily long; (ii) we may not know…

Machine Learning · Computer Science 2008-09-15 Pieter Adriaans , Paul Vitanyi

To learn intrinsic low-dimensional structures from high-dimensional data that most discriminate between classes, we propose the principle of Maximal Coding Rate Reduction ($\text{MCR}^2$), an information-theoretic measure that maximizes the…

Machine Learning · Computer Science 2020-06-16 Yaodong Yu , Kwan Ho Ryan Chan , Chong You , Chaobing Song , Yi Ma

This paper introduces a new method for model selection and more generally hyperparameter selection in machine learning. Minimum description length (MDL) is an established method for model selection, which is however not directly aimed at…

Machine Learning · Computer Science 2019-05-23 Mojtaba Abolfazli , Anders Host-Madsen , June Zhang

Using predictive adaptive arithmetic coding and the Minimum Description Length principle, we derive an efficient tool for model selection problems : the RIC information criterion. We then present an extension of these coding techniques to…

Methodology · Statistics 2007-05-23 Guilhem Coq , Olivier Alata , Marc Arnaudon , Christian Olivier

Deep neural networks trained through end-to-end learning have achieved remarkable success across various domains in the past decade. However, the end-to-end learning strategy, originally designed to minimize predictive loss in a black-box…

Machine Learning · Computer Science 2025-06-11 Canlin Zhang , Xiuwen Liu

The Minimum Description Length principle for online sequence estimation/prediction in a proper learning setup is studied. If the underlying model class is discrete, then the total expected square loss is a particularly interesting…

Statistics Theory · Mathematics 2007-07-16 Jan Poland , Marcus Hutter

In this correspondence, we focus on the performance analysis of the widely-used minimum description length (MDL) source enumeration technique in array processing. Unfortunately, available theoretical analysis exhibit deviation from the…

Information Theory · Computer Science 2015-05-13 Farzan Haddadi , Mohammadreza Malekmohammadi , Mohammad Mahdi Nayebi , Mohammad Reza Aref

We study neural network compressibility by using singular learning theory to extend the minimum description length (MDL) principle to singular models like neural networks. Through extensive experiments on the Pythia suite with quantization,…

Machine Learning · Statistics 2025-10-15 Einar Urdshals , Edmund Lau , Jesse Hoogland , Stan van Wingerden , Daniel Murfet

The relationship between the Bayesian approach and the minimum description length approach is established. We sharpen and clarify the general modeling principles MDL and MML, abstracted as the ideal MDL principle and defined from Bayes's…

Machine Learning · Computer Science 2007-07-16 Paul Vitanyi , Ming Li

We propose a general framework for neural network compression that is motivated by the Minimum Description Length (MDL) principle. For that we first derive an expression for the entropy of a neural network, which measures its complexity…

Machine Learning · Computer Science 2018-12-20 Simon Wiedemann , Arturo Marban , Klaus-Robert Müller , Wojciech Samek

We present the first theoretical framework that connects predictive coding (PC), a biologically inspired local learning rule, with the minimum description length (MDL) principle in deep networks. We prove that layerwise PC performs…

Machine Learning · Computer Science 2025-07-17 Benjamin Prada , Shion Matsumoto , Abdul Malik Zekri , Ankur Mali

In a world where Machine Learning (ML) is increasingly deployed to support decision-making in critical domains, providing decision-makers with explainable, stable, and relevant inputs becomes fundamental. Understanding how machine learning…

Machine Learning · Computer Science 2024-08-07 Karol Capała , Paulina Tworek , Jose Sousa

The curse of dimensionality is a widely known issue in reinforcement learning (RL). In the tabular setting where the state space $\mathcal{S}$ and the action space $\mathcal{A}$ are both finite, to obtain a nearly optimal policy with…

Machine Learning · Computer Science 2022-10-28 Bingyan Wang , Yuling Yan , Jianqing Fan

In this paper we discuss a method, which we call Minimum Conditional Description Length (MCDL), for estimating the parameters of a subset of sites within a Markov random field. We assume that the edges are known for the entire graph…

Information Theory · Computer Science 2016-02-25 Matthew G. Reyes , David L. Neuhoff

In previous work we developed a method of learning Bayesian Network models from raw data. This method relies on the well known minimal description length (MDL) principle. The MDL principle is particularly well suited to this task as it…

Artificial Intelligence · Computer Science 2013-03-08 Wai Lam , Fahiem Bacchus

We study the maximum mean discrepancy (MMD) in the context of critical transitions modelled by fast-slow stochastic dynamical systems. We establish a new link between the dynamical theory of critical transitions with the statistical aspects…

Pattern Formation and Solitons · Physics 2019-01-30 Boumediene Hamzi , Christian Kuehn , Sameh Mohamed

We consider the Minimum Description Length principle for online sequence prediction. If the underlying model class is discrete, then the total expected square loss is a particularly interesting performance measure: (a) this quantity is…

Machine Learning · Computer Science 2007-07-16 Jan Poland , Marcus Hutter

Networks are fundamental models for data used in practically every application domain. In most instances, several implicit or explicit choices about the network definition impact the translation of underlying data to a network…

Artificial Intelligence · Computer Science 2018-01-12 Ivan Brugere , Tanya Y. Berger-Wolf

Recent sequential pattern mining methods have used the minimum description length (MDL) principle to define an encoding scheme which describes an algorithm for mining the most compressing patterns in a database. We present a novel…

Machine Learning · Statistics 2016-11-14 Jaroslav Fowkes , Charles Sutton

The Minimum Description Length (MDL) principle offers a formal framework for applying Occam's razor in machine learning. However, its application to neural networks such as Transformers is challenging due to the lack of a principled,…

Machine Learning · Computer Science 2026-03-04 Peter Shaw , James Cohan , Jacob Eisenstein , Kristina Toutanova