English
Related papers

Related papers: The Minimum Description Length Principle and Model…

200 papers

A set of molecular descriptors whose length is independent of molecular size is developed for machine learning models that target thermodynamic and electronic properties of molecules. These features are evaluated by monitoring performance…

Using predictive adaptive arithmetic coding and the Minimum Description Length principle, we derive an efficient tool for model selection problems : the RIC information criterion. We then present an extension of these coding techniques to…

Methodology · Statistics 2007-05-23 Guilhem Coq , Olivier Alata , Marc Arnaudon , Christian Olivier

We prove that the Minimum Description Length learning rule exhibits tempered overfitting. We obtain tempered agnostic finite sample learning guarantees and characterize the asymptotic behavior in the presence of random label noise.

Machine Learning · Computer Science 2023-02-15 Naren Sarayu Manoj , Nathan Srebro

The minimum description length (MDL) principle states that the best model to account for some data minimizes the sum of the lengths, in bits, of the descriptions of the model and the residual error. The description length is thus a…

Quantitative Methods · Quantitative Biology 2015-07-21 Peter T. Hraber , Bette T. Korber , Steven Wolinsky , Henry A. Erlich , Elizabeth A. Trachtenberg , Thomas B. Kepler

The (non-)equivalence of canonical and microcanonical ensembles is a fundamental question in statistical physics, concerning whether the use of soft and hard constraints in the maximum-entropy construction leads to the same description of a…

Statistical Mechanics · Physics 2025-11-25 Francesca Giuffrida , Tiziano Squartini , Peter Grünwald , Diego Garlaschelli

An ideal outcome of pattern mining is a small set of informative patterns, containing no redundancy or noise, that identifies the key structure of the data at hand. Standard frequent pattern miners do not achieve this goal, as due to the…

Data Structures and Algorithms · Computer Science 2019-02-11 Nikolaj Tatti , Jilles Vreeken

A prescription to calculate the minimum number of bits needed for binary strip detector readout is presented. This permits a systematic analysis of the readout efficiency relative to this theoretical minimum number of bits. Different level…

Instrumentation and Detectors · Physics 2015-06-17 Maurice Garcia-Sciveres , Xinkang Wang

We provide a complete characterization of the entire regularization curve of a modified two-part-code Minimum Description Length (MDL) learning rule for binary classification, based on an arbitrary prior or description language. Grunwald…

Machine Learning · Statistics 2025-03-12 Xiaohan Zhu , Nathan Srebro

Approximation of the optimal two-part MDL code for given data, through successive monotonically length-decreasing two-part MDL codes, has the following properties: (i) computation of each step may take arbitrarily long; (ii) we may not know…

Machine Learning · Computer Science 2008-09-15 Pieter Adriaans , Paul Vitanyi

Graphs are a popular data type found in many domains. Numerous techniques have been proposed to find interesting patterns in graphs to help understand the data and support decision-making. However, there are generally two limitations that…

Artificial Intelligence · Computer Science 2022-04-28 Jiahong Liu , Min Zhou , Philippe Fournier-Viger , Menglin Yang , Lujia Pan , Mourad Nouioua

Symbolic regression is the machine learning method for learning functions from data. After a brief overview of the symbolic regression landscape, I will describe the two main challenges that traditional algorithms face: they have an unknown…

Instrumentation and Methods for Astrophysics · Physics 2025-07-18 Harry Desmond

The minimum description length (MDL) principle in supervised learning is studied. One of the most important theories for the MDL principle is Barron and Cover's theory (BC theory), which gives a mathematical justification of the MDL…

Information Theory · Computer Science 2016-07-12 Masanori Kawakita , Jun'ichi Takeuchi

Principal component analysis (PCA) is perhaps the most widely used method for data dimensionality reduction. A key question in PCA is deciding how many factors to retain. This manuscript describes a new approach to automatically selecting…

Methodology · Statistics 2026-02-10 Enes Makalic , Daniel F. Schmidt

We introduce a method to determine if a certain capability helps to achieve an accurate model of given data. We view labels as being generated from the inputs by a program composed of subroutines with different capabilities, and we posit…

Machine Learning · Computer Science 2021-03-08 Ethan Perez , Douwe Kiela , Kyunghyun Cho

Statistical shape models enhance machine learning algorithms providing prior information about deformation. A Point Distribution Model (PDM) is a popular landmark-based statistical shape model for segmentation. It requires choosing a model…

Machine Learning · Computer Science 2018-08-02 Alma Eguizabal , Peter J. Schreier , David Ramírez

To learn intrinsic low-dimensional structures from high-dimensional data that most discriminate between classes, we propose the principle of Maximal Coding Rate Reduction ($\text{MCR}^2$), an information-theoretic measure that maximizes the…

Machine Learning · Computer Science 2020-06-16 Yaodong Yu , Kwan Ho Ryan Chan , Chong You , Chaobing Song , Yi Ma

A major challenge in designing efficient statistical supervised learning algorithms is finding representations that perform well not only on available training samples but also on unseen data. While the study of representation learning has…

Machine Learning · Statistics 2024-02-06 Milad Sefidgaran , Abdellatif Zaidi , Piotr Krasnowski

Minimum message length is a general Bayesian principle for model selection and parameter estimation that is based on information theory. This paper applies the minimum message length principle to a small-sample model selection problem…

Methodology · Statistics 2018-02-13 Chi Kuen Wong , Enes Makalic , Daniel F. Schmidt

Why heavily parameterized neural networks (NNs) do not overfit the data is an important long standing open question. We propose a phenomenological model of the NN training to explain this non-overfitting puzzle. Our linear frequency…

Machine Learning · Computer Science 2021-05-26 Yaoyu Zhang , Tao Luo , Zheng Ma , Zhi-Qin John Xu

State-of-the-art NLP methods achieve human-like performance on many tasks, but make errors nevertheless. Characterizing these errors in easily interpretable terms gives insight into whether a classifier is prone to making systematic errors,…

Computation and Language · Computer Science 2023-11-21 Michael A. Hedderich , Jonas Fischer , Dietrich Klakow , Jilles Vreeken