Related papers: Inflation as an Information Bottleneck - A strateg…
We discuss relationship between inflation and various models of production of density inhomogeneities due to strings, global monopoles, textures and other topological and non-topological defects. Neither of these models leads to a…
This study revisits label smoothing via a form of information bottleneck. Under the assumption of sufficient model flexibility and no conflicting labels for the same input, we theoretically and experimentally demonstrate that the model…
We introduce a bottleneck method for learning data representations based on information deficiency, rather than the more traditional information sufficiency. A variational upper bound allows us to implement this method efficiently. The…
While inflation gives an appealing explanation of observed cosmological data, there are a wide range of different inflation models, providing differing predictions for the initial perturbations. Typically models are motivated either by…
Interpretability is a pressing issue for machine learning. Common approaches to interpretable machine learning constrain interactions between features of the input, rendering the effects of those features on a model's output comprehensible…
Probabilities in eternal inflation are traditionally defined as limiting frequency distributions, but a unique and unambiguous probability measure remains elusive. In this paper, we present a different approach, based on Bayesian reasoning.…
We review the main aspects of the warm inflation scenario, focusing on the inflationary dynamics and the predictions related to the primordial spectrum of perturbations, to be compared with the recent cosmological observations. We study in…
A general information equilibrium model in the case of ideal information transfer is defined and then used to derive the relationship between supply (information destination) and demand (information source) with the price as the detector of…
Information bottleneck (IB) is a paradigm to extract information in one target random variable from another relevant random variable, which has aroused great interest due to its potential to explain deep neural networks in terms of…
The information bottleneck (IB) method is a technique designed to extract meaningful information related to one random variable from another random variable, and has found extensive applications in machine learning problems. In this paper,…
Following the 2015 Planck release, we briefly comment on the status and some ongoing opportunities in the interface between inflationary cosmology, string theory, and CMB data. The constraints in the $r$-$n_s$ plane introduce a new…
Eternal inflation is a seemingly generic consequence of theories that give rise to accelerated expansion of the universe and possess multiple vacuum states. Making predictions in an eternally inflating universe is notoriously difficult…
The information bottleneck (IB) method is a technique for extracting information that is relevant for predicting the target random variable from the source random variable, which is typically implemented by optimizing the IB Lagrangian that…
The information bottleneck principle provides an information-theoretic method for representation learning, by training an encoder to retain all information which is relevant for predicting the label while minimizing the amount of other,…
With present and future observations becoming of higher and higher quality, it is timely and necessary to investigate the most significant theoretical uncertainties in the predictions of inflation. We show that our ignorance of the entire…
A well-interpretable measure of information has been recently proposed based on a partition obtained by intersecting a random sequence with its moving average. The partition yields disjoint sets of the sequence, which are then ranked…
An appealing explanation for the Planck data is provided by inflationary models with a singular non-canonical kinetic term: a Laurent expansion of the kinetic function translates into a potential with a nearly shift-symmetric plateau in…
These lectures cover the theoretical structure and phenomenology of some basic mechanisms for inflation. A full treatment of the problem requires `ultraviolet completion' because of the sensitivity of inflation to quantum gravity effects,…
Classifying inflationary scenarios according to their scaling properties is a powerful way to connect theory with observations. A useful tool to make such a classification is the beta-function formalism. By describing inflation in terms of…
In this work, we generalize the information bottleneck (IB) approach to the multi-view learning context. The exponentially growing complexity of the optimal representation motivates the development of two novel formulations with more…