Related papers: Grade Inflation in Generative Models
The methods of effective field theory are used to study generic theories of inflation with a single inflaton field. For scalar modes, the leading corrections to the ${\cal R}$ correlation function are found to be purely of the $k$-inflation…
Current studies on adversarial robustness mainly focus on aggregating local robustness results from a set of data samples to evaluate and rank different models. However, the local statistics may not well represent the true global robustness…
Large classes of standard single-field slow-roll inflationary models consistent with the required number of e-folds, the current bounds on the spectral index of scalar perturbations, the tensor-to-scalar ratio, and the scale of inflation…
Information theoretic quantities play a central role in machine learning. The recent surge in the complexity of data and models has increased the demand for accurate estimation of these quantities. However, as the dimension grows the…
The CMIP3 multi-model ensemble spread most likely underestimates the real model uncertainty in future climate predictions because of the similarity, and shared defects, of the models in the ensemble. To generate an appropriate level of…
We discuss the entropy and the size/homogeneity/horizon problems in power-law expanding universes with one scale initial conditions. We set the minimal scale $\Lambda = 10^{25}$ GeV at which a non-inflationary solution is possible and show…
A unified approach to quintessence and inflation is investigated with the use of a single scalar field. It is argued that successful potentials have to approximate a combination of exponential and inverse power-law decline in the limit of…
We identify empirical scaling laws for the cross-entropy loss in four domains: generative image modeling, video modeling, multimodal image$\leftrightarrow$text models, and mathematical problem solving. In all cases autoregressive…
Probabilistic generative models provide a powerful framework for representing data that avoids the expense of manual annotation typically needed by discriminative approaches. Model selection in this generative setting can be challenging,…
Human ratings have become a crucial resource for training and evaluating machine learning systems. However, traditional elicitation methods for absolute and comparative rating suffer from issues with consistency and often do not distinguish…
This paper introduces an algorithm to select demonstration examples for in-context learning of a query set. Given a set of $n$ examples, how can we quickly select $k$ out of $n$ to best serve as the conditioning for downstream inference?…
Graph neural networks (GNNs) extend convolutional neural networks (CNNs) to graph-based data. A question that arises is how much performance improvement does the underlying graph structure in the GNN provide over the CNN (that ignores this…
Gradient-based attribution methods aim to explain decisions of deep learning models but so far lack identifiability guarantees. Here, we propose a method to generate attribution maps with identifiability guarantees by developing a…
Attention head pruning has emerged as an effective technique for transformer model compression, an increasingly important goal in the era of Green AI. However, existing pruning methods often rely on static importance scores, which fail to…
This paper explores the theoretical foundations of fair regression under the constraint of demographic parity within the unawareness framework, where disparate treatment is prohibited, extending existing results where such treatment is…
Generative models, as a powerful technique for generation, also gradually become a critical tool for recognition tasks. However, in skeleton-based action recognition, the features obtained from existing pre-trained generative methods…
Popular wisdom suggests that measuring the tensor to scalar ratio $r$ on CMB scales is a "proof of inflation" since one generic prediction is a scale-invariant tensor spectrum while alternatives predict $r$ that is many orders of magnitude…
Investing in urban green schoolyards is becoming more popular around the world because they could enhance health, education, and community outcomes. There is still considerable debate regarding the impact of urban green schoolyards on…
Gradient boosting of regression trees is a competitive procedure for learning predictive models of continuous data that fits the data with an additive non-parametric model. The classic version of gradient boosting assumes that the data is…
A general approach to viable modified $f(R)$ gravity is developed in both the Jordan and the Einstein frames. A class of exponential, realistic modified gravities is introduced and investigated with care. Special focus is made on step-class…