English
Related papers

Related papers: Generalizing the Mean and Variance to Categorical …

200 papers

Contextual type theory distinguishes between bound variables and meta-variables to write potentially incomplete terms in the presence of binders. It has found good use as a framework for concise explanations of higher-order unification,…

Logic in Computer Science · Computer Science 2011-11-02 Mathieu Boespflug , Brigitte Pientka

Message passing neural networks (MPNN) have seen a steep rise in popularity since their introduction as generalizations of convolutional neural networks to graph-structured data, and are now considered state-of-the-art tools for solving a…

Machine Learning · Computer Science 2022-08-05 Sohir Maskey , Ron Levie , Yunseok Lee , Gitta Kutyniok

The sample median is often used in statistical analyses of physical or astronomical data wherein a central value must be found from samples polluted by elements which do not belong to the population of interest or when the underlying…

Data Analysis, Statistics and Probability · Physics 2008-04-04 Jean-Michel Levy

A method of quantizing parametrized systems is developed that is based on a kind of ``gauge invariant'' quantities---the so-called perennials (a perennial must also be an ``integral of motion''). The problem of time in its particular form…

General Relativity and Quantum Cosmology · Physics 2009-10-22 P. Hajicek

We introduce a framework for uncertainty estimation that both describes and extends many existing methods. We consider typical hyperparameters involved in classical training as random variables and marginalise them out to capture various…

Machine Learning · Computer Science 2021-07-07 Francesco Farina , Lawrence Phillips , Nicola J Richmond

Despite the celebrated popularity of Graph Neural Networks (GNNs) across numerous applications, the ability of GNNs to generalize remains less explored. In this work, we propose to study the generalization of GNNs through a novel…

Machine Learning · Computer Science 2024-04-17 Shouheng Li , Dongwoo Kim , Qing Wang

Ensuring robust model performance in diverse real-world scenarios requires addressing generalizability across domains with covariate shifts. However, no formal procedure exists for statistically evaluating generalizability in machine…

Machine Learning · Computer Science 2025-06-13 Daniel de Vassimon Manela , Linying Yang , Robin J. Evans

Within the machine learning community, the widely-used uniform convergence framework has been used to answer the question of how complex, over-parameterized models can generalize well to new data. This approach bounds the test error of the…

Machine Learning · Statistics 2021-03-05 Ryan Theisen , Jason M. Klusowski , Michael W. Mahoney

We are now witnessing a rapid growth of a new part of group theory which has become known as "statistical group theory". A typical result in this area would say something like ``a random element (or a tuple of elements) of a group G has a…

Group Theory · Mathematics 2007-05-23 Alexandre V. Borovik , Alexei G. Myasnikov , Vladimir Shpilrain

We express the mean and variance terms in a double exponential regression model as additive functions of the predictors and use Bayesian variable selection to determine which predictors enter the model, and whether they enter linearly or…

Methodology · Statistics 2007-07-17 Remy Cottet , Robert Kohn , David Nott

Markov categories are a novel framework to describe and treat problems in probability and information theory. In this work we combine the categorical formalism with the traditional quantitative notions of entropy, mutual information, and…

Information Theory · Computer Science 2024-04-15 Paolo Perrone

Generalized contextuality is a possible indicator of non-classical behaviour in quantum information theory. In finite-dimensional systems, this is justified by the fact that noncontextual theories can be embedded into some simplex, i.e.…

The paper presents a construction of a quantitative measure of variability for parameter estimates in the data fitting problem under interval uncertainty. It shows the degree of variability and ambiguity of the estimate, and the need for…

Numerical Analysis · Mathematics 2020-03-12 Sergey P. Shary

Deep metric learning is often used to learn an embedding function that captures the semantic differences within a dataset. A key factor in many problem domains is how this embedding generalizes to new classes of data. In observing many…

Machine Learning · Computer Science 2019-09-18 Xiaotong Liu , Hong Xuan , Zeyu Zhang , Abby Stylianou , Robert Pless

Variational inference with a factorized Gaussian posterior estimate is a widely used approach for learning parameters and hidden variables. Empirically, a regularizing effect can be observed that is poorly understood. In this work, we show…

Machine Learning · Computer Science 2019-09-04 Julius Kunze , Louis Kirsch , Hippolyt Ritter , David Barber

The Chernoff bound is a well-known tool for obtaining a high probability bound on the expectation of a Bernoulli random variable in terms of its sample average. This bound is commonly used in statistical learning theory to upper bound the…

Machine Learning · Statistics 2022-05-18 Andrew Y. K. Foong , Wessel P. Bruinsma , David R. Burt

The Median of Means (MoM) is a mean estimator that has gained popularity in the context of heavy-tailed data. In this work, we analyze its performance in the task of simultaneously estimating the mean of each function in a class…

Machine Learning · Statistics 2025-06-23 Mikael Møller Høgsgaard , Andrea Paudice

Machine learning algorithms are increasingly used to inform critical decisions. There is a growing concern about bias, that algorithms may produce uneven outcomes for individuals in different demographic groups. In this work, we measure…

Machine Learning · Computer Science 2021-06-01 Runshan Fu , Yangfan Liang , Peter Zhang

Bayesian inference and kernel methods are well established in machine learning. The neural network Gaussian process in particular provides a concept to investigate neural networks in the limit of infinitely wide hidden layers by using…

Disordered Systems and Neural Networks · Physics 2023-11-10 Javed Lindner , David Dahmen , Michael Krämer , Moritz Helias

This paper introduces a novel annotation framework for the fine-grained modeling of Noun Phrases' (NPs) genericity in natural language. The framework is designed to be simple and intuitive, making it accessible to non-expert annotators and…

Computation and Language · Computer Science 2024-04-02 Claudia Collacciani , Andrea Amelio Ravelli , Marianna Marcella Bolognesi