English
Related papers

Related papers: A Generalized Typicality for Abstract Alphabets

200 papers

Language modeling, a central task in natural language processing, involves estimating a probability distribution over strings. In most cases, the estimated distribution sums to 1 over all finite strings. However, in some pathological cases,…

Computation and Language · Computer Science 2023-08-23 Li Du , Lucas Torroba Hennigen , Tiago Pimentel , Clara Meister , Jason Eisner , Ryan Cotterell

Density aggregation is a central problem in machine learning, for instance when combining predictions from a Deep Ensemble. The choice of aggregation remains an open question with two commonly proposed approaches being linear pooling…

In this paper we consider the axiomatic characterization of information and certainty measures in a unified way. We present the general axiomatic system which captures the common properties of a large number of the measures previously…

Information Theory · Computer Science 2015-06-17 Velimir M. Ilic , Miomir S. Stankovic

Measurability with respect to ideals is tightly connected with absoluteness principles for certain forcing notions. We study a uniformization principle that postulates the existence of a uniformizing function on a large set, relative to a…

Logic · Mathematics 2022-05-31 Sandra Müller , Philipp Schlicht

An infinite log-gas formalism, due to Dyson, and independently Fogler and Shklovskii, is applied to the computation of conditioned gap probabilities at the hard and soft edges of random matrix $\beta$-ensembles. The conditioning is that…

Mathematical Physics · Physics 2015-05-30 Peter J. Forrester , Nicholas S. Witte

Estimation of density functions supported on general domains arises when the data is naturally restricted to a proper subset of the real space. This problem is complicated by typically intractable normalizing constants. Score matching…

Methodology · Statistics 2020-09-25 Shiqing Yu , Mathias Drton , Ali Shojaie

In this paper we introduce generalised Markov numbers and extend the classical Markov theory for the discrete Markov spectrum to the case of generalised Markov numbers. In particular we show recursive properties for these numbers and find…

Number Theory · Mathematics 2018-09-07 Oleg Karpenkov , Matty van-Son

We give a simple proof of the splitting lemma in singularity theory, also known as generalized Morse lemma, for formal power series over arbitrary fields. Our proof for the uniqueness of the residual part in any characteristic is new and…

Algebraic Geometry · Mathematics 2025-11-18 Gert-Martin Greuel , Gerhard Pfister

Recently, metric learning and similarity learning have attracted a large amount of interest. Many models and optimisation algorithms have been proposed. However, there is relatively little work on the generalization analysis of such…

Machine Learning · Computer Science 2013-03-19 Qiong Cao , Zheng-Chu Guo , Yiming Ying

One of the main concepts in quantum physics is a density matrix, which is a symmetric positive definite matrix of trace one. Finite probability distributions can be seen as a special case when the density matrix is restricted to be…

Quantum Physics · Physics 2009-01-12 Manfred K Warmuth , Dima Kuzmin

Classical probability theory supports probability measures, assigning a fixed positive real value to each event, these measures are far from satisfactory in formulating real-life occurrences. The main innovation of this paper is the…

Probability · Mathematics 2009-02-09 Yehuda Izhakian , Zur Izhakian

The paper proposes another extension of the extremal principle. A new extremality model involving collections of arbitrary families of sets is studied. It generalizes the conventional model based on linear translations of given sets as well…

Optimization and Control · Mathematics 2024-09-04 Nguyen Duy Cuong , Alexander Y. Kruger , Nguyen Hieu Thao

We generalize the measurement using an expanded concept of cover, in order to provide a new approach to size of set other than cardinality. The generalized measurement has application backgrounds such as a generalized problem in dimension…

General Mathematics · Mathematics 2012-11-13 Hua-Rong Peng , Da-Hai Li , Qiong-Hua Wang

We derive a new class of statistical tests for generalized linear models based on thresholding point estimators. These tests can be employed whether the model includes more parameters than observations or not. For linear models, our tests…

Methodology · Statistics 2018-03-14 Sylvain Sardy , Caroline Giacobino , Jairo Diaz-Rodriguez

Generalized Feller theory provides an important analog to Feller theory beyond locally compact state spaces. This is very useful for solutions of certain stochastic partial differential equations, Markovian lifts of fractional processes, or…

Probability · Mathematics 2023-08-09 Christa Cuchiero , Tonio Möllmann , Josef Teichmann

We generalize subgraph densities, arising in dense graph limit theory, to Markov spaces (symmetric measures on the square of a standard Borel space). More generally, we define an analogue of the set of homomorphisms in the form of a measure…

Probability · Mathematics 2023-11-13 Dávid Kunszenti-Kovács , László Lovász , Balázs Szegedy

If $\Lambda $ is a measure space, $u:\Lambda ^{m}\rightarrow \Bbb{R}$ is a given function and $N\geq m,$ the function $U(x_{1},...,x_{N})=\left( \begin{array}{l} N \\ m \end{array} \right) ^{-1}\sum_{1\leq i_{1}<\cdots <i_{m}\leq…

Functional Analysis · Mathematics 2015-01-14 Irina Navrotskaya , Patrick J. Rabier

This technical report presents a general framework for parsing a variety of grammar formalisms. We develop a grammar formalism, called an Abstract Grammar, which is general enough to represent grammars at many levels of the hierarchy,…

Computation and Language · Computer Science 2018-01-22 Daniel Harasim , Chris Bruno , Eva Portelance , Martin Rohrmeier , Timothy J. O'Donnell

In Monoidal Computer I, we introduced a categorical model of computation where the formal reasoning about computability was supported by the simple and popular diagrammatic language of string diagrams. In the present paper, we refine and…

Logic in Computer Science · Computer Science 2014-02-25 Dusko Pavlovic

Bell tests are of profound statistical nature. Besides physical considerations, the proper understanding of their implications should involve detailed statistical analyses. In this regard, recent works have shown that their consequences and…

Quantum Physics · Physics 2025-06-10 Alfredo Luis