English
Related papers

Related papers: Abstract hypernormalisation, and normalisation-by-…

200 papers

We introduce dicodensity monads: a generalisation of pointwise codensity monads generated by functors to monads generated by mixed-variant bifunctors. Our construction is based on the notion of strong dinaturality (also known as Barr…

Logic in Computer Science · Computer Science 2026-03-03 Maciej Piróg , Filip Sieczkowski

Doubly intractable models are encountered in a number of fields, e.g. social networks, ecology and epidemiology. Inference for such models requires the evaluation of a likelihood function, whose normalising factor depends on the model…

Methodology · Statistics 2025-08-25 Yu Yang , Matias Quiroz , Robert Kohn , Scott A. Sisson

Hierarchical Archimedean copulas (HACs) are multivariate uniform distributions constructed by nesting Archimedean copulas into one another, and provide a flexible approach to modeling non-exchangeable data. However, this flexibility in the…

Methodology · Statistics 2025-08-19 Samuel Perreault , Yanbo Tang , Ruyi Pan , Nancy Reid

Triplet Markov chains are general generative models for sequential data which take into account three kinds of random variables: (noisy) observations, their associated discrete labels and latent variables which aim at strengthening the…

Machine Learning · Statistics 2023-09-08 Katherine Morales , Yohan Petetin

We introduce a category-theoreticabstraction of a syntax with auxiliary functions, called an admissiblemonad morphism. Relying on an abstract form of structural recursion,we then design generic tools to construct admissible monad…

Logic in Computer Science · Computer Science 2022-04-11 Tom Hirschowitz , Ambroise Lafont

Recent work has shown that tight concentration of the entire spectrum of singular values of a deep network's input-output Jacobian around one at initialization can speed up learning by orders of magnitude. Therefore, to guide important…

Machine Learning · Statistics 2018-02-28 Jeffrey Pennington , Samuel S. Schoenholz , Surya Ganguli

In probabilistic modelling, joint distributions are often of more interest than their marginals, but the standard composition of stochastic channels is defined by marginalization. Last year at ACT, the notion of 'copy-composition' was…

Category Theory · Mathematics 2025-09-26 Toby St Clere Smithe

In computer science, especially when dealing with quantum computing or other non-standard models of computation, basic notions in probability theory like "a predicate" vary wildly. There seems to be one constant: the only useful example of…

Logic · Mathematics 2020-07-21 Abraham Westerbaan , Bas Westerbaan , John van de Wetering

We describe a type system for the linear-algebraic $\lambda$-calculus. The type system accounts for the linear-algebraic aspects of this extension of $\lambda$-calculus: it is able to statically describe the linear combinations of terms…

Logic in Computer Science · Computer Science 2017-05-12 Pablo Arrighi , Alejandro Díaz-Caro , Benoît Valiron

This paper introduces and studies a categorical analogue of the familiar monoid semiring construction. By introducing an axiomatisation of summation that unifies notions of summation from algebraic program semantics with various notions of…

Category Theory · Mathematics 2013-06-03 Peter Hines

In this paper, we make specific conjectures about the distribution of Jacobians of random graphs with their canonical duality pairings. Our conjectures are based on a Cohen-Lenstra type heuristic saying that a finite abelian group with…

Combinatorics · Mathematics 2016-04-19 Julien Clancy , Nathan Kaplan , Timothy Leake , Sam Payne , Melanie Matchett Wood

Virtually all questions that one can ask about the behavioral and structural complexity of a stochastic process reduce to a linear algebraic framing of a time evolution governed by an appropriate hidden-Markov process generator. Each type…

Chaotic Dynamics · Physics 2018-04-18 Paul M. Riechers , James P. Crutchfield

While behavioural equivalences among systems of the same type, such as Park/Milner bisimilarity of labelled transition systems, are an established notion, a systematic treatment of relationships between systems of different type is…

Logic in Computer Science · Computer Science 2025-02-07 Pedro Nora , Jurriaan Rot , Lutz Schröder , Paul Wild

Several interesting generative learning algorithms involve a complex probability distribution over many random variables, involving intractable normalization constants or latent variable normalization. Some of them may even not have an…

Machine Learning · Computer Science 2014-05-13 Yoshua Bengio , Li Yao , Kyunghyun Cho

Moralisation and Triangulation are transformations allowing to switch between different ways of factoring a probability distribution into a graphical model. Moralisation allows to view a Bayesian network (a directed model) as a Markov…

Artificial Intelligence · Computer Science 2025-07-30 Antonio Lorenzin , Fabio Zanasi

Normalisation in probability theory turns a subdistribution into a proper distribution. It is a partial operation, since it is undefined for the zero subdistribution. This partiality makes it hard to reason equationally about normalisation.…

Logic in Computer Science · Computer Science 2023-06-22 Bart Jacobs

We provide a novel family of generative block-models for random graphs that naturally incorporates degree distributions: the block-constrained configuration model. Block-constrained configuration models build on the generalised…

Physics and Society · Physics 2021-02-24 Giona Casiraghi

We propose a method for the classification of objects that are structured as random trees. Our aim is to model a distribution over the node label assignments in settings where the tree data structure is associated with node attributes…

Machine Learning · Computer Science 2024-09-18 Wouter W. L. Nuijten , Vlado Menkovski

A leading hypothesis for the surprising generalization of neural networks is that the dynamics of gradient descent bias the model towards simple solutions, by searching through the solution space in an incremental order of complexity. We…

Machine Learning · Computer Science 2020-01-01 Daniel Gissin , Shai Shalev-Shwartz , Amit Daniely

A class of models is presented, in the form of continuation monads polymorphic for first-order individuals, that is sound and complete for minimal intuitionistic predicate logic. The proofs of soundness and completeness are constructive and…

Logic · Mathematics 2014-11-04 Danko Ilik