English
Related papers

Related papers: Mathematical Foundations for a Compositional Accou…

200 papers

Bayesian statistical models allow us to formalise our knowledge about the world and reason about our uncertainty, but there is a need for better procedures to accurately encode its complexity. One way to do so is through compositional…

Computation · Statistics 2017-03-01 Maria Lomeli

In tasks like semantic parsing, instruction following, and question answering, standard deep networks fail to generalize compositionally from small datasets. Many existing approaches overcome this limitation with model architectures that…

Computation and Language · Computer Science 2023-07-06 Ekin Akyürek , Jacob Andreas

Bayesian optimisation presents a sample-efficient methodology for global optimisation. Within this framework, a crucial performance-determining subroutine is the maximisation of the acquisition function, a task complicated by the fact that…

Machine Learning · Computer Science 2020-12-18 Antoine Grosnit , Alexander I. Cowen-Rivers , Rasul Tutunov , Ryan-Rhys Griffiths , Jun Wang , Haitham Bou-Ammar

In probabilistic modelling, joint distributions are often of more interest than their marginals, but the standard composition of stochastic channels is defined by marginalization. Last year at ACT, the notion of 'copy-composition' was…

Category Theory · Mathematics 2025-09-26 Toby St Clere Smithe

We develop a novel data-driven approach to the inverse problem of classical statistical mechanics: given experimental data on the collective motion of a classical many-body system, how does one characterise the free energy landscape of that…

Statistical Mechanics · Physics 2022-03-01 Peter Yatsyshin , Serafim Kalliadasis , Andrew B. Duncan

This thesis contributes to ongoing research related to the categorical compositional model for natural language of Coecke, Sadrzadeh and Clark in three ways: Firstly, I propose a concrete instantiation of the abstract framework based on…

Computation and Language · Computer Science 2015-05-04 Dimitri Kartsaklis

Sequential neuronal activity underlies a wide range of processes in the brain. Neuroscientific evidence for neuronal sequences has been reported in domains as diverse as perception, motor control, speech, spatial navigation and memory.…

Adaptation and Self-Organizing Systems · Physics 2020-04-03 Sascha Frölich , Dimitrije Marković , Stefan J. Kiebel

Causal discovery and causal reasoning are classically treated as separate and consecutive tasks: one first infers the causal graph, and then uses it to estimate causal effects of interventions. However, such a two-stage approach is…

Machine Learning · Computer Science 2022-10-18 Christian Toth , Lars Lorch , Christian Knoll , Andreas Krause , Franz Pernkopf , Robert Peharz , Julius von Kügelgen

This paper presents a computational model of concept learning using Bayesian inference for a grammatically structured hypothesis space, and test the model on multisensory (visual and haptics) recognition of 3D objects. The study is…

Computer Vision and Pattern Recognition · Computer Science 2014-09-25 Ifeoma Nwogu , Goker Erdogan , Ilker Yildirim , Robert Jacobs

We describe a procedure for explaining neurons in deep representations by identifying compositional logical concepts that closely approximate neuron behavior. Compared to prior work that uses atomic labels as explanations, analyzing neurons…

Machine Learning · Computer Science 2021-02-04 Jesse Mu , Jacob Andreas

Replay in the brain has been viewed as rehearsal, or, more recently, as sampling from a transition model. Here, we propose a new hypothesis: that replay is able to implement a form of compositional computation where entities are assembled…

Neurons and Cognition · Quantitative Biology 2022-12-21 Zeb Kurth-Nelson , Timothy Behrens , Greg Wayne , Kevin Miller , Lennart Luettgau , Ray Dolan , Yunzhe Liu , Philipp Schwartenbeck

Bayes' rule tells us how to invert a causal process in order to update our beliefs in light of new evidence. If the process is believed to have a complex compositional structure, we may ask whether composing the inversions of the component…

Category Theory · Mathematics 2020-07-29 Toby St. Clere Smithe

Functional data analysis, which models data as realizations of random functions over a continuum, has emerged as a useful tool for time series data. Often, the goal is to infer the dynamic connections (or time-varying conditional…

Methodology · Statistics 2024-12-10 Chunshan Liu , Daniel R. Kowal , James Doss-Gollin , Marina Vannucci

Motivated by modern observational studies, we introduce a class of functional models that expands nested and crossed designs. These models account for the natural inheritance of correlation structure from sampling design in studies where…

Applications · Statistics 2013-04-26 Haochang Shou , Vadim Zipunnikov , Ciprian M. Crainiceanu , Sonja Greven

Structural and functional neuroimaging modalities provide complementary windows into brain organization: structural imaging characterizes neural tissue anatomy and microstructure, while functional imaging captures dynamic patterns of neural…

Methodology · Statistics 2026-03-24 Sakul Mahat , Sharmistha Guha , Jessica Bernard

Humans excel at applying learned behavior to unlearned situations. A crucial component of this generalization behavior is our ability to compose/decompose a whole into reusable parts, an attribute known as compositionality. One of the…

Artificial Intelligence · Computer Science 2024-07-24 Prasanna Vijayaraghavan , Jeffrey Frederic Queisser , Sergio Verduzco Flores , Jun Tani

This paper describes a computational framework for a grammar architecture in which different linguistic domains such as morphology, syntax, and semantics are treated not as separate components but compositional domains. Word and phrase…

cmp-lg · Computer Science 2008-02-03 Cem Bozsahin , Elvan Gocmen

A supervised learning algorithm searches over a set of functions $A \to B$ parametrised by a space $P$ to find the best approximation to some ideal function $f\colon A \to B$. It does this by taking examples $(a,f(a)) \in A\times B$, and…

Category Theory · Mathematics 2019-05-02 Brendan Fong , David I. Spivak , Rémy Tuyéras

Normative and task-driven theories offer powerful top-down explanations for biological systems, yet the goals of quantitatively arbitrating between competing theories, and utilizing them as inductive biases to improve data-driven fits of…

Artificial Intelligence · Computer Science 2025-09-30 Bahti Zakirov , Gašper Tkačik

Compositionality is thought to be a key component of language, and various compositional benchmarks have been developed to empirically probe the compositional generalization of existing sequence processing models. These benchmarks often…

Machine Learning · Computer Science 2024-05-07 Parikshit Ram , Tim Klinger , Alexander G. Gray