English
Related papers

Related papers: Category-Theoretic Quantitative Compositional Dist…

200 papers

An open problem with categorical compositional distributional semantics is the representation of words that are considered semantically vacuous from a distributional perspective, such as determiners, prepositions, relative pronouns or…

Computation and Language · Computer Science 2016-08-05 Dimitri Kartsaklis

We accommodate the Integrated Connectionist/Symbolic Architecture (ICS) of [32] within the categorical compositional semantics (CatCo) of [13], forming a model of categorical compositional cognition (CatCog). This resolves intrinsic…

Artificial Intelligence · Computer Science 2016-08-15 Yaared Al-Mehairi , Bob Coecke , Martha Lewis

The Categorical Compositional Distributional (DisCoCat) Model is a powerful mathematical model for composing the meaning of sentences in natural languages. Since we can think of biological sequences as the "language of life", it is…

Quantitative Methods · Quantitative Biology 2019-08-14 Yanying Wu , Quanlong Wang

Deep compositional models of meaning acting on distributional representations of words in order to produce vectors of larger text constituents are evolving to a popular area of NLP research. We detail a compositional distributional…

Computation and Language · Computer Science 2015-08-14 Jianpeng Cheng , Dimitri Kartsaklis

The categorical compositional distributional (DisCoCat) model of meaning rigorously connects distributional semantics and pregroup grammars, and has found a variety of applications in computational linguistics. From a more abstract…

Computation and Language · Computer Science 2016-08-05 Stefano Gogioso

Coecke, Sadrzadeh, and Clark (arXiv:1003.4394v1 [cs.CL]) developed a compositional model of meaning for distributional semantics, in which each word in a sentence has a meaning vector and the distributional meaning of the sentence is a…

Computation and Language · Computer Science 2011-07-29 Edward Grefenstette , Mehrnoosh Sadrzadeh , Stephen Clark , Bob Coecke , Stephen Pulman

The Distributional Compositional Categorical (DisCoCat) model is a mathematical framework that provides compositional semantics for meanings of natural language sentences. It consists of a computational procedure for constructing meanings…

Logic · Mathematics 2013-06-21 Bob Coecke , Edward Grefenstette , Mehrnoosh Sadrzadeh

Originally inspired by categorical quantum mechanics (Abramsky and Coecke, LiCS'04), the categorical compositional distributional model of natural language meaning of Coecke, Sadrzadeh and Clark provides a conceptually motivated procedure…

Computation and Language · Computer Science 2015-02-05 Robin Piedeleu , Dimitri Kartsaklis , Bob Coecke , Mehrnoosh Sadrzadeh

Interventional causal models describe several joint distributions over some variables used to describe a system, one for each intervention setting. They provide a formal recipe for how to move between the different joint distributions and…

Machine Learning · Statistics 2021-08-06 Eigil F. Rischel , Sebastian Weichwald

Discourse relations bind smaller linguistic units into coherent texts. However, automatically identifying discourse relations is difficult, because it requires understanding the semantics of the linked arguments. A more subtle challenge is…

Computation and Language · Computer Science 2014-11-26 Yangfeng Ji , Jacob Eisenstein

Despite ample evidence that our concepts, our cognitive architecture, and mathematics itself are all deeply compositional, few models take advantage of this structure. We therefore propose a radically compositional approach to computational…

Neurons and Cognition · Quantitative Biology 2019-11-18 Toby B. St Clere Smithe

Discourse relations bind smaller linguistic elements into coherent texts. However, automatically identifying discourse relations is difficult, because it requires understanding the semantics of the linked sentences. A more subtle challenge…

Computation and Language · Computer Science 2015-04-29 Yangfeng Ji , Jacob Eisenstein

Conceptual combination performs a fundamental role in creating the broad range of compound phrases utilized in everyday language. This article provides a novel probabilistic framework for assessing whether the semantics of conceptual…

Computation and Language · Computer Science 2014-11-24 Peter D. Bruza , Kirsty Kitto , Brentyn J. Ramm , Laurianne Sitbon

Distributional semantic models provide vector representations for words by gathering co-occurrence frequencies from corpora of text. Compositional distributional models extend these from words to phrases and sentences. In categorical…

Computation and Language · Computer Science 2018-10-10 Esma Balkir , Dimitri Kartsaklis , Mehrnoosh Sadrzadeh

The categorical compositional distributional model of meaning gives the composition of words into phrases and sentences pride of place. However, it has so far lacked a model of logical negation. This paper gives some steps towards providing…

Computation and Language · Computer Science 2020-05-12 Martha Lewis

The categorical compositional approach to meaning has been successfully applied in natural language processing, outperforming other models in mainstream empirical language processing tasks. We show how this approach can be generalized to…

Logic in Computer Science · Computer Science 2017-10-02 Joe Bolt , Bob Coecke , Fabrizio Genovese , Martha Lewis , Dan Marsden , Robin Piedeleu

Modelling concept representation is a foundational problem in the study of cognition and linguistics. This work builds on the confluence of conceptual tools from G\"ardenfors semantic spaces, categorical compositional linguistics, and…

Computation and Language · Computer Science 2020-08-07 James Hefford , Vincent Wang , Matthew Wilson

The compositionality of meaning extends beyond the single sentence. Just as words combine to form the meaning of sentences, so do sentences combine to form the meaning of paragraphs, dialogues and general discourse. We introduce both a…

Computation and Language · Computer Science 2013-06-18 Nal Kalchbrenner , Phil Blunsom

We propose a mathematical framework for a unification of the distributional theory of meaning in terms of vector space models, and a compositional theory for grammatical types, for which we rely on the algebra of Pregroups, introduced by…

Computation and Language · Computer Science 2010-03-24 Bob Coecke , Mehrnoosh Sadrzadeh , Stephen Clark

The Categorical Compositional Distributional (DisCoCat) framework models meaning in natural language using the mathematical framework of quantum theory, expressed as formal diagrams. DisCoCat diagrams can be associated with tensor networks…

Computation and Language · Computer Science 2025-04-02 Jurek Eisinger , Ward Gauderis , Lin de Huybrecht , Geraint A. Wiggins