English
Related papers

Related papers: Collaborative Training of Tensors for Compositiona…

200 papers

We propose a segmental neural language model that combines the generalization power of neural networks with the ability to discover word-like units that are latent in unsegmented character sequences. In contrast to previous segmentation…

Computation and Language · Computer Science 2019-06-19 Kazuya Kawakami , Chris Dyer , Phil Blunsom

To overcome the absence of training data for unseen classes, conventional zero-shot learning approaches mainly train their model on seen datapoints and leverage the semantic descriptions for both seen and unseen classes. Beyond exploiting…

Machine Learning · Computer Science 2019-10-22 Hyeonwoo Yu , Beomhee Lee

Coecke, Sadrzadeh, and Clark (arXiv:1003.4394v1 [cs.CL]) developed a compositional model of meaning for distributional semantics, in which each word in a sentence has a meaning vector and the distributional meaning of the sentence is a…

Computation and Language · Computer Science 2011-07-29 Edward Grefenstette , Mehrnoosh Sadrzadeh , Stephen Clark , Bob Coecke , Stephen Pulman

Distributional models are derived from co-occurrences in a corpus, where only a small proportion of all possible plausible co-occurrences will be observed. This results in a very sparse vector space, requiring a mechanism for inferring…

Computation and Language · Computer Science 2016-08-25 Thomas Kober , Julie Weeds , Jeremy Reffin , David Weir

People easily recognize new visual categories that are new combinations of known components. This compositional generalization capacity is critical for learning in real-world domains like vision and language because the long tail of new…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Yuval Atzmon , Felix Kreuk , Uri Shalit , Gal Chechik

Data-driven representation learning for words is a technique of central importance in NLP. While indisputably useful as a source of features in downstream tasks, such vectors tend to consist of uninterpretable components whose relationship…

Computation and Language · Computer Science 2015-06-18 Manaal Faruqui , Chris Dyer

Collecting robotic manipulation data is expensive, making it impractical to acquire demonstrations for the combinatorially large space of tasks that arise in multi-object, multi-robot, and multi-environment settings. While recent generative…

Semantic composition functions have been playing a pivotal role in neural representation learning of text sequences. In spite of their success, most existing models suffer from the underfitting problem: they use the same shared…

Artificial Intelligence · Computer Science 2018-02-27 Junkun Chen , Xipeng Qiu , Pengfei Liu , Xuanjing Huang

Zero-shot learning aims to recognize instances of unseen classes, for which no visual instance is available during training, by learning multimodal relations between samples from seen classes and corresponding class semantic…

Computer Vision and Pattern Recognition · Computer Science 2020-10-08 Yannick Le Cacheux , Hervé Le Borgne , Michel Crucianu

Learning word embeddings using distributional information is a task that has been studied by many researchers, and a lot of studies are reported in the literature. On the contrary, less studies were done for the case of multiple languages.…

Computation and Language · Computer Science 2020-04-15 Marco Berlot , Evan Kaplan

Modelling compositional meaning for sentences using empirical distributional methods has been a challenge for computational linguists. We implement the abstract categorical model of Coecke et al. (arXiv:1003.4394v1 [cs.CL]) using data from…

Computation and Language · Computer Science 2015-03-13 Edward Grefenstette , Mehrnoosh Sadrzadeh

In the present paper we show that distributional information is particularly important when considering concept availability under implicit language learning conditions. Based on results from different behavioural experiments we argue that…

Computation and Language · Computer Science 2016-06-30 Dimitrios Alikaniotis , John N. Williams

The functional approach to compositional distributional semantics considers transitive verbs to be linear maps that transform the distributional vectors representing nouns into a vector representing a sentence. We conduct an initial…

Computation and Language · Computer Science 2014-12-15 Tamara Polajnar , Laura Rimell , Stephen Clark

We propose a new type of representation learning method that models words, phrases and sentences seamlessly. Our method does not depend on word segmentation and any human-annotated resources (e.g., word dictionaries), yet it is very…

Computation and Language · Computer Science 2019-05-30 Geewook Kim , Kazuki Fukui , Hidetoshi Shimodaira

Building meaningful representations of noun compounds is not trivial since many of them scarcely appear in the corpus. To that end, composition functions approximate the distributional representation of a noun compound by combining its…

Computation and Language · Computer Science 2019-06-13 Vered Shwartz

Modelling compositionality has been a longstanding area of research in the field of vector space semantics. The categorical approach to compositionality maps grammar onto vector spaces in a principled way, but comes under fire for requiring…

Computation and Language · Computer Science 2019-01-31 Martha Lewis

In this work, we propose a composition/decomposition framework for adversarially training generative models on composed data - data where each sample can be thought of as being constructed from a fixed number of components. In our…

Machine Learning · Computer Science 2019-01-24 Yeu-Chern Harn , Zhenghao Chen , Vladimir Jojic

This paper investigates the learning of 3rd-order tensors representing the semantics of transitive verbs. The meaning representations are part of a type-driven tensor-based semantic framework, from the newly emerging field of compositional…

Computation and Language · Computer Science 2014-02-19 Tamara Polajnar , Luana Fagarasan , Stephen Clark

This work introduces a model that can recognize objects in images even if no training data is available for the objects. The only necessary knowledge about the unseen categories comes from unsupervised large text corpora. In our zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2013-03-21 Richard Socher , Milind Ganjoo , Hamsa Sridhar , Osbert Bastani , Christopher D. Manning , Andrew Y. Ng

Score-based diffusion models have emerged as effective approaches for both conditional and unconditional generation. Still conditional generation is based on either a specific training of a conditional model or classifier guidance, which…

Machine Learning · Computer Science 2024-12-25 Davide Scassola , Sebastiano Saccani , Ginevra Carbone , Luca Bortolussi