English
Related papers

Related papers: Text Similarity in Vector Space Models: A Comparat…

200 papers

Semantic sentence embedding models encode natural language sentences into vectors, such that closeness in embedding space indicates closeness in the semantics between the sentences. Bilingual data offers a useful signal for learning such…

Computation and Language · Computer Science 2020-11-20 John Wieting , Graham Neubig , Taylor Berg-Kirkpatrick

Assessing the trustworthiness of artificial intelligence systems requires knowledge from many different disciplines. These disciplines do not necessarily share concepts between them and might use words with different meanings, or even use…

Information Retrieval · Computer Science 2022-08-10 Dennis Vetter , Jesmin Jahan Tithi , Magnus Westerlund , Roberto V. Zicari , Gemma Roig

We attribute the vulnerability of natural language processing models to the fact that similar inputs are converted to dissimilar representations in the embedding space, leading to inconsistent outputs, and we propose a novel robust training…

Computation and Language · Computer Science 2022-07-28 Yichen Yang , Xiaosen Wang , Kun He

Learned vector representations of words are useful tools for many information retrieval and natural language processing tasks due to their ability to capture lexical semantics. However, while many such tasks involve or even rely on named…

Computation and Language · Computer Science 2020-02-13 Satya Almasian , Andreas Spitz , Michael Gertz

Text embeddings are commonly evaluated on a small set of datasets from a single task not covering their possible applications to other tasks. It is unclear whether state-of-the-art embeddings on semantic textual similarity (STS) can be…

Computation and Language · Computer Science 2023-03-21 Niklas Muennighoff , Nouamane Tazi , Loïc Magne , Nils Reimers

Embedding words in a vector space has gained a lot of attention in recent years. While state-of-the-art methods provide efficient computation of word similarities via a low-dimensional matrix embedding, their motivation is often left…

Computation and Language · Computer Science 2016-09-29 Shihao Ji , Hyokun Yun , Pinar Yanardag , Shin Matsushima , S. V. N. Vishwanathan

Text embedding models are designed for sentence-level applications like retrieval and semantic similarity, and are primarily evaluated on sentence-level benchmarks. Their behavior on isolated words is less understood. We show that simply…

Computation and Language · Computer Science 2025-12-09 Rajeev Ranjan

We first present our work in machine translation, during which we used aligned sentences to train a neural network to embed n-grams of different languages into an $d$-dimensional space, such that n-grams that are the translation of each…

Machine Learning · Computer Science 2011-05-17 Etter Vincent

The increasing prevalence of video clips has sparked growing interest in text-video retrieval. Recent advances focus on establishing a joint embedding space for text and video, relying on consistent embedding representations to compute…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Jiamian Wang , Guohao Sun , Pichao Wang , Dongfang Liu , Sohail Dianat , Majid Rabbani , Raghuveer Rao , Zhiqiang Tao

Visual-semantic embedding aims to learn a joint embedding space where related video and sentence instances are located close to each other. Most existing methods put instances in a single embedding space. However, they struggle to embed…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Huy Manh Nguyen , Tomo Miyazaki , Yoshihiro Sugaya , Shinichiro Omachi

This paper aims to provide an unsupervised modelling approach that allows for a more flexible representation of text embeddings. It jointly encodes the words and the paragraphs as individual matrices of arbitrary column dimension with unit…

Computation and Language · Computer Science 2022-12-01 Souvik Banerjee , Bamdev Mishra , Pratik Jawanpuria , Manish Shrivastava

Semantic textual similarity is the task of estimating the similarity between the meaning of two texts. In this paper, we fine-tune transformer architectures for semantic textual similarity on the Semantic Textual Similarity Benchmark by…

Computation and Language · Computer Science 2023-06-02 Ivan Rep , Vladimir Čeperić

Machine translation has wide applications in daily life. In mission-critical applications such as translating official documents, incorrect translation can have unpleasant or sometimes catastrophic consequences. This motivates recent…

Software Engineering · Computer Science 2022-04-07 Jialun Cao , Meiziniu Li , Yeting Li , Ming Wen , Shing-Chi Cheung

Measuring similarity between training examples is critical for curating high-quality and diverse pretraining datasets for language models. However, similarity is typically computed with a generic off-the-shelf embedding model that has been…

Machine Learning · Computer Science 2025-10-22 Dylan Sam , Ayan Chakrabarti , Afshin Rostamizadeh , Srikumar Ramalingam , Gui Citovsky , Sanjiv Kumar

Word embedding methods revolve around learning continuous distributed vector representations of words with neural networks, which can capture semantic and/or syntactic cues, and in turn be used to induce similarity measures among words,…

Computation and Language · Computer Science 2016-07-25 Kuan-Yu Chen , Shih-Hung Liu , Berlin Chen , Hsin-Min Wang , Hsin-Hsi Chen

Text embedding models have significantly contributed to advancements in natural language processing by adeptly capturing semantic properties of textual data. However, the ability of these models to generalize across a wide range of…

Computation and Language · Computer Science 2023-11-15 Yan Zhang , Zhaopeng Feng , Zhiyang Teng , Zuozhu Liu , Haizhou Li

In this paper, we propose a novel approach for measuring the degree of similarity between categories of two pieces of Persian text, which were published as descriptions of two separate advertisements. We built an appropriate dataset for…

Computation and Language · Computer Science 2019-09-27 Hossein Keshavarz , Shohreh Tabatabayi Seifi , Mohammad Izadi

We present a novel method for using agent experiences gathered through an embodied simulation to ground contextualized word vectors to object representations. We use similarity learning to make comparisons between different object types…

Computation and Language · Computer Science 2023-05-24 Sadaf Ghaffari , Nikhil Krishnaswamy

Word embeddings predict a word from its neighbours by learning small, dense embedding vectors. In practice, this prediction corresponds to a semantic score given to the predicted word (or term weight). We present a novel model that, given a…

Information Retrieval · Computer Science 2019-06-04 Casper Hansen , Christian Hansen , Stephen Alstrup , Jakob Grue Simonsen , Christina Lioma

We provide a comparative study between neural word representations and traditional vector spaces based on co-occurrence counts, in a number of compositional tasks. We use three different semantic spaces and implement seven tensor-based…

Computation and Language · Computer Science 2014-08-27 Dmitrijs Milajevs , Dimitri Kartsaklis , Mehrnoosh Sadrzadeh , Matthew Purver