English
Related papers

Related papers: Probability Signature: Bridging Data Semantics and…

200 papers

Token embeddings play a crucial role in language modeling but, despite this practical relevance, their theoretical understanding remains limited. Our paper addresses the gap by characterizing the structure of embeddings obtained via…

Machine Learning · Computer Science 2025-06-26 Diyuan Wu , Aleksandr Shevchenko , Samet Oymak , Marco Mondelli

Semantic sentence embedding models encode natural language sentences into vectors, such that closeness in embedding space indicates closeness in the semantics between the sentences. Bilingual data offers a useful signal for learning such…

Computation and Language · Computer Science 2020-11-20 John Wieting , Graham Neubig , Taylor Berg-Kirkpatrick

Word embeddings are an essential instrument in many NLP tasks. Most available resources are trained on general language from Web corpora or Wikipedia dumps. However, word embeddings for domain-specific language are rare, in particular for…

Computation and Language · Computer Science 2023-02-14 Ricardo Schiffers , Dagmar Kern , Daniel Hienert

Transformer models learn to encode and decode an input text, and produce contextual token embeddings as a side-effect. The mapping from language into the embedding space maps words expressing similar concepts onto points that are close in…

Computation and Language · Computer Science 2025-09-03 Vivi Nastase , Paola Merlo

Most compositional distributional semantic models represent sentence meaning with a single vector. In this paper, we propose a Structured Distributional Model (SDM) that combines word embeddings with formal semantics and is based on the…

Computation and Language · Computer Science 2019-06-19 Emmanuele Chersoni , Enrico Santus , Ludovica Pannitto , Alessandro Lenci , Philippe Blache , Chu-Ren Huang

We investigate compositional structures in data embeddings from pre-trained vision-language models (VLMs). Traditionally, compositionality has been associated with algebraic operations on embeddings of words from a pre-existing vocabulary.…

Machine Learning · Computer Science 2024-01-12 Matthew Trager , Pramuditha Perera , Luca Zancato , Alessandro Achille , Parminder Bhatia , Stefano Soatto

The power of machine learning systems not only promises great technical progress, but risks societal harm. As a recent example, researchers have shown that popular word embedding algorithms exhibit stereotypical biases, such as gender bias.…

Machine Learning · Computer Science 2019-06-11 Marc-Etienne Brunet , Colleen Alkalay-Houlihan , Ashton Anderson , Richard Zemel

Models such as Word2Vec and GloVe construct word embeddings based on the co-occurrence probability $P(i,j)$ of words $i$ and $j$ in text corpora. The resulting vectors $W_i$ not only group semantically similar words but also exhibit a…

Computation and Language · Computer Science 2025-10-24 Daniel J. Korchinski , Dhruva Karkada , Yasaman Bahri , Matthieu Wyart

The conventional natural language processing approaches are not accustomed to the social media text due to colloquial discourse and non-homogeneous characteristics. Significantly, the language identification in a multilingual document is…

Computation and Language · Computer Science 2021-06-30 M Zeeshan Ansari , Tanvir Ahmad , M M Sufyan Beg , Asma Ikram

The relationship between words in a sentence often tells us more about the underlying semantic content of a document than its actual words, individually. In this work, we propose two novel algorithms, called Flexible Lexical Chain II and…

The expected signature maps a collection of data streams to a lower dimensional representation, with a remarkable property: the resulting feature tensor can fully characterize the data generating distribution. This "model-free" embedding…

Machine Learning · Statistics 2025-05-29 Lorenzo Lucchese , Mikko S. Pakkanen , Almut E. D. Veraart

Word embeddings represent language vocabularies as clouds of $d$-dimensional points. We investigate how information is conveyed by the general shape of these clouds, instead of representing the semantic meaning of each token. Specifically,…

Computation and Language · Computer Science 2025-01-15 Ondřej Draganov , Steven Skiena

Data representation is a fundamental task in machine learning. The representation of data affects the performance of the whole machine learning system. In a long history, the representation of data is done by feature engineering, and…

Computation and Language · Computer Science 2016-11-21 Siwei Lai

Many models learn representations of knowledge graph data by exploiting its low-rank latent structure, encoding known relations between entities and enabling unknown facts to be inferred. To predict whether a relation holds between…

Machine Learning · Computer Science 2021-01-19 Carl Allen , Ivana Balažević , Timothy Hospedales

Hierarchical vector field interpolation introduces a structured probabilistic framework for lexical representation, ensuring that word embeddings transition smoothly across a continuous manifold rather than being constrained to discrete…

Computation and Language · Computer Science 2025-03-27 Clive Pendleton , Ewan Harrington , Giles Fairbrother , Jasper Arkwright , Nigel Fenwick , Richard Katrix

Learning word embeddings using distributional information is a task that has been studied by many researchers, and a lot of studies are reported in the literature. On the contrary, less studies were done for the case of multiple languages.…

Computation and Language · Computer Science 2020-04-15 Marco Berlot , Evan Kaplan

Semantic sentence embeddings are usually supervisedly built minimizing distances between pairs of embeddings of sentences labelled as semantically similar by annotators. Since big labelled datasets are rare, in particular for non-English…

Computation and Language · Computer Science 2021-10-06 Marco Di Giovanni , Marco Brambilla

The question of what kinds of linguistic information are encoded in different layers of Transformer-based language models is of considerable interest for the NLP community. Existing work, however, has overwhelmingly focused on word-level…

Computation and Language · Computer Science 2023-10-19 Dmitry Nikolaev , Sebastian Padó

Low-dimensional embeddings are a cornerstone in the modelling and analysis of complex networks. However, most existing approaches for mining network embedding spaces rely on computationally intensive machine learning systems to facilitate…

Social and Information Networks · Computer Science 2024-10-04 Alexandros Xenos , Noel-Malod Dognin , Natasa Przulj

Various NLP problems -- such as the prediction of sentence similarity, entailment, and discourse relations -- are all instances of the same general task: the modeling of semantic relations between a pair of textual elements. A popular model…

Computation and Language · Computer Science 2019-04-05 Damien Sileo , Tim Van-De-Cruys , Camille Pradel , Philippe Muller