English
Related papers

Related papers: Norm of Word Embedding Encodes Information Gain

200 papers

The problem of knowledge graph (KG) reasoning has been widely explored by traditional rule-based systems and more recently by knowledge graph embedding methods. While logical rules can capture deterministic behavior in a KG they are brittle…

Artificial Intelligence · Computer Science 2020-09-24 Susheel Suresh , Jennifer Neville

A word embedding is a low-dimensional, dense and real- valued vector representation of a word. Word embeddings have been used in many NLP tasks. They are usually gener- ated from a large text corpus. The embedding of a word cap- tures both…

Computation and Language · Computer Science 2017-08-15 Quanzhi Li , Sameena Shah , Xiaomo Liu , Armineh Nourbakhsh

The vector representation of words, known as word embeddings, has opened a new research approach in linguistic studies. These representations can capture different types of information about words. The grammatical gender of nouns is a…

Computation and Language · Computer Science 2020-11-04 Hartger Veeman , Ali Basirat

Lexical normalisation (LN) is the process of correcting each word in a dataset to its canonical form so that it may be more easily and more accurately analysed. Most lexical normalisation systems operate at the character-level, while…

Computation and Language · Computer Science 2019-11-15 Michael Stewart , Wei Liu , Rachel Cardell-Oliver

Natural language semantics has recently sought to combine the complementary strengths of formal and distributional approaches to meaning. More specifically, proposals have been put forward to augment formal semantic machinery with…

Computation and Language · Computer Science 2021-03-03 Noortje J. Venhuizen , Petra Hendriks , Matthew W. Crocker , Harm Brouwer

Natural Language Processing enables computers to understand human language by analysing and classifying text efficiently with deep-level grammatical and semantic features. Existing models capture features by learning from large corpora with…

Computation and Language · Computer Science 2026-02-25 Azrin Sultana , Firoz Ahmed

The compositionality degree of multiword expressions indicates to what extent the meaning of a phrase can be derived from the meaning of its constituents and their grammatical relations. Prediction of (non)-compositionality is a task that…

Computation and Language · Computer Science 2019-06-10 Abhik Jana , Dmitry Puzyrev , Alexander Panchenko , Pawan Goyal , Chris Biemann , Animesh Mukherjee

Unstructured text provides decision-makers with a rich data source in many domains, ranging from product reviews in retail to nursing notes in healthcare. To leverage this information, words are typically translated into word embeddings --…

Machine Learning · Statistics 2024-02-20 Kan Xu , Xuanyi Zhao , Hamsa Bastani , Osbert Bastani

Ensembling word embeddings to improve distributed word representations has shown good success for natural language processing tasks in recent years. These approaches either carry out straightforward mathematical operations over a set of…

Computation and Language · Computer Science 2018-08-14 James O' Neill , Danushka Bollegala

Understanding how words change their meanings over time is key to models of language and cultural evolution, but historical data on meaning is scarce, making theories hard to develop and test. Word embeddings show promise as a diachronic…

Computation and Language · Computer Science 2018-10-26 William L. Hamilton , Jure Leskovec , Dan Jurafsky

Distributional models provide a convenient way to model semantics using dense embedding spaces derived from unsupervised learning algorithms. However, the dimensions of dense embedding spaces are not designed to resemble human semantic…

Computation and Language · Computer Science 2018-11-15 Steven Derby , Paul Miller , Brian Murphy , Barry Devereux

We develop a streaming (one-pass, bounded-memory) word embedding algorithm based on the canonical skip-gram with negative sampling algorithm implemented in word2vec. We compare our streaming algorithm to word2vec empirically by measuring…

Computation and Language · Computer Science 2017-04-26 Chandler May , Kevin Duh , Benjamin Van Durme , Ashwin Lall

Data representation is a fundamental task in machine learning. The representation of data affects the performance of the whole machine learning system. In a long history, the representation of data is done by feature engineering, and…

Computation and Language · Computer Science 2016-11-21 Siwei Lai

Word embeddings are one of the most useful tools in any modern natural language processing expert's toolkit. They contain various types of information about each word which makes them the best way to represent the terms in any NLP task. But…

Computation and Language · Computer Science 2019-06-20 Armin Seyeditabari , Narges Tabari , Shafie Gholizade , Wlodek Zadrozny

Knowledge graphs represent information as structured triples and serve as the backbone for a wide range of applications, including question answering, link prediction, and recommendation systems. A prominent line of research for exploring…

Machine Learning · Computer Science 2025-10-15 Rita T. Sousa , Heiko Paulheim

We propose a novel vector representation that integrates lexical contrast into distributional vectors and strengthens the most salient features for determining degrees of word similarity. The improved vectors significantly outperform…

Computation and Language · Computer Science 2016-05-26 Kim Anh Nguyen , Sabine Schulte im Walde , Ngoc Thang Vu

Recent works on word representations mostly rely on predictive models. Distributed word representations (aka word embeddings) are trained to optimally predict the contexts in which the corresponding words tend to appear. Such models have…

Computation and Language · Computer Science 2015-04-10 Rémi Lebret , Ronan Collobert

An essential part of monitoring machine learning models in production is measuring input and output data drift. In this paper, we present a system for measuring distributional shifts in natural language data and highlight and investigate…

Computation and Language · Computer Science 2023-12-06 Gyandev Gupta , Bashir Rastegarpanah , Amalendu Iyer , Joshua Rubin , Krishnaram Kenthapadi

Distributional semantics models derive word space from linguistic items in context. Meaning is obtained by defining a distance measure between vectors corresponding to lexical entities. Such vectors present several problems. In this paper…

Computation and Language · Computer Science 2017-12-25 Jakub Dutkiewicz , Czesław Jędrzejek

Recently, word representation has been increasingly focused on for its excellent properties in representing the word semantics. Previous works mainly suffer from the problem of polysemy phenomenon. To address this problem, most of previous…

Computation and Language · Computer Science 2015-11-20 Xinchi Chen , Xipeng Qiu , Jingxiang Jiang , Xuanjing Huang