English
Related papers

Related papers: Deconstructing and reconstructing word embedding a…

200 papers

In order to expand their reach and increase website ad revenue, media outlets have started using clickbait techniques to lure readers to click on articles on their digital platform. Having successfully enticed the user to open the article,…

Information Retrieval · Computer Science 2018-08-06 Vaibhav Kumar , Mrinal Dhar , Dhruv Khattar , Yash Kumar Lal , Abhimanshu Mishra , Manish Shrivastava , Vasudeva Varma

Contextual embeddings represent a new generation of semantic representations learned from Neural Language Modelling (NLM) that addresses the issue of meaning conflation hampering traditional word embeddings. In this work, we show that…

Computation and Language · Computer Science 2019-06-25 Daniel Loureiro , Alipio Jorge

Word embeddings aims to map sense of the words into a lower dimensional vector space in order to reason over them. Training embeddings on domain specific data helps express concepts more relevant to their use case but comes at a cost of…

Computation and Language · Computer Science 2018-08-20 Shubham Bhardwaj

Word alignment over parallel corpora has a wide variety of applications, including learning translation lexicons, cross-lingual transfer of language processing tools, and automatic evaluation or analysis of translation outputs. The great…

Computation and Language · Computer Science 2021-08-13 Zi-Yi Dou , Graham Neubig

Word2Vec is a widely used algorithm for extracting low-dimensional vector representations of words. It generated considerable excitement in the machine learning and natural language processing (NLP) communities recently due to its…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-08-09 Shihao Ji , Nadathur Satish , Sheng Li , Pradeep Dubey

State-of-the-art NLP systems represent inputs with word embeddings, but these are brittle when faced with Out-of-Vocabulary (OOV) words. To address this issue, we follow the principle of mimick-like models to generate vectors for unseen…

Computation and Language · Computer Science 2022-03-22 Lihu Chen , Gaël Varoquaux , Fabian M. Suchanek

In recent years, word embeddings have been surprisingly effective at capturing intuitive characteristics of the words they represent. These vectors achieve the best results when training corpora are extremely large, sometimes billions of…

Computation and Language · Computer Science 2017-12-06 Willie Boag , Hassan Kané

To be able to interact better with humans, it is crucial for machines to understand sound - a primary modality of human perception. Previous works have used sound to learn embeddings for improved generic textual similarity assessment. In…

Computation and Language · Computer Science 2017-08-30 Ashwin K Vijayakumar , Ramakrishna Vedantam , Devi Parikh

Dialogue act recognition is an important component of a large number of natural language processing pipelines. Many research works have been carried out in this area, but relatively few investigate deep neural networks and word embeddings.…

Computation and Language · Computer Science 2020-10-23 Christophe Cerisara , Pavel Kral , Ladislav Lenc

Most state-of-the-art models in natural language processing (NLP) are neural models built on top of large, pre-trained, contextual language models that generate representations of words in context and are fine-tuned for the task at hand.…

Computation and Language · Computer Science 2020-10-13 Brian Lester , Daniel Pressel , Amy Hemmeter , Sagnik Ray Choudhury , Srinivas Bangalore

Distributed word embeddings have shown superior performances in numerous Natural Language Processing (NLP) tasks. However, their performances vary significantly across different tasks, implying that the word embeddings learnt by those…

Computation and Language · Computer Science 2017-09-21 Danushka Bollegala , Kohei Hayashi , Ken-ichi Kawarabayashi

Detecting vulnerabilities within compiled binaries is challenging due to lost high-level code structures and other factors such as architectural dependencies, compilers, and optimization options. To address these obstacles, this research…

Cryptography and Security · Computer Science 2024-12-17 Gary A. McCully , John D. Hastings , Shengjie Xu , Adam Fortier

Word embeddings have advanced the state of the art in NLP across numerous tasks. Understanding the contents of dense neural representations is of utmost interest to the computational semantics community. We propose to focus on relating…

Computation and Language · Computer Science 2022-05-30 Timothee Mickus , Kees van Deemter , Mathieu Constant , Denis Paperno

Distributed word representation (a.k.a. word embedding) is a key focus in natural language processing (NLP). As a highly successful word embedding model, Word2Vec offers an efficient method for learning distributed word representations on…

Computation and Language · Computer Science 2024-07-30 Chaohao Yang , Chris Ding

General embeddings like word2vec, GloVe and ELMo have shown a lot of success in natural language tasks. The embeddings are typically extracted from models that are built on general tasks such as skip-gram models and natural language…

Computation and Language · Computer Science 2020-11-03 Aparna Khare , Srinivas Parthasarathy , Shiva Sundaram

Unsupervised word embeddings have become a popular approach of word representation in NLP tasks. However there are limitations to the semantics represented by unsupervised embeddings, and inadequate fine-tuning of embeddings can lead to…

Computation and Language · Computer Science 2019-06-10 Xiao Zhang , Ji Wu , Dejing Dou

Effective communication between healthcare providers and patients is crucial to providing high-quality patient care. In this work, we investigate how Doctor-written and AI-generated texts in healthcare consultations can be classified using…

Computation and Language · Computer Science 2024-02-08 Olumide Ebenezer Ojo , Olaronke Oluwayemisi Adebanji , Alexander Gelbukh , Hiram Calvo , Anna Feldman

Tradition tweet classification models for crisis response focus on convolutional layers and domain-specific word embeddings. In this paper, we study the application of different neural networks with general-purpose and domain-specific word…

Computation and Language · Computer Science 2019-03-27 Reem ALRashdi , Simon O'Keefe

We propose to learn word embeddings from visual co-occurrences. Two words co-occur visually if both words apply to the same image or image region. Specifically, we extract four types of visual co-occurrences between object and attribute…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Tanmay Gupta , Alexander Schwing , Derek Hoiem

Low-dimensional embeddings are a cornerstone in the modelling and analysis of complex networks. However, most existing approaches for mining network embedding spaces rely on computationally intensive machine learning systems to facilitate…

Social and Information Networks · Computer Science 2024-10-04 Alexandros Xenos , Noel-Malod Dognin , Natasa Przulj