English
Related papers

Related papers: Tweet2Vec: Learning Tweet Embeddings Using Charact…

200 papers

We propose a learning model for the task of visual storytelling. The main idea is to predict anchor word embeddings from the images and use the embeddings and the image features jointly to generate narrative sentences. We use the embeddings…

Computer Vision and Pattern Recognition · Computer Science 2020-01-15 Bowen Zhang , Hexiang Hu , Fei Sha

In the field of Natural Language Processing (NLP), we revisit the well-known word embedding algorithm word2vec. Word embeddings identify words by vectors such that the words' distributional similarity is captured. Unexpectedly, besides…

Machine Learning · Computer Science 2018-06-22 Tobias Eichinger

Word vector representations enable machines to encode human language for spoken language understanding and processing. Confusion2vec, motivated from human speech production and perception, is a word vector representation which encodes…

Computation and Language · Computer Science 2022-05-04 Prashanth Gurunath Shivakumar , Panayiotis Georgiou , Shrikanth Narayanan

We analyze the process of creating word embedding feature representations designed for a learning task when annotated data is scarce, for example, in depressive language detection from Tweets. We start with a rich word embedding pre-trained…

Computation and Language · Computer Science 2021-06-25 Nawshad Farruque , Randy Goebel , Osmar Zaiane

Cross-lingual embeddings represent the meaning of words from different languages in the same vector space. Recent work has shown that it is possible to construct such representations by aligning independently learned monolingual embedding…

With the growth of social medias, such as Twitter, plenty of user-generated data emerge daily. The short texts published on Twitter -- the tweets -- have earned significant attention as a rich source of information to guide many…

Artificial Intelligence · Computer Science 2021-06-01 Sérgio Barreto , Ricardo Moura , Jonnathan Carvalho , Aline Paes , Alexandre Plastino

We introduce two pre-trained retrieval focused multilingual sentence encoding models, respectively based on the Transformer and CNN model architectures. The models embed text from 16 languages into a single semantic space using a multi-task…

In recent years, inductive graph embedding models, \emph{viz.}, graph neural networks (GNNs) have become increasingly accurate at link prediction (LP) in online social networks. The performance of such networks depends strongly on the input…

Machine Learning · Computer Science 2021-08-24 Chitrank Gupta , Yash Jain , Abir De , Soumen Chakrabarti

Deep learning natural language processing models often use vector word embeddings, such as word2vec or GloVe, to represent words. A discrete sequence of words can be much more easily integrated with downstream neural layers if it is…

Machine Learning · Computer Science 2020-03-04 Aliakbar Panahi , Seyran Saeedi , Tom Arodz

Semantic sentence embeddings are usually supervisedly built minimizing distances between pairs of embeddings of sentences labelled as semantically similar by annotators. Since big labelled datasets are rare, in particular for non-English…

Computation and Language · Computer Science 2021-10-06 Marco Di Giovanni , Marco Brambilla

In the current literature, most embedding models are based on the encoder-only transformer architecture to extract a dense and meaningful representation of the given input, which can be a text, an image, and more. With the recent advances…

Computation and Language · Computer Science 2025-03-18 Elio Musacchio , Lucia Siciliani , Pierpaolo Basile , Giovanni Semeraro

We present a novel approach to learn representations for sentence-level semantic similarity using conversational data. Our method trains an unsupervised model to predict conversational input-response pairs. The resulting sentence embeddings…

Computation and Language · Computer Science 2018-04-23 Yinfei Yang , Steve Yuan , Daniel Cer , Sheng-yi Kong , Noah Constant , Petr Pilar , Heming Ge , Yun-Hsuan Sung , Brian Strope , Ray Kurzweil

Semantic representations of words have been successfully extracted from unlabeled corpuses using neural network models like word2vec. These representations are generally high quality and are computationally inexpensive to train, making them…

Computation and Language · Computer Science 2019-10-24 Raj Patel , Carlotta Domeniconi

The advances in AI-enabled techniques have accelerated the creation and automation of visualizations in the past decade. However, presenting visualizations in a descriptive and generative format remains a challenge. Moreover, current…

Human-Computer Interaction · Computer Science 2024-03-28 Qing Chen , Ying Chen , Ruishi Zou , Wei Shuai , Yi Guo , Jiazhe Wang , Nan Cao

The hashtag recommendation problem addresses recommending (suggesting) one or more hashtags to explicitly tag a post made on a given social network platform, based upon the content and context of the post. In this work, we propose a novel…

Computation and Language · Computer Science 2017-12-06 Kuntal Dey , Ritvik Shrivastava , Saroj Kaushik , L. Venkata Subramaniam

Emotion recognition datasets are relatively small, making the use of the more sophisticated deep learning approaches challenging. In this work, we propose a transfer learning method for speech emotion recognition where features extracted…

Sound · Computer Science 2021-04-09 Leonardo Pepino , Pablo Riera , Luciana Ferrer

We propose a new algorithm for topic modeling, Vec2Topic, that identifies the main topics in a corpus using semantic information captured via high-dimensional distributed word embeddings. Our technique is unsupervised and generates a list…

Computation and Language · Computer Science 2016-03-16 Ramandeep S Randhawa , Parag Jain , Gagan Madan

Recent advances in machine learning research have produced powerful neural graph embedding methods, which learn useful, low-dimensional vector representations of network data. These neural methods for graph embedding excel in graph machine…

Physics and Society · Physics 2024-11-05 Sadamori Kojaku , Filippo Radicchi , Yong-Yeol Ahn , Santo Fortunato

In this paper we present deep-learning models that submitted to the SemEval-2018 Task~1 competition: "Affect in Tweets". We participated in all subtasks for English tweets. We propose a Bi-LSTM architecture equipped with a multi-layer self…

Learning sentence vectors that generalise well is a challenging task. In this paper we compare three methods of learning phrase embeddings: 1) Using LSTMs, 2) using recursive nets, 3) A variant of the method 2 using the POS information of…

Computation and Language · Computer Science 2018-05-23 Anson Bastos