English
Related papers

Related papers: GloVeInit at SemEval-2020 Task 1: Using GloVe Vect…

200 papers

Deep learning natural language processing models often use vector word embeddings, such as word2vec or GloVe, to represent words. A discrete sequence of words can be much more easily integrated with downstream neural layers if it is…

Machine Learning · Computer Science 2020-03-04 Aliakbar Panahi , Seyran Saeedi , Tom Arodz

We tackle the problem of identifying metaphors in text, treated as a sequence tagging task. The pre-trained word embeddings GloVe, ELMo and BERT have individually shown good performance on sequential metaphor identification. These…

Computation and Language · Computer Science 2021-04-08 Rui Mao , Chenghua Lin , Frank Guerin

Embedding words in vector space is a fundamental first step in state-of-the-art natural language processing (NLP). Typical NLP solutions employ pre-defined vector representations to improve generalization by co-locating similar words in…

Computation and Language · Computer Science 2023-01-03 Bimal Bhattarai , Ole-Christoffer Granmo , Lei Jiao , Rohan Yadav , Jivitesh Sharma

This paper describes the BLCU-ICALL system used in the SemEval-2022 Task 1 Comparing Dictionaries and Word Embeddings, the Definition Modeling subtrack, achieving 1st on Italian, 2nd on Spanish and Russian, and 3rd on English and French. We…

Computation and Language · Computer Science 2022-04-19 Cunliang Kong , Yujie Wang , Ruining Chong , Liner Yang , Hengyuan Zhang , Erhong Yang , Yaping Huang

We describe the University of Alberta systems for the SemEval-2022 Task 2 on multilingual idiomaticity detection. Working under the assumption that idiomatic expressions are noncompositional, our first method integrates information on the…

Computation and Language · Computer Science 2022-05-30 Bradley Hauer , Seeratpal Jaura , Talgat Omarov , Grzegorz Kondrak

Automated keyphrase extraction is a fundamental textual information processing task concerned with the selection of representative phrases from a document that summarize its content. This work presents a novel unsupervised method for…

Computation and Language · Computer Science 2018-04-16 Eirini Papagiannopoulou , Grigorios Tsoumakas

We propose a training-free approach to improve sentence embeddings leveraging test-time compute by applying generative text models for data augmentation at inference time. Unlike conventional data augmentation that utilises synthetic…

Computation and Language · Computer Science 2025-09-09 Manuel Frank , Haithem Afli

A currently successful approach to computational semantics is to represent words as embeddings in a machine-learned vector space. We present an ensemble method that combines embeddings produced by GloVe (Pennington et al., 2014) and…

Computation and Language · Computer Science 2019-12-20 Robyn Speer , Joshua Chin

We propose a novel and simple method for semi-supervised text classification. The method stems from the hypothesis that a classifier with pretrained word embeddings always outperforms the same classifier with randomly initialized word…

Computation and Language · Computer Science 2019-10-01 Hwiyeol Jo , Ceyda Cinarel

In this paper, we propose Emo2Vec which encodes emotional semantics into vectors. We train Emo2Vec by multi-task learning six different emotion-related tasks, including emotion/sentiment analysis, sarcasm classification, stress detection,…

Computation and Language · Computer Science 2018-09-13 Peng Xu , Andrea Madotto , Chien-Sheng Wu , Ji Ho Park , Pascale Fung

Word embedding models such as GloVe rely on co-occurrence statistics from a large corpus to learn vector representations of word meaning. These vectors have proven to capture surprisingly fine-grained semantic and syntactic information.…

Computation and Language · Computer Science 2017-11-16 Shoaib Jameel , Zied Bouraoui , Steven Schockaert

SemEval-2024 Task 8 provides a challenge to detect human-written and machine-generated text. There are 3 subtasks for different detection scenarios. This paper proposes a system that mainly deals with Subtask B. It aims to detect if given…

Computation and Language · Computer Science 2024-04-02 Renhua Gu , Xiangfeng Meng

Trustworthiness of generative language models (GLMs) is crucial in their deployment to critical decision making systems. Hence, certified risk control methods such as selective prediction and conformal prediction have been applied to…

Machine Learning · Computer Science 2025-01-28 Minjae Lee , Kyungmin Kim , Taesoo Kim , Sangdon Park

This paper presents our strategy to address the SemEval-2022 Task 3 PreTENS: Presupposed Taxonomies Evaluating Neural Network Semantics. The goal of the task is to identify if a sentence is deemed acceptable or not, depending on the…

Computation and Language · Computer Science 2022-10-10 Injy Sarhan , Pablo Mosteiro , Marco Spruit

Pretraining sentence encoders with language modeling and related unsupervised tasks has recently been shown to be very effective for language understanding tasks. By supplementing language model-style pretraining with further training on…

Computation and Language · Computer Science 2019-03-01 Jason Phang , Thibault Févry , Samuel R. Bowman

We present a novel approach to learn representations for sentence-level semantic similarity using conversational data. Our method trains an unsupervised model to predict conversational input-response pairs. The resulting sentence embeddings…

Computation and Language · Computer Science 2018-04-23 Yinfei Yang , Steve Yuan , Daniel Cer , Sheng-yi Kong , Noah Constant , Petr Pilar , Heming Ge , Yun-Hsuan Sung , Brian Strope , Ray Kurzweil

Popular word embedding methods such as word2vec and GloVe assign a single vector representation to each word, even if a word has multiple distinct meanings. Multi-sense embeddings instead provide different vectors for each sense of a word.…

Computation and Language · Computer Science 2019-04-03 Michael A. Hedderich , Andrew Yates , Dietrich Klakow , Gerard de Melo

This paper presents the team BRUMS submission to SemEval-2020 Task 3: Graded Word Similarity in Context. The system utilises state-of-the-art contextualised word embeddings, which have some task-specific adaptations, including stacked…

Computation and Language · Computer Science 2021-05-21 Hansi Hettiarachchi , Tharindu Ranasinghe

This paper describes a hypernym discovery system for our participation in the SemEval-2018 Task 9, which aims to discover the best (set of) candidate hypernyms for input concepts or entities, given the search space of a pre-defined…

Computation and Language · Computer Science 2018-05-29 Zhuosheng Zhang , Jiangtong Li , Hai Zhao , Bingjie Tang

We present a semi-supervised learning framework based on graph embeddings. Given a graph between instances, we train an embedding for each instance to jointly predict the class label and the neighborhood context in the graph. We develop…

Machine Learning · Computer Science 2016-05-30 Zhilin Yang , William W. Cohen , Ruslan Salakhutdinov