English
Related papers

Related papers: Will it Unblend?

200 papers

Most statistical machine translation systems cannot translate words that are unseen in the training data. However, humans can translate many classes of out-of-vocabulary (OOV) words (e.g., novel morphological variants, misspellings, and…

Computation and Language · Computer Science 2018-08-20 Nelson F. Liu , Jonathan May , Michael Pust , Kevin Knight

Word vector representations open up new opportunities to extract useful information from unstructured text. Defining a word as a vector made it easy for the machine learning algorithms to understand a text and extract information from. Word…

Computation and Language · Computer Science 2021-05-19 Mohammed Ibrahim , Susan Gauch , Tyler Gerth , Brandon Cox

We propose an innovative token representation and update method in a new ultra-small language model: the Wave network. Specifically, we use a complex vector to represent each token, encoding both global and local semantics of the input…

Computation and Language · Computer Science 2024-11-12 Xin Zhang , Victor S. Sheng

Recent studies on neural networks with pre-trained weights (i.e., BERT) have mainly focused on a low-dimensional subspace, where the embedding vectors computed from input words (or their contexts) are located. In this work, we propose a new…

Computation and Language · Computer Science 2021-05-17 Seonghyeon Lee , Dongha Lee , Hwanjo Yu

Standard pretrained language models operate on sequences of subword tokens without direct access to the characters that compose each token's string representation. We probe the embedding layer of pretrained language models and show that…

Computation and Language · Computer Science 2022-06-09 Itay Itzhak , Omer Levy

We use paraphrases as a unique source of data to analyze contextualized embeddings, with a particular focus on BERT. Because paraphrases naturally encode consistent word and phrase semantics, they provide a unique lens for investigating…

Computation and Language · Computer Science 2022-07-13 Laura Burdick , Jonathan K. Kummerfeld , Rada Mihalcea

Implicit discourse relation classification is one of the most difficult parts in shallow discourse parsing as the relation prediction without explicit connectives requires the language understanding at both the text span level and the…

Computation and Language · Computer Science 2020-04-29 Xin Liu , Jiefu Ou , Yangqiu Song , Xin Jiang

Word embeddings are substantially successful in capturing semantic relations among words. However, these lexical semantics are difficult to be interpreted. Definition modeling provides a more intuitive way to evaluate embeddings by…

Computation and Language · Computer Science 2020-07-21 Haitong Zhang , Yongping Du , Jiaxin Sun , Qingxiao Li

Developing high-performance entity normalization algorithms that can alleviate the term variation problem is of great interest to the biomedical community. Although deep learning-based methods have been successfully applied to biomedical…

Information Retrieval · Computer Science 2019-08-12 Zongcheng Ji , Qiang Wei , Hua Xu

This paper investigates the problem of learning cross-lingual representations in a contextual space. We propose Cross-Lingual BERT Transformation (CLBT), a simple and efficient approach to generate cross-lingual contextualized word…

Computation and Language · Computer Science 2019-09-17 Yuxuan Wang , Wanxiang Che , Jiang Guo , Yijia Liu , Ting Liu

Phrase representations derived from BERT often do not exhibit complex phrasal compositionality, as the model relies instead on lexical similarity to determine semantic relatedness. In this paper, we propose a contrastive fine-tuning…

Computation and Language · Computer Science 2021-10-15 Shufan Wang , Laure Thompson , Mohit Iyyer

This paper presents a performance study of transformer language models under different hardware configurations and accuracy requirements and derives empirical observations about these resource/accuracy trade-offs. In particular, we study…

Computation and Language · Computer Science 2024-03-08 Souvika Sarkar , Mohammad Fakhruddin Babar , Md Mahadi Hassan , Monowar Hasan , Shubhra Kanti Karmaker Santu

Pretraining deep language models has led to large performance gains in NLP. Despite this success, Schick and Sch\"utze (2020) recently showed that these models struggle to understand rare words. For static word embeddings, this problem has…

Computation and Language · Computer Science 2020-04-30 Timo Schick , Hinrich Schütze

This study investigates the internal representations of verb-particle combinations, called multi-word verbs, within transformer-based large language models (LLMs), specifically examining how these models capture lexical and syntactic…

Computation and Language · Computer Science 2025-02-10 Hassane Kissane , Achim Schilling , Patrick Krauss

This paper presents final results of the Out-Of-Vocabulary 2022 (OOV) challenge. The OOV contest introduces an important aspect that is not commonly studied by Optical Character Recognition (OCR) models, namely, the recognition of unseen…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Sergi Garcia-Bordils , Andrés Mafla , Ali Furkan Biten , Oren Nuriel , Aviad Aberdam , Shai Mazor , Ron Litman , Dimosthenis Karatzas

Spelling irregularities, known now as spelling mistakes, have been found for several centuries. As humans, we are able to understand most of the misspelled words based on their location in the sentence, perceived pronunciation, and context.…

Computation and Language · Computer Science 2021-01-12 Yifei Hu , Xiaonan Jing , Youlim Ko , Julia Taylor Rayz

In creating sentence embeddings for Natural Language Inference (NLI) tasks, using transformer-based models like BERT leads to high accuracy, but require hundreds of millions of parameters. These models take in sentences as a sequence of…

Computation and Language · Computer Science 2025-12-17 Jason Lunder

While BERT is an effective method for learning monolingual sentence embeddings for semantic similarity and embedding based transfer learning (Reimers and Gurevych, 2019), BERT based cross-lingual sentence embeddings have yet to be explored.…

Computation and Language · Computer Science 2022-03-09 Fangxiaoyu Feng , Yinfei Yang , Daniel Cer , Naveen Arivazhagan , Wei Wang

Machine translation models have discrete vocabularies and commonly use subword segmentation techniques to achieve an 'open vocabulary.' This approach relies on consistent and correct underlying unicode sequences, and makes models…

Computation and Language · Computer Science 2021-12-13 Elizabeth Salesky , David Etter , Matt Post

Named Entity Recognition systems achieve remarkable performance on domains such as English news. It is natural to ask: What are these models actually learning to achieve this? Are they merely memorizing the names themselves? Or are they…

Computation and Language · Computer Science 2021-01-05 Oshin Agarwal , Yinfei Yang , Byron C. Wallace , Ani Nenkova