中文
相关论文

相关论文: Evaluation of Morphological Embeddings for English…

200 篇论文

Conventional word embeddings represent words with fixed vectors, which are usually trained based on co-occurrence patterns among words. In doing so, however, the power of such representations is limited, where the same word might be…

计算与语言 · 计算机科学 2020-01-10 Hongming Zhang , Jiaxin Bai , Yan Song , Kun Xu , Changlong Yu , Yangqiu Song , Wilfred Ng , Dong Yu

In this paper, our main contributions are that embeddings from relatively smaller corpora can outperform ones from larger corpora and we make the new Swedish analogy test set publicly available. To achieve a good network performance in…

计算与语言 · 计算机科学 2021-04-20 Tosin P. Adewumi , Foteini Liwicki , Marcus Liwicki

A review of Word Embedding Models through a deconstructive approach reveals their several shortcomings and inconsistencies. These include instability of the vector representations, a distorted analogical reasoning, geometric incompatibility…

计算与语言 · 计算机科学 2019-02-05 Koushik Varma Kalidindi

Word embeddings or distributed representations of words are being used in various applications like machine translation, sentiment analysis, topic identification etc. Quality of word embeddings and performance of their applications depends…

计算与语言 · 计算机科学 2020-03-09 Erion Çano , Maurizio Morisio

We present three innovations in tokenization and subword segmentation. First, we propose to use unsupervised morphological analysis with Morfessor as pre-tokenization. Second, we present an algebraic method for obtaining subword embeddings…

计算与语言 · 计算机科学 2024-10-04 Jindřich Libovický , Jindřich Helcl

Word embeddings are usually derived from corpora containing text from many individuals, thus leading to general purpose representations rather than individually personalized representations. While personalized embeddings can be useful to…

计算与语言 · 计算机科学 2020-11-22 Charles Welch , Jonathan K. Kummerfeld , Verónica Pérez-Rosas , Rada Mihalcea

Word embeddings are fixed-length, dense and distributed word representations that are used in natural language processing (NLP) applications. There are basically two types of word embedding models which are non-contextual (static) models…

计算与语言 · 计算机科学 2024-05-14 Karahan Sarıtaş , Cahid Arda Öz , Tunga Güngör

Word embeddings are an essential instrument in many NLP tasks. Most available resources are trained on general language from Web corpora or Wikipedia dumps. However, word embeddings for domain-specific language are rare, in particular for…

计算与语言 · 计算机科学 2023-02-14 Ricardo Schiffers , Dagmar Kern , Daniel Hienert

Distributed word embeddings have shown superior performances in numerous Natural Language Processing (NLP) tasks. However, their performances vary significantly across different tasks, implying that the word embeddings learnt by those…

计算与语言 · 计算机科学 2017-09-21 Danushka Bollegala , Kohei Hayashi , Ken-ichi Kawarabayashi

This paper presents a scalable method for integrating compositional morphological representations into a vector-based probabilistic language model. Our approach is evaluated in the context of log-bilinear language models, rendered suitably…

计算与语言 · 计算机科学 2014-05-19 Jan A. Botha , Phil Blunsom

Prior studies in multilingual language modeling (e.g., Cotterell et al., 2018; Mielke et al., 2019) disagree on whether or not inflectional morphology makes languages harder to model. We attempt to resolve the disagreement and extend those…

计算与语言 · 计算机科学 2021-03-29 Hyunji Hayley Park , Katherine J. Zhang , Coleman Haley , Kenneth Steimel , Han Liu , Lane Schwartz

Traditional neural word embeddings are usually dependent on a richer diversity of vocabulary. However, the language models recline to cover major vocabularies via the word embedding parameters, in particular, for multilingual language…

计算与语言 · 计算机科学 2023-08-21 Amit Kumar Jaiswal , Haiming Liu

We analyze a word embedding method in supervised tasks. It maps words on a sphere such that words co-occurring in similar contexts lie closely. The similarity of contexts is measured by the distribution of substitutes that can fill them. We…

计算与语言 · 计算机科学 2014-07-28 Volkan Cirik , Deniz Yuret

This study investigates the impact of morphological typology on tokenization and language modeling performance. We focus on languages with synthetic and analytical morphological structures and examine their productivity when tokenized using…

计算与语言 · 计算机科学 2024-11-01 Iñigo Parra

Word embeddings capture semantic relationships based on contextual information and are the basis for a wide variety of natural language processing applications. Notably these relationships are solely learned from the data and subsequently…

计算与语言 · 计算机科学 2020-01-15 Stephanie Brandl , David Lassner , Maximilian Alber

We propose spoken sentence embeddings which capture both acoustic and linguistic content. While existing works operate at the character, phoneme, or word level, our method learns long-term dependencies by modeling speech at the sentence…

声音 · 计算机科学 2019-02-22 Albert Haque , Michelle Guo , Prateek Verma , Li Fei-Fei

Self-supervised speech models can be trained to efficiently recognize spoken words in naturalistic, noisy environments. However, we do not understand the types of linguistic representations these models use to accomplish this task. To…

计算与语言 · 计算机科学 2025-09-30 Jon Gauthier , Canaan Breiss , Matthew Leonard , Edward F. Chang

Word embedding pioneered by Mikolov et al. is a staple technique for word representations in natural language processing (NLP) research which has also found popularity in music information retrieval tasks. Depending on the type of text data…

信息检索 · 计算机科学 2020-08-05 Seungheon Doh , Jongpil Lee , Tae Hong Park , Juhan Nam

Word embeddings represent a transformative technology for analyzing text data in social work research, offering sophisticated tools for understanding case notes, policy documents, research literature, and other text-based materials. This…

计算与语言 · 计算机科学 2024-11-12 Brian E. Perron , Kelley A. Rivenburgh , Bryan G. Victor , Zia Qi , Hui Luan

Bilingual word embeddings represent words of two languages in the same space, and allow to transfer knowledge from one language to the other without machine translation. The main approach is to train monolingual embeddings first and then…

计算与语言 · 计算机科学 2018-04-24 J. Goikoetxea , A. Soroa , E. Agirre