中文
相关论文

相关论文: An Analysis of Lemmatization on Topic Models of Mo…

200 篇论文

Topic models are used to identify and group similar themes in a set of documents. Recent advancements in deep learning based neural topic models has received significant research interest. In this paper, an approach is proposed that further…

计算与语言 · 计算机科学 2024-10-15 Trishia Khandelwal

We critically evaluate the widespread assumption that deep learning NLP models do not require lemmatized input. To test this, we trained versions of contextualised word embedding ELMo models on raw tokenized corpora and on the corpora with…

计算与语言 · 计算机科学 2019-09-10 Andrey Kutuzov , Elizaveta Kuzmenko

Lemmatization is a natural language processing (NLP) task which consists of producing, from a given inflected word, its canonical form or lemma. Lemmatization is one of the basic tasks that facilitate downstream NLP applications, and is of…

计算与语言 · 计算机科学 2023-10-23 Olia Toporkov , Rodrigo Agerri

Text preprocessing is a fundamental component of Natural Language Processing, involving techniques such as stopword removal, stemming, and lemmatization to prepare text as input for further processing and analysis. Despite the…

计算与语言 · 计算机科学 2025-10-14 Marco Braga , Gian Carlo Milanese , Gabriella Pasi

Lemmatization aims to reduce the sparse data problem by relating the inflected forms of a word to its dictionary form. Using context can help, both for unseen and ambiguous words. Yet most context-sensitive approaches require full…

计算与语言 · 计算机科学 2019-07-02 Toms Bergmanis , Sharon Goldwater

Lemmatization is the process of grouping together the inflected forms of a word so they can be analysed as a single item, identified by the word's lemma, or dictionary form. In computational linguistics, lemmatisation is the algorithmic…

计算与语言 · 计算机科学 2022-07-26 Michal Karwatowski , Marcin Pietron

The number of documents available into Internet moves each day up. For this reason, processing this amount of information effectively and expressibly becomes a major concern for companies and scientists. Methods that represent a textual…

Topic modeling analyzes a collection of documents to learn meaningful patterns of words. However, previous topic models consider only the spelling of words and do not take into consideration the homography of words. In this study, we…

计算与语言 · 计算机科学 2024-10-04 Takashi Shibuya , Takehito Utsuro

Text stemming is a natural language processing technique that is used to reduce words to their base form, also known as the root form. The use of stemming in IR has been shown to often improve the effectiveness of keyword-matching models…

信息检索 · 计算机科学 2024-02-20 Shuai Wang , Shengyao Zhuang , Guido Zuccon

Modeling topics effectively in short texts, such as tweets and news snippets, is crucial to capturing rapidly evolving social trends. Existing topic models often struggle to accurately capture the underlying semantic patterns of short…

计算与语言 · 计算机科学 2025-02-18 Shuyu Chang , Rui Wang , Peng Ren , Qi Wang , Haiping Huang

Topic modeling is a widely used technique for revealing underlying thematic structures within textual data. However, existing models have certain limitations, particularly when dealing with short text datasets that lack co-occurring words.…

人工智能 · 计算机科学 2023-12-18 Han Wang , Nirmalendu Prakash , Nguyen Khoi Hoang , Ming Shan Hee , Usman Naseem , Roy Ka-Wei Lee

Lemmatization of standard languages is concerned with (i) abstracting over morphological differences and (ii) resolving token-lemma ambiguities of inflected words in order to map them to a dictionary headword. In the present paper we aim to…

计算与语言 · 计算机科学 2019-03-19 Enrique Manjavacas , Ákos Kádár , Mike Kestemont

Topic models extract groups of words from documents, whose interpretation as a topic hopefully allows for a better understanding of the data. However, the resulting word groups are often not coherent, making them harder to interpret.…

计算与语言 · 计算机科学 2021-06-18 Federico Bianchi , Silvia Terragni , Dirk Hovy

Probabilistic topic models are widely used to discover latent topics in document collections, while latent feature vector representations of words have been used to obtain high performance in many NLP tasks. In this paper, we extend two…

计算与语言 · 计算机科学 2018-10-16 Dat Quoc Nguyen , Richard Billingsley , Lan Du , Mark Johnson

Topic modeling is a well-established technique for exploring text corpora. Conventional topic models (e.g., LDA) represent topics as bags of words that often require "reading the tea leaves" to interpret; additionally, they offer users…

计算与语言 · 计算机科学 2024-04-03 Chau Minh Pham , Alexander Hoyle , Simeng Sun , Philip Resnik , Mohit Iyyer

In Automatic Text Summarization, preprocessing is an important phase to reduce the space of textual representation. Classically, stemming and lemmatization have been widely used for normalizing words. However, even using normalization on…

信息检索 · 计算机科学 2012-09-17 Juan-Manuel Torres-Moreno

Topic modelling, as a well-established unsupervised technique, has found extensive use in automatically detecting significant topics within a corpus of documents. However, classic topic modelling approaches (e.g., LDA) have certain…

计算与语言 · 计算机科学 2024-03-27 Yida Mu , Chun Dong , Kalina Bontcheva , Xingyi Song

Topic modeling analyzes documents to learn meaningful patterns of words. However, existing topic models fail to learn interpretable topics when working with large and heavy-tailed vocabularies. To this end, we develop the Embedded Topic…

信息检索 · 计算机科学 2019-07-12 Adji B. Dieng , Francisco J. R. Ruiz , David M. Blei

Topics generated by topic models are typically represented as list of terms. To reduce the cognitive overhead of interpreting these topics for end-users, we propose labelling a topic with a succinct phrase that summarises its theme or idea.…

计算与语言 · 计算机科学 2016-12-26 Shraey Bhatia , Jey Han Lau , Timothy Baldwin

We investigate the extent to which modern, neural language models are susceptible to structural priming, the phenomenon whereby the structure of a sentence makes the same structure more probable in a follow-up sentence. We explore how…

计算与语言 · 计算机科学 2022-06-30 Arabella Sinclair , Jaap Jumelet , Willem Zuidema , Raquel Fernández
‹ 上一页 1 2 3 10 下一页 ›