中文
相关论文

相关论文: n-stage Latent Dirichlet Allocation: A Novel Appro…

200 篇论文

Topic modeling is widely used for analytically evaluating large collections of textual data. One of the most popular topic techniques is Latent Dirichlet Allocation (LDA), which is flexible and adaptive, but not optimal for e.g. short texts…

计算与语言 · 计算机科学 2022-12-19 Muriël de Groot , Mohammad Aliannejadi , Marcel R. Haas

Topic models, such as latent Dirichlet allocation (LDA), can be useful tools for the statistical analysis of document collections and other discrete data. The LDA model assumes that the words of each document arise from a mixture of topics,…

应用统计 · 统计学 2009-09-29 David M. Blei , John D. Lafferty

Latent Dirichlet Allocation (LDA) is a popular topic modeling technique for hidden semantic discovery of text data and serves as a fundamental tool for text analysis in various applications. However, the LDA model as well as the training…

机器学习 · 计算机科学 2020-10-12 Fangyuan Zhao , Xuebin Ren , Shusen Yang , Qing Han , Peng Zhao , Xinyu Yang

For organizing large text corpora topic modeling provides useful tools. A widely used method is Latent Dirichlet Allocation (LDA), a generative probabilistic model which models single texts in a collection of texts as mixtures of latent…

计算与语言 · 计算机科学 2020-04-02 Jonas Rieger , Lars Koppers , Carsten Jentsch , Jörg Rahnenführer

Word clouds became a standard tool for presenting results of natural language processing methods such as topic modelling. They exhibit most important words, where word size is often chosen proportional to the relevance of words within a…

统计计算 · 统计学 2023-02-14 Peter Winker

Topic models have emerged as fundamental tools in unsupervised machine learning. Most modern topic modeling algorithms take a probabilistic view and derive inference algorithms based on Latent Dirichlet Allocation (LDA) or its variants. In…

机器学习 · 计算机科学 2016-05-30 Ke Jiang , Suvrit Sra , Brian Kulis

Latent Dirichlet Allocation (LDA) is a topic model widely used in natural language processing and machine learning. Most approaches to training the model rely on iterative algorithms, which makes it difficult to run LDA on big corpora that…

机器学习 · 统计学 2020-10-23 Alexander Terenin , Måns Magnusson , Leif Jonsson , David Draper

Developing efficient and scalable algorithms for Latent Dirichlet Allocation (LDA) is of wide interest for many applications. Previous work has developed an O(1) Metropolis-Hastings sampling method for each token. However, the performance…

机器学习 · 统计学 2016-03-03 Jianfei Chen , Kaiwei Li , Jun Zhu , Wenguang Chen

Topic modeling is a state-of-the-art technique for analyzing text corpora. It uses a statistical model, most commonly Latent Dirichlet Allocation (LDA), to discover abstract topics that occur in the document collection. However, the…

人机交互 · 计算机科学 2021-10-19 Valerie Müller , Christian Sieg , Lars Linsen

We study a parametric family of latent variable models, namely topic models, equipped with a hierarchical structure among the topic variables. Such models may be viewed as a finite mixture of the latent Dirichlet allocation (LDA) induced…

统计理论 · 数学 2024-08-27 Sunrit Chakraborty , Rayleigh Lei , XuanLong Nguyen

Latent Dirichlet Allocation (LDA) mining thematic structure of documents plays an important role in nature language processing and machine learning areas. However, the probability distribution from LDA only describes the statistical…

计算与语言 · 计算机科学 2015-06-30 Li-Qiang Niu , Xin-Yu Dai

Selecting in-domain data from a large pool of diverse and out-of-domain data is a non-trivial problem. In most cases simply using all of the available data will lead to sub-optimal and in some cases even worse performance compared to…

计算与语言 · 计算机科学 2019-07-03 Mortaza , Doulaty , Thomas Hain

Most of the information on the Internet is represented in the form of microtexts, which are short text snippets such as news headlines or tweets. These sources of information are abundant, and mining these data could uncover meaningful…

计算与语言 · 计算机科学 2019-09-17 Trung Trinh , Tho Quan , Trung Mai

Latent Dirichlet Allocation (LDA) model is a famous model in the topic model field, it has been studied for years due to its extensive application value in industry and academia. However, the mathematical derivation of LDA model is…

信息检索 · 计算机科学 2019-08-28 Chen Ma

In the internet era there has been an explosion in the amount of digital text information available, leading to difficulties of scale for traditional inference algorithms for topic models. Recent advances in stochastic variational inference…

机器学习 · 计算机科学 2013-05-14 James Foulds , Levi Boyles , Christopher Dubois , Padhraic Smyth , Max Welling

Conventional bag-of-words approaches for topic modeling, like latent Dirichlet allocation (LDA), struggle with literary text. Literature challenges lexical methods because narrative language focuses on immersive sensory details instead of…

计算与语言 · 计算机科学 2025-05-30 Li Lucy , Camilla Griffiths , Sarah Levine , Jennifer L. Eberhardt , Dorottya Demszky , David Bamman

An initial procedure in text-as-data applications is text preprocessing. One of the typical steps, which can substantially facilitate computations, consists in removing infrequent words believed to provide limited information about the…

计算与语言 · 计算机科学 2023-11-27 Victor Bystrov , Viktoriia Naboka-Krell , Anna Staszewska-Bystrova , Peter Winker

In this work, automatic analysis of themes contained in a large corpora of judgments from public procurement domain is performed. The employed technique is unsupervised latent Dirichlet allocation (LDA). In addition, it is proposed, to use…

计算与语言 · 计算机科学 2014-12-18 Michał Łopuszyński

A common task in many political institutions (i.e. Parliament) is to find politicians who are experts in a particular field. In order to tackle this problem, the first step is to obtain politician profiles which include their interests, and…

信息检索 · 计算机科学 2024-01-22 Luis M. de Campos , Juan M. Fernández-Luna , Juan F. Huete , Luis Redondo-Expósito

The increasing volume of short texts generated on social media sites, such as Twitter or Facebook, creates a great demand for effective and efficient topic modeling approaches. While latent Dirichlet allocation (LDA) can be applied, it is…

计算与语言 · 计算机科学 2013-01-29 Jeon-Hyung Kang , Jun Ma , Yan Liu