中文
相关论文

相关论文: Towards Big Topic Modeling

200 篇论文

Latent Dirichlet Allocation (LDA) is a popular tool for analyzing discrete count data such as text and images. Applications require LDA to handle both large datasets and a large number of topics. Though distributed CPU systems have been…

分布式、并行与集群计算 · 计算机科学 2024-06-21 Kaiwei Li , Jianfei Chen , Wenguang Chen , Jun Zhu

Topic models have emerged as fundamental tools in unsupervised machine learning. Most modern topic modeling algorithms take a probabilistic view and derive inference algorithms based on Latent Dirichlet Allocation (LDA) or its variants. In…

机器学习 · 计算机科学 2016-05-30 Ke Jiang , Suvrit Sra , Brian Kulis

In the internet era there has been an explosion in the amount of digital text information available, leading to difficulties of scale for traditional inference algorithms for topic models. Recent advances in stochastic variational inference…

机器学习 · 计算机科学 2013-05-14 James Foulds , Levi Boyles , Christopher Dubois , Padhraic Smyth , Max Welling

The problem of topic modeling can be seen as a generalization of the clustering problem, in that it posits that observations are generated due to multiple latent factors (e.g., the words in each document are generated as a mixture of…

机器学习 · 计算机科学 2013-01-21 Animashree Anandkumar , Dean P. Foster , Daniel Hsu , Sham M. Kakade , Yi-Kai Liu

Using the 6,638 case descriptions of societal impact submitted for evaluation in the Research Excellence Framework (REF 2014), we replicate the topic model (Latent Dirichlet Allocation or LDA) made in this context and compare the results…

计算与语言 · 计算机科学 2018-06-05 Tobias Hecking , Loet Leydesdorff

In this paper, we provide the first practical algorithms with provable guarantees for the problem of inferring the topics assigned to each document in an LDA topic model. This is the primary inference problem for many applications of topic…

机器学习 · 计算机科学 2025-06-10 Adam Breuer

Latent Dirichlet Allocation (LDA) is a popular topic modeling technique for exploring document collections. Because of the increasing prevalence of large datasets, there is a need to improve the scalability of inference of LDA. In this…

人工智能 · 计算机科学 2011-07-20 Ke Zhai , Jordan Boyd-Graber , Nima Asadi

Learning meaningful topic models with massive document collections which contain millions of documents and billions of tokens is challenging because of two reasons: First, one needs to deal with a large number of topics (typically in the…

分布式、并行与集群计算 · 计算机科学 2014-12-17 Hsiang-Fu Yu , Cho-Jui Hsieh , Hyokun Yun , S. V. N Vishwanathan , Inderjit S. Dhillon

For organizing large text corpora topic modeling provides useful tools. A widely used method is Latent Dirichlet Allocation (LDA), a generative probabilistic model which models single texts in a collection of texts as mixtures of latent…

计算与语言 · 计算机科学 2020-04-02 Jonas Rieger , Lars Koppers , Carsten Jentsch , Jörg Rahnenführer

This paper presents our recent efforts, zenLDA, an efficient and scalable Collapsed Gibbs Sampling system for Latent Dirichlet Allocation training, which is thought to be challenging that both data parallelism and model parallelism are…

分布式、并行与集群计算 · 计算机科学 2015-11-23 Bo Zhao , Hucheng Zhou , Guoqiang Li , Yihua Huang

Probabilistic topic models are popular unsupervised learning methods, including probabilistic latent semantic indexing (pLSI) and latent Dirichlet allocation (LDA). By now, their training is implemented on general purpose computers (GPCs),…

机器学习 · 计算机科学 2018-04-11 Zihao Xiao , Jianfei Chen , Jun Zhu

Probabilistic topic models like Latent Dirichlet Allocation (LDA) have been previously extended to the bilingual setting. A fundamental modeling assumption in several of these extensions is that the input corpora are in the form of document…

计算与语言 · 计算机科学 2021-12-01 Georgios Balikas , Massih-Reza Amini , Marianne Clausel

Topic models, and more specifically the class of Latent Dirichlet Allocation (LDA), are widely used for probabilistic modeling of text. MCMC sampling from the posterior distribution is typically performed using a collapsed Gibbs sampler. We…

机器学习 · 统计学 2017-08-16 Måns Magnusson , Leif Jonsson , Mattias Villani , David Broman

Topic models, such as latent Dirichlet allocation (LDA), can be useful tools for the statistical analysis of document collections and other discrete data. The LDA model assumes that the words of each document arise from a mixture of topics,…

应用统计 · 统计学 2009-09-29 David M. Blei , John D. Lafferty

The increasing volume of short texts generated on social media sites, such as Twitter or Facebook, creates a great demand for effective and efficient topic modeling approaches. While latent Dirichlet allocation (LDA) can be applied, it is…

计算与语言 · 计算机科学 2013-01-29 Jeon-Hyung Kang , Jun Ma , Yan Liu

Despite many years of research into latent Dirichlet allocation (LDA), applying LDA to collections of non-categorical items is still challenging. Yet many problems with much richer data share a similar structure and could benefit from the…

机器学习 · 统计学 2020-01-08 Iryna Korshunova , Hanchen Xiong , Mateusz Fedoryszak , Lucas Theis

This paper presents an intertemporal bimodal network to analyze the evolution of the semantic content of a scientific field within the framework of topic modeling, namely using the Latent Dirichlet Allocation (LDA). The main contribution is…

计算与语言 · 计算机科学 2020-02-13 Luigi Di Caro , Marco Guerzoni , Massimiliano Nuccio , Giovanni Siragusa

One of the main computational and scientific challenges in the modern age is to extract useful information from unstructured texts. Topic models are one popular machine-learning approach which infers the latent topical structure of a…

机器学习 · 统计学 2018-07-20 Martin Gerlach , Tiago P. Peixoto , Eduardo G. Altmann

Topic modeling is admittedly a convenient way to monitor markets trend. Conventionally, Latent Dirichlet Allocation, LDA, is considered a must-do model to gain this type of information. By given the merit of deducing keyword with token…

计算与语言 · 计算机科学 2023-09-19 Ching-Hsun Tseng , Shin-Jye Lee , Po-Wei Cheng , Chien Lee , Chih-Chieh Hung

Developing efficient and scalable algorithms for Latent Dirichlet Allocation (LDA) is of wide interest for many applications. Previous work has developed an O(1) Metropolis-Hastings sampling method for each token. However, the performance…

机器学习 · 统计学 2016-03-03 Jianfei Chen , Kaiwei Li , Jun Zhu , Wenguang Chen