中文
相关论文

相关论文: Analyzing Aviation Safety Narratives with LDA, NMF…

200 篇论文

With the advent and popularity of big data mining and huge text analysis in modern times, automated text summarization became prominent for extracting and retrieving important information from documents. This research investigates aspects…

信息检索 · 计算机科学 2023-05-31 Daniel F. O. Onah , Elaine L. L. Pang , Mahmoud El-Haj

In this paper we present a model for unsupervised topic discovery in texts corpora. The proposed model uses documents, words, and topics lookup table embedding as neural network model parameters to build probabilities of words given topics,…

计算与语言 · 计算机科学 2019-11-26 Sileye 0. Ba

Topic Modeling is an approach used for automatic comprehension and classification of data in a variety of settings, and perhaps the canonical application is in uncovering thematic structure in a corpus of documents. A number of foundational…

机器学习 · 计算机科学 2012-04-13 Sanjeev Arora , Rong Ge , Ankur Moitra

With the development of technology, the use of social media has become quite common. Analyzing comments on social media in areas such as media and advertising plays an important role today. For this reason, new and traditional natural…

计算与语言 · 计算机科学 2021-10-04 Zekeriya Anil Guven , Banu Diri , Tolgahan Cakaloglu

Topic modeling is a state-of-the-art technique for analyzing text corpora. It uses a statistical model, most commonly Latent Dirichlet Allocation (LDA), to discover abstract topics that occur in the document collection. However, the…

人机交互 · 计算机科学 2021-10-19 Valerie Müller , Christian Sieg , Lars Linsen

Probabilistic topic models are generative models that describe the content of documents by discovering the latent topics underlying them. However, the structure of the textual input, and for instance the grouping of words in coherent text…

计算与语言 · 计算机科学 2016-06-02 Georgios Balikas , Massih-Reza Amini , Marianne Clausel

Topic models such as Latent Dirichlet Allocation (LDA) have been widely used in information retrieval for tasks ranging from smoothing and feedback methods to tools for exploratory search and discovery. However, classical methods for…

分布式、并行与集群计算 · 计算机科学 2017-06-20 Rolf Jagerman , Carsten Eickhoff , Maarten de Rijke

Topic models, such as latent Dirichlet allocation (LDA), can be useful tools for the statistical analysis of document collections and other discrete data. The LDA model assumes that the words of each document arise from a mixture of topics,…

应用统计 · 统计学 2009-09-29 David M. Blei , John D. Lafferty

We summarize our exploratory investigation into whether Machine Learning (ML) techniques applied to publicly available professional text can substantially augment strategic planning for astronomy. We find that an approach based on Latent…

数字图书馆 · 计算机科学 2024-07-04 Brian Thomas , Harley Thronson , Anthony Buonomo , Louis Barbier

Latent Dirichlet Allocation (LDA) models trained without stopword removal often produce topics with high posterior probabilities on uninformative words, obscuring the underlying corpus content. Even when canonical stopwords are manually…

计算与语言 · 计算机科学 2017-10-17 Angela Fan , Finale Doshi-Velez , Luke Miratrix

We present LDAExplore, a tool to visualize topic distributions in a given document corpus that are generated using Topic Modeling methods. Latent Dirichlet Allocation (LDA) is one of the basic methods that is predominantly used to generate…

信息检索 · 计算机科学 2015-07-24 Ashwinkumar Ganesan , Kiante Brantley , Shimei Pan , Jian Chen

Supervised topic models can help clinical researchers find interpretable cooccurence patterns in count data that are relevant for diagnostics. However, standard formulations of supervised Latent Dirichlet Allocation have two problems.…

The problem of topic modeling can be seen as a generalization of the clustering problem, in that it posits that observations are generated due to multiple latent factors (e.g., the words in each document are generated as a mixture of…

机器学习 · 计算机科学 2013-01-21 Animashree Anandkumar , Dean P. Foster , Daniel Hsu , Sham M. Kakade , Yi-Kai Liu

This paper presents an intertemporal bimodal network to analyze the evolution of the semantic content of a scientific field within the framework of topic modeling, namely using the Latent Dirichlet Allocation (LDA). The main contribution is…

计算与语言 · 计算机科学 2020-02-13 Luigi Di Caro , Marco Guerzoni , Massimiliano Nuccio , Giovanni Siragusa

We have used an unsupervised machine learning method called Latent Dirichlet Allocation (LDA) to thematically analyze all papers published in the Physics Education Research Conference Proceedings between 2001 and 2018. By looking at…

物理教育 · 物理学 2020-07-08 Tor Ole B. Odden , Alessandro Marin , Marcos D. Caballero

Context: Topic modeling finds human-readable structures in unstructured textual data. A widely used topic modeler is Latent Dirichlet allocation. When run on different datasets, LDA suffers from "order effects" i.e. different topics are…

软件工程 · 计算机科学 2018-03-16 Amritanshu Agrawal , Wei Fu , Tim Menzies

We introduce supervised latent Dirichlet allocation (sLDA), a statistical model of labelled documents. The model accommodates a variety of response types. We derive an approximate maximum-likelihood procedure for parameter estimation, which…

机器学习 · 统计学 2010-03-04 David M. Blei , Jon D. McAuliffe

The volume of textual data available in aviation safety reports presents a challenge for timely and accurate analysis. This paper examines how Artificial Intelligence (AI) and, specifically, Natural Language Processing (NLP) can automate…

人工智能 · 计算机科学 2025-06-03 Aziida Nanyonga , Graham Wild

Text mining methods are used for a wide range of Software Engineering (SE) tasks. The biggest challenge of text mining is high dimensional data, i.e., a corpus of documents can contain $10^4$ to $10^6$ unique words. To address this…

软件工程 · 计算机科学 2018-05-01 Amritanshu Agrawal , Huy Tu , Tim Menzies

A text mining approach is proposed based on latent Dirichlet allocation (LDA) to analyze the Consumer Financial Protection Bureau (CFPB) consumer complaints. The proposed approach aims to extract latent topics in the CFPB complaint…

信息检索 · 计算机科学 2018-07-20 Kaveh Bastani , Hamed Namavari , Jeffry Shaffer