English
Related papers

Related papers: A Novel Method of Fuzzy Topic Modeling based on Tr…

200 papers

Aspect-based opinion mining is widely applied to review data to aggregate or summarize opinions of a product, and the current state-of-the-art is achieved with Latent Dirichlet Allocation (LDA)-based model. Although social media data like…

Computation and Language · Computer Science 2016-09-22 Kar Wai Lim , Wray Buntine

Contextualised word vectors obtained via pre-trained language models encode a variety of knowledge that has already been exploited in applications. Complementary to these language models are probabilistic topic models that learn thematic…

Computation and Language · Computer Science 2023-01-12 Mozhgan Talebpour , Alba Garcia Seco de Herrera , Shoaib Jameel

The embedded topic model (ETM) is a widely used approach that assumes the sampled document-topic distribution conforms to the logistic normal distribution for easier optimization. However, this assumption oversimplifies the real…

Computation and Language · Computer Science 2025-01-03 Wei Shao , Mingyang Liu , Linqi Song

Topic modelling is fundamentally a soft clustering problem (of known objects -- documents, over unknown clusters -- topics). That is, the task is incorrectly posed. In particular, the topic models are unstable and incomplete. All this leads…

Computation and Language · Computer Science 2024-09-27 Alex Gorbulev , Vasiliy Alekseev , Konstantin Vorontsov

We investigate the problem of learning a topic model - the well-known Latent Dirichlet Allocation - in a distributed manner, using a cluster of C processors and dividing the corpus to be learned equally among them. We propose a simple…

Machine Learning · Computer Science 2009-09-28 James Petterson , Tiberio Caetano

This study explores the application of topic modelling techniques Latent Dirichlet Allocation (LDA), Nonnegative Matrix Factorization (NMF), and Probabilistic Latent Semantic Analysis (PLSA) on the Socrata dataset spanning from 1908 to…

Machine Learning · Computer Science 2025-01-06 Aziida Nanyonga , Graham Wild

In the new global era, determining trends can play an important role in guiding researchers, scientists, and agencies. The main faced challenge is to track the emerging topics among the stacked publications. Therefore, any study done to…

Computational Engineering, Finance, and Science · Computer Science 2023-10-25 Sila Ovgu Korkut , Oznur Oztunc Kaymak , Aytug Onan , Erman Ulker , Femin Yalcin

Financial news items are unstructured sources of information that can be mined to extract knowledge for market screening applications. Manual extraction of relevant information from the continuous stream of finance-related news is…

Sparse and short news headlines can be arbitrary, noisy, and ambiguous, making it difficult for classic topic model LDA (latent Dirichlet allocation) designed for accommodating long text to discover knowledge from them. Nonetheless, some of…

Statistical Finance · Quantitative Finance 2021-07-02 Yun Bai , Xixi Li , Hao Yu , Suling Jia

Latent Dirichlet Allocation (LDA) is a topic model widely used in natural language processing and machine learning. Most approaches to training the model rely on iterative algorithms, which makes it difficult to run LDA on big corpora that…

Machine Learning · Statistics 2020-10-23 Alexander Terenin , Måns Magnusson , Leif Jonsson , David Draper

To solve the big topic modeling problem, we need to reduce both time and space complexities of batch latent Dirichlet allocation (LDA) algorithms. Although parallel LDA algorithms on the multi-processor architecture have low time and space…

Machine Learning · Computer Science 2013-11-19 Jian-Feng Yan , Jia Zeng , Zhi-Qiang Liu , Yang Gao

Topic modeling is a powerful technique for uncovering hidden themes within a collection of documents. However, the effectiveness of traditional topic models often relies on sufficient word co-occurrence, which is lacking in short texts.…

Computation and Language · Computer Science 2024-10-22 Pritom Saha Akash , Kevin Chen-Chuan Chang

The recent advancement of large language models has spurred a growing trend of integrating pre-trained language model (PLM) embeddings into topic models, fundamentally reshaping how topics capture semantic structure. Classical models such…

Computation and Language · Computer Science 2026-03-12 Hanlin Xiao , Mauricio A. Álvarez , Rainer Breitling

A common task in many political institutions (i.e. Parliament) is to find politicians who are experts in a particular field. In order to tackle this problem, the first step is to obtain politician profiles which include their interests, and…

Information Retrieval · Computer Science 2024-01-22 Luis M. de Campos , Juan M. Fernández-Luna , Juan F. Huete , Luis Redondo-Expósito

In this paper, we propose a novel online topic tracking framework, named IEDL, for tracking the topic changes related to deep learning techniques on Stack Exchange and automatically interpreting each identified topic. The proposed framework…

Information Retrieval · Computer Science 2019-07-04 Fenglei Jin , Cuiyun Gao , Michael R. Lyu

Topic models are a popular tool for understanding text collections, but their evaluation has been a point of contention. Automated evaluation metrics such as coherence are often used, however, their validity has been questioned for neural…

Computation and Language · Computer Science 2024-02-21 Zongxia Li , Andrew Mao , Daniel Stephens , Pranav Goel , Emily Walpole , Alden Dima , Juan Fung , Jordan Boyd-Graber

Topic modeling is a technique for organizing and extracting themes from large collections of unstructured text. Non-negative matrix factorization (NMF) is a common unsupervised approach that decomposes a term frequency-inverse document…

Machine Learning · Computer Science 2024-07-30 Selma Wanna , Ryan Barron , Nick Solovyev , Maksim E. Eren , Manish Bhattarai , Kim Rasmussen , Boian S. Alexandrov

We propose a new algorithm for topic modeling, Vec2Topic, that identifies the main topics in a corpus using semantic information captured via high-dimensional distributed word embeddings. Our technique is unsupervised and generates a list…

Computation and Language · Computer Science 2016-03-16 Ramandeep S Randhawa , Parag Jain , Gagan Madan

In this technical report, we present jLDADMM---an easy-to-use Java toolkit for conventional topic models. jLDADMM is released to provide alternatives for topic modeling on normal or short texts. It provides implementations of the Latent…

Information Retrieval · Computer Science 2018-08-14 Dat Quoc Nguyen

The present study proposes a novel method of trend detection and visualization - more specifically, modeling the change in a topic over time. Where current models used for the identification and visualization of trends only convey the…

Computation and Language · Computer Science 2023-09-19 Angad Sandhu , Aneesh Edara , Vishesh Narayan , Faizan Wajid , Ashok Agrawala