English
Related papers

Related papers: Distributed Asymmetric Allocation: A Topic Model f…

200 papers

This article presents a probabilistic generative model for text based on semantic topics and syntactic classes called Part-of-Speech LDA (POSLDA). POSLDA simultaneously uncovers short-range syntactic patterns (syntax) and long-range…

Computation and Language · Computer Science 2013-03-13 William M. Darling , Fei Song

Topic models, and more specifically the class of Latent Dirichlet Allocation (LDA), are widely used for probabilistic modeling of text. MCMC sampling from the posterior distribution is typically performed using a collapsed Gibbs sampler. We…

Machine Learning · Statistics 2017-08-16 Måns Magnusson , Leif Jonsson , Mattias Villani , David Broman

Social media users have finite attention which limits the number of incoming messages from friends they can process. Moreover, they pay more attention to opinions and recommendations of some friends more than others. In this paper, we…

Social and Information Networks · Computer Science 2013-01-29 Jeon-Hyung Kang , Kristina Lerman , Lise Getoor

Our study demonstrates the effective use of Large Language Models (LLMs) for automating the classification of complex datasets. We specifically target proposals of Decentralized Autonomous Organizations (DAOs), as the clas-sification of…

Computers and Society · Computer Science 2024-07-04 Christian Ziegler , Marcos Miranda , Guangye Cao , Gustav Arentoft , Doo Wan Nam

We propose a new topic modeling procedure that takes advantage of the fact that the Latent Dirichlet Allocation (LDA) log likelihood function is asymptotically equivalent to the logarithm of the volume of the topic simplex. This allows…

Machine Learning · Statistics 2019-04-04 Byoungwook Jang , Alfred Hero

Probabilistic topic models are widely used to discover latent topics in document collections, while latent feature vector representations of words have been used to obtain high performance in many NLP tasks. In this paper, we extend two…

Computation and Language · Computer Science 2018-10-16 Dat Quoc Nguyen , Richard Billingsley , Lan Du , Mark Johnson

Analyzing short texts infers discriminative and coherent latent topics that is a critical and fundamental task since many real-world applications require semantic understanding of short texts. Traditional long text topic modeling algorithms…

Information Retrieval · Computer Science 2019-04-17 Qiang Jipeng , Qian Zhenyu , Li Yun , Yuan Yunhao , Wu Xindong

Topic modeling based on latent Dirichlet allocation (LDA) has been a framework of choice to deal with multimodal data, such as in image annotation tasks. Another popular approach to model the multimodal data is through deep neural networks,…

Computer Vision and Pattern Recognition · Computer Science 2016-01-01 Yin Zheng , Yu-Jin Zhang , Hugo Larochelle

The task of discovering topics in text corpora has been dominated by Latent Dirichlet Allocation and other Topic Models for over a decade. In order to apply these approaches to massive text corpora, the vocabulary needs to be reduced…

Computation and Language · Computer Science 2019-08-08 Gibran Fuentes-Pineda , Ivan Vladimir Meza-Ruiz

In this paper, we propose a method for resume rating using Latent Dirichlet Allocation (LDA) and entity detection with SpaCy. The proposed method first extracts relevant entities such as education, experience, and skills from the resume…

Computation and Language · Computer Science 2023-08-01 Vidhita Jagwani , Smit Meghani , Krishna Pai , Sudhir Dhage

A common use of NLP is to facilitate the understanding of large document collections, with a shift from using traditional topic models to Large Language Models. Yet the effectiveness of using LLM for large corpus understanding in real-world…

Computation and Language · Computer Science 2025-06-05 Zongxia Li , Lorena Calvo-Bartolomé , Alexander Hoyle , Paiheng Xu , Alden Dima , Juan Francisco Fung , Jordan Boyd-Graber

A conversational system needs to know how to switch between topics to continue the conversation for a more extended period. For this topic detection from dialogue corpus has become an important task for a conversation and accurate…

Information Retrieval · Computer Science 2020-06-08 Haider Khalid , Vincent Wade

Inferring topics from the overwhelming amount of short texts becomes a critical but challenging task for many content analysis tasks, such as content charactering, user interest profiling, and emerging topic detecting. Existing methods such…

Computation and Language · Computer Science 2016-09-28 Jipeng Qiang , Ping Chen , Tong Wang , Xindong Wu

Word embedding models such as the skip-gram learn vector representations of words' semantic relationships, and document embedding models learn similar representations for documents. On the other hand, topic models provide latent…

Computation and Language · Computer Science 2019-09-12 Kamrun Naher Keya , Yannis Papanikolaou , James R. Foulds

We introduce the author-topic model, a generative model for documents that extends Latent Dirichlet Allocation (LDA; Blei, Ng, & Jordan, 2003) to include authorship information. Each author is associated with a multinomial distribution over…

Information Retrieval · Computer Science 2012-07-19 Michal Rosen-Zvi , Thomas Griffiths , Mark Steyvers , Padhraic Smyth

Automatic classification of scientific articles based on common characteristics is an interesting problem with many applications in digital library and information retrieval systems. Properly organized articles can be useful for automatic…

Information Retrieval · Computer Science 2015-05-04 Shameem A Puthiya Parambath

Topic modeling is a widely used technique for uncovering thematic structures from large text corpora. However, most topic modeling approaches e.g. Latent Dirichlet Allocation (LDA) struggle to capture nuanced semantics and contextual…

Information Retrieval · Computer Science 2024-09-25 Satya Kapoor , Alex Gil , Sreyoshi Bhaduri , Anshul Mittal , Rutu Mulkar

Supervisory signals can help topic models discover low-dimensional data representations that are more interpretable for clinical tasks. We propose a framework for training supervised latent Dirichlet allocation that balances two goals:…

Machine Learning · Computer Science 2017-12-05 Michael C. Hughes , Gabriel Hope , Leah Weiner , Thomas H. McCoy , Roy H. Perlis , Erik B. Sudderth , Finale Doshi-Velez

Topic modeling is a branch of Natural Language Processing (NLP) that aims to organize large collections of texts into coherent groups according to word co-occurrence patterns, with Latent Dirichlet Allocation (LDA) remaining one of the most…

Computation and Language · Computer Science 2026-05-29 Alex Ding , Tarun Rapaka , Willy Rodriguez , Jason Yang

Mining large corpora can generate useful discoveries but is time-consuming for humans. We formulate a new task, D5, that automatically discovers differences between two large corpora in a goal-driven way. The task input is a problem…

Computation and Language · Computer Science 2023-10-26 Ruiqi Zhong , Peter Zhang , Steve Li , Jinwoo Ahn , Dan Klein , Jacob Steinhardt