English
Related papers

Related papers: Probit Normal Correlated Topic Models

200 papers

The multinomial probit model is a typical statistical model for multiple-choice data applied in many research areas. When we are interested in some quantiles of relative utilities for understanding the distribution of these utilities, the…

Methodology · Statistics 2025-08-20 Masaaki Okabe , Koki Matsuoka , Jun Tsuchida , Hiroshi Yadohisa

This work presents a model reduction approach for problems with coherent structures that propagate over time such as convection-dominated flows and wave-type phenomena. Traditional model reduction methods have difficulties with these…

Numerical Analysis · Mathematics 2020-06-16 Benjamin Peherstorfer

We present a novel Bayesian topic model for learning discourse-level document structure. Our model leverages insights from discourse theory to constrain latent topic assignments in a way that reflects the underlying organization of document…

Information Retrieval · Computer Science 2014-01-16 Harr Chen , S. R. K. Branavan , Regina Barzilay , David R. Karger

We present a novel model for text complexity analysis which can be fitted to ordered categorical data measured on multiple scales, e.g. a corpus with binary responses mixed with a corpus with more than two ordered outcomes. The multiple…

Applications · Statistics 2018-11-13 Johan Falkenjack , Mattias Villani , Arne Jönsson

Multi-modal data collections, such as corpora of paired images and text snippets, require analysis methods beyond single-view component and topic models. For continuous observations the current dominant approach is based on extensions of…

Machine Learning · Computer Science 2012-10-19 Seppo Virtanen , Yangqing Jia , Arto Klami , Trevor Darrell

Probabilistic topic modeling is a popular and powerful family of tools for uncovering thematic structure in large sets of unstructured text documents. While much attention has been directed towards the modeling algorithms and their various…

Information Retrieval · Computer Science 2014-12-01 Samuel Rönnqvist , Xiaolu Wang , Peter Sarlin

We propose a new problem called coordinated topic modeling that imitates human behavior while describing a text corpus. It considers a set of well-defined topics like the axes of a semantic space with a reference representation. It then…

Computation and Language · Computer Science 2022-10-25 Pritom Saha Akash , Jie Huang , Kevin Chen-Chuan Chang

Topic modeling is a widely used technique for revealing underlying thematic structures within textual data. However, existing models have certain limitations, particularly when dealing with short text datasets that lack co-occurring words.…

Artificial Intelligence · Computer Science 2023-12-18 Han Wang , Nirmalendu Prakash , Nguyen Khoi Hoang , Ming Shan Hee , Usman Naseem , Roy Ka-Wei Lee

We propose a Label Propagation based algorithm for weakly supervised text classification. We construct a graph where each document is represented by a node and edge weights represent similarities among the documents. Additionally, we…

Computation and Language · Computer Science 2017-12-08 Sachin Pawar , Nitin Ramrakhiyani , Swapnil Hingmire , Girish K. Palshikar

Topic models have evolved from conventional Bayesian probabilistic models to recent Neural Topic Models (NTMs). Although NTMs have shown promising performance when trained and tested on a specific corpus, their generalisation ability across…

Computation and Language · Computer Science 2024-06-14 Xiaohao Yang , He Zhao , Dinh Phung , Lan Du

Topic modeling analyzes documents to learn meaningful patterns of words. However, existing topic models fail to learn interpretable topics when working with large and heavy-tailed vocabularies. To this end, we develop the Embedded Topic…

Information Retrieval · Computer Science 2019-07-12 Adji B. Dieng , Francisco J. R. Ruiz , David M. Blei

Many scientific and engineering fields involve analyzing network data. For document networks, relational topic models (RTMs) provide a probabilistic generative process to describe both the link structure and document contents, and they have…

Machine Learning · Computer Science 2013-10-10 Ning Chen , Jun Zhu , Fei Xia , Bo Zhang

Traditional neural topic models are typically optimized by reconstructing the document's Bag-of-Words (BoW) representations, overlooking contextual information and struggling with data sparsity. In this work, we propose a novel approach to…

Computation and Language · Computer Science 2026-02-23 Raymond Li , Amirhossein Abaskohi , Chuyuan Li , Gabriel Murray , Giuseppe Carenini

Topic modeling is used for discovering latent semantic structure, usually referred to as topics, in a large collection of documents. The most widely used methods are Latent Dirichlet Allocation and Probabilistic Latent Semantic Analysis.…

Computation and Language · Computer Science 2020-08-24 Dimo Angelov

In this paper we describe a novel framework for the discovery of the topical content of a data corpus, and the tracking of its complex structural changes across the temporal dimension. In contrast to previous work our model does not impose…

Information Retrieval · Computer Science 2015-12-29 Adham Beykikhoshk , Ognjen Arandjelovic , Dinh Phung , Svetha Venkatesh

Prompt-based learning's efficacy across numerous natural language processing tasks has led to its integration into dense passage retrieval. Prior research has mainly focused on enhancing the semantic understanding of pre-trained language…

Computation and Language · Computer Science 2023-10-11 Qingfa Xiao , Shuangyin Li , Lei Chen

We describe a new method for visualizing topics, the distributions over terms that are automatically extracted from large text corpora using latent variable models. Our method finds significant $n$-grams related to a topic, which are then…

Machine Learning · Statistics 2009-07-07 David M. Blei , John D. Lafferty

Over the years, topic models have provided an efficient way of extracting insights from text. However, while many models have been proposed, none are able to model topic temporality and hierarchy jointly. Modelling time provide more precise…

Information Retrieval · Computer Science 2023-01-25 Judicael Poumay , Ashwin Ittoo

Correlated binary response data with covariates are ubiquitous in longitudinal or spatial studies. Among the existing statistical models the most well-known one for this type of data is the multivariate probit model, which uses a Gaussian…

Methodology · Statistics 2021-01-08 Zhongwei Zhang , Reinaldo B. Arellano-Valle , Marc G. Genton , Raphaël Huser

Topic evolution modeling has received significant attentions in recent decades. Although various topic evolution models have been proposed, most studies focus on the single document corpus. However in practice, we can easily access data…

Computation and Language · Computer Science 2021-11-23 Yandi Zhu , Xiaoling Lu , Jingya Hong , Feifei Wang