English
Related papers

Related papers: A Survey on Neural Topic Models: Methods, Applicat…

200 papers

We proposed a novel multilayer correlated topic model (MCTM) to analyze how the main ideas inherit and vary between a document and its different segments, which helps understand an article's structure. The variational…

Information Retrieval · Computer Science 2021-01-07 Ye Tian

Documents exhibit sequential structure at multiple levels of abstraction (e.g., sentences, paragraphs, sections). These abstractions constitute a natural hierarchy for representing the context in which to infer the meaning of words and…

Computation and Language · Computer Science 2016-06-01 Shalini Ghosh , Oriol Vinyals , Brian Strope , Scott Roy , Tom Dean , Larry Heck

Spatiotemporal point processes (STPPs) are probabilistic models for events occurring in continuous space and time. Real-world event data often exhibit intricate dependencies and heterogeneous dynamics. By incorporating modern deep learning…

Machine Learning · Computer Science 2025-02-14 Sumantrak Mukherjee , Mouad Elhamdi , George Mohler , David A. Selby , Yao Xie , Sebastian Vollmer , Gerrit Grossmann

Probabilistic topic modeling is a popular and powerful family of tools for uncovering thematic structure in large sets of unstructured text documents. While much attention has been directed towards the modeling algorithms and their various…

Information Retrieval · Computer Science 2014-12-01 Samuel Rönnqvist , Xiaolu Wang , Peter Sarlin

We present a survey on multilingual neural machine translation (MNMT), which has gained a lot of traction in the recent years. MNMT has been useful in improving translation quality as a result of translation knowledge transfer (transfer…

Computation and Language · Computer Science 2020-01-08 Raj Dabre , Chenhui Chu , Anoop Kunchukuttan

Recently, topic modeling has been widely used to discover the abstract topics in text corpora. Most of the existing topic models are based on the assumption of three-layer hierarchical Bayesian structure, i.e. each document is modeled as a…

Computation and Language · Computer Science 2017-04-10 Yi-Kun Tang , Xian-Ling Mao , Heyan Huang , Guihua Wen

Trans-dimensional random field language models (TRF LMs) have recently been introduced, where sentences are modeled as a collection of random fields. The TRF approach has been shown to have the advantages of being computationally more…

Computation and Language · Computer Science 2017-09-20 Bin Wang , Zhijian Ou

Topic modeling has been a widely used tool for unsupervised text analysis. However, comprehensive evaluations of a topic model remain challenging. Existing evaluation methods are either less comparable across different models (e.g.,…

Computation and Language · Computer Science 2025-01-15 Xiaohao Yang , He Zhao , Dinh Phung , Wray Buntine , Lan Du

Statistical topic models provide a general data-driven framework for automated discovery of high-level knowledge from large collections of text documents. While topic models can potentially discover a broad range of themes in a data set,…

Artificial Intelligence · Computer Science 2008-08-08 Chaitanya Chemudugunta , Padhraic Smyth , Mark Steyvers

Automatically associating social media posts with topics is an important prerequisite for effective search and recommendation on many social media platforms. However, topic classification of such posts is quite challenging because of (a) a…

Computation and Language · Computer Science 2022-05-04 Vivek Kulkarni , Kenny Leung , Aria Haghighi

In the Humanities and Social Sciences, there is increasing interest in approaches to information extraction, prediction, intelligent linkage, and dimension reduction applicable to large text corpora. With approaches in these fields being…

Applications · Statistics 2019-04-16 Vanessa Glenny , Jonathan Tuke , Nigel Bean , Lewis Mitchell

The recent advances in neural language models have also been successfully applied to the field of chemistry, offering generative solutions for classical problems in molecular design and synthesis planning. These new methods have the…

Machine Learning · Computer Science 2023-05-19 Dimitrios Christofidellis , Giorgio Giannone , Jannis Born , Ole Winther , Teodoro Laino , Matteo Manica

We present a novel method for hierarchical topic detection where topics are obtained by clustering documents in multiple ways. Specifically, we model document collections using a class of graphical models called hierarchical latent tree…

Computation and Language · Computer Science 2016-12-22 Peixian Chen , Nevin L. Zhang , Tengfei Liu , Leonard K. M. Poon , Zhourong Chen , Farhan Khawar

The fields of generative AI and transfer learning have experienced remarkable advancements in recent years especially in the domain of Natural Language Processing (NLP). Transformers have been at the heart of these advancements where the…

Computation and Language · Computer Science 2024-02-28 Majd Saleh , Stéphane Paquelet

We propose a Bayesian generative model for incorporating prior domain knowledge into hierarchical topic modeling. Although embedded topic models (ETMs) and its variants have gained promising performance in text analysis, they mainly focus…

Computation and Language · Computer Science 2022-09-29 Dongsheng Wang , Yishi Xu , Miaoge Li , Zhibin Duan , Chaojie Wang , Bo Chen , Mingyuan Zhou

The exponential growth of online social network platforms and applications has led to a staggering volume of user-generated textual content, including comments and reviews. Consequently, users often face difficulties in extracting valuable…

Computation and Language · Computer Science 2023-08-23 Anusuya Krishnan

Trajectory planning is a fundamental problem in robotics. It facilitates a wide range of applications in navigation and motion planning, control, and multi-agent coordination. Trajectory planning is a difficult problem due to its…

Robotics · Computer Science 2024-02-13 Zihan Yu , Yuqing Tang

In the domain of Natural Language Processing (NLP), Named Entity Recognition (NER) stands out as a pivotal mechanism for extracting structured insights from unstructured text. This manuscript offers an exhaustive exploration into the…

Computation and Language · Computer Science 2023-09-26 Kalyani Pakhale

To date, there have been massive Semi-Structured Documents (SSDs) during the evolution of the Internet. These SSDs contain both unstructured features (e.g., plain text) and metadata (e.g., tags). Most previous works focused on modeling the…

Computation and Language · Computer Science 2015-07-31 Shuangyin Li , Jiefei Li , Guan Huang , Ruiyang Tan , Rong Pan

Topic models are evaluated based on their ability to describe documents well (i.e. low perplexity) and to produce topics that carry coherent semantic meaning. In topic modeling so far, perplexity is a direct optimization target. However,…

Computation and Language · Computer Science 2018-09-11 Ran Ding , Ramesh Nallapati , Bing Xiang