English
Related papers

Related papers: vONTSS: vMF based semi-supervised neural topic mod…

200 papers

Existing topic modeling methods, from LDA to recent neural and LLM-based approaches, which focus mainly on statistical coherence, often produce redundant or off-target topics that miss the user's underlying intent. We introduce…

Artificial Intelligence · Computer Science 2026-04-15 Rui Wang , Yi Zheng , Dongxin Wang , Haiping Huang , Yuanzhi Yao , Yuxiang Zhou , Jialin Yu , Philip Torr

We propose the Neural Vector Space Model (NVSM), a method that learns representations of documents in an unsupervised manner for news article retrieval. In the NVSM paradigm, we learn low-dimensional representations of words and documents…

Information Retrieval · Computer Science 2018-08-21 Christophe Van Gysel , Maarten de Rijke , Evangelos Kanoulas

Modeling latent representations in a hyperspherical space has proven effective for capturing directional similarities in high-dimensional text data, benefiting topic modeling. Variational autoencoder-based neural topic models (VAE-NTMs)…

Computation and Language · Computer Science 2025-08-18 Suman Adhya , Debarshi Kumar Sanyal

Multimodal large language models (MLLMs) have demonstrated remarkable potential for enhancing scene understanding in autonomous driving systems through powerful logical reasoning capabilities. However, the deployment of these models faces…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Yunsheng Ma , Amr Abdelraouf , Rohit Gupta , Ziran Wang , Kyungtae Han

A hallmark of variational autoencoders (VAEs) for text processing is their combination of powerful encoder-decoder models, such as LSTMs, with simple latent distributions, typically multivariate Gaussians. These models pose a difficult…

Computation and Language · Computer Science 2018-10-15 Jiacheng Xu , Greg Durrett

Topic models have been widely used in discovering latent topics which are shared across documents in text mining. Vector representations, word embeddings and topic embeddings, map words and topics into a low-dimensional and dense real-value…

Computation and Language · Computer Science 2017-02-24 Jarvan Law , Hankz Hankui Zhuo , Junhua He , Erhu Rong

Semi-supervised learning has made remarkable strides by effectively utilizing a limited amount of labeled data while capitalizing on the abundant information present in unlabeled data. However, current algorithms often prioritize aligning…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Zhiquan Tan , Kaipeng Zheng , Weiran Huang

Although convolutional neural networks (CNNs) have achieved remarkable progress in weakly supervised semantic segmentation (WSSS), the effective receptive field of CNN is insufficient to capture global context information, leading to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Chunmeng Liu , Enze Xie , Wenjia Wang , Wenhai Wang , Guangyao Li , Ping Luo

Topic models have been widely used to learn text representations and gain insight into document corpora. To perform topic discovery, most existing neural models either take document bag-of-words (BoW) or sequence of tokens as input followed…

Computation and Language · Computer Science 2021-07-12 Madhur Panwar , Shashank Shailabh , Milan Aggarwal , Balaji Krishnamurthy

Nonnegative matrix factorization (NMF) based topic modeling methods do not rely on model- or data-assumptions much. However, they are usually formulated as difficult optimization problems, which may suffer from bad local minima and high…

Information Retrieval · Computer Science 2021-02-26 JianYu Wang , Xiao-Lei Zhang

We propose several new models for semi-supervised nonnegative matrix factorization (SSNMF) and provide motivation for SSNMF models as maximum likelihood estimators given specific distributions of uncertainty. We present multiplicative…

As one of the prevalent topic mining tools, neural topic modeling has attracted a lot of interests for the advantages of high efficiency in training and strong generalisation abilities. However, due to the lack of context in each short…

Information Retrieval · Computer Science 2020-08-12 Jiachun Feng , Zusheng Zhang , Cheng Ding , Yanghui Rao , Haoran Xie

In recent years, there has been an ever increasing amount of multivariate time series (MTS) data in various domains, typically generated by a large family of sensors such as wearable devices. This has led to the development of novel…

Machine Learning · Computer Science 2022-02-08 Kang Gu , Soroush Vosoughi , Temiloluwa Prioleau

This document is about the multi-document Von-Mises-Fisher mixture model with a Dirichlet prior, referred to as VMFMix. VMFMix is analogous to Latent Dirichlet Allocation (LDA) in that they can capture the co-occurrence patterns acorss…

Computation and Language · Computer Science 2017-02-27 Shaohua Li

The von Mises-Fisher (vMF) is a well-known density model for directional random variables. The recent surge of the deep embedding methodologies for high-dimensional structured data such as images or texts, aimed at extracting salient…

Machine Learning · Computer Science 2021-02-11 Minyoung Kim

Text spotting, a task involving the extraction of textual information from image or video sequences, faces challenges in cross-domain adaption, such as image-to-image and image-to-video generalization. In this paper, we introduce a new…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Yuliang Liu , Mingxin Huang , Hao Yan , Linger Deng , Weijia Wu , Hao Lu , Chunhua Shen , Lianwen Jin , Xiang Bai

Though word embeddings and topics are complementary representations, several past works have only used pre-trained word embeddings in (neural) topic modeling to address data sparsity problem in short text or small collection of documents.…

Computation and Language · Computer Science 2019-09-18 Pankaj Gupta , Yatin Chaudhary , Hinrich Schütze

Topic modeling of textual corpora is an important and challenging problem. In most previous work, the "bag-of-words" assumption is usually made which ignores the ordering of words. This assumption simplifies the computation, but it…

Machine Learning · Computer Science 2015-02-13 Min Yang , Tianyi Cui , Wenting Tu

Topic models are widely used to analyze document collections. While they are valuable for discovering latent topics in a corpus when analysts are unfamiliar with the corpus, analysts also commonly start with an understanding of the content…

Computation and Language · Computer Science 2024-07-01 Garima Dhanania , Sheshera Mysore , Chau Minh Pham , Mohit Iyyer , Hamed Zamani , Andrew McCallum

Unsupervised machine translation (MT) has recently achieved impressive results with monolingual corpora only. However, it is still challenging to associate source-target sentences in the latent space. As people speak different languages…

Computation and Language · Computer Science 2020-05-08 Po-Yao Huang , Junjie Hu , Xiaojun Chang , Alexander Hauptmann