English
Related papers

Related papers: Infinite Author Topic Model based on Mixed Gamma-N…

200 papers

We present an approach to generating topics using a model trained only for document title generation, with zero examples of topics given during training. We leverage features that capture the relevance of a candidate span in a document for…

Computation and Language · Computer Science 2020-04-30 Oleg Vasilyev , Kathryn Evans , Anna Venancio-Marques , John Bohannon

We propose a latent topic model with a Markovian transition for process data, which consist of time-stamped events recorded in a log file. Such data are becoming more widely available in computer-based educational assessment with complex…

Methodology · Statistics 2019-11-06 Haochen Xu , Guanhua Fang , Zhiliang Ying

In this paper, we introduce an authorship attribution method called Authorial Language Models (ALMs) that involves identifying the most likely author of a questioned document based on the perplexity of the questioned document calculated for…

Computation and Language · Computer Science 2024-02-14 Weihang Huang , Akira Murakami , Jack Grieve

Authorship attribution refers to the task of automatically determining the author based on a given sample of text. It is a problem with a long history and has a wide range of application. Building author profiles using language models is…

Computation and Language · Computer Science 2016-02-25 Zhenhao Ge , Yufang Sun

Topic modeling is one of the most powerful techniques in text mining for data mining, latent data discovery, and finding relationships among data, text documents. Researchers have published many articles in the field of topic modeling and…

Information Retrieval · Computer Science 2018-12-07 Hamed Jelodar , Yongli Wang , Chi Yuan , Xia Feng , Xiahui Jiang , Yanchao Li , Liang Zhao

We propose a straightforward solution for detecting scarce topics in unbalanced short-text datasets. Our approach, named CWUTM (Topic model based on co-occurrence word networks for unbalanced short text datasets), Our approach addresses the…

Computation and Language · Computer Science 2023-11-07 Chengjie Ma , Junping Du , Meiyu Liang , Zeli Guan

This study introduces Bidirectional Topic Matching (BTM), a novel method for cross-corpus topic modeling that quantifies thematic overlap and divergence between corpora. BTM is a flexible framework that can incorporate various topic…

Computation and Language · Computer Science 2024-12-25 Raven Adam , Marie Lisa Kogler

Topic drift is a common phenomenon in multi-turn dialogue. Therefore, an ideal dialogue generation models should be able to capture the topic information of each context, detect the relevant context, and produce appropriate responses…

Computation and Language · Computer Science 2020-09-29 Hainan Zhang , Yanyan Lan , Liang Pang , Hongshen Chen , Zhuoye Ding , Dawei Yin

We propose a Concentrated Document Topic Model(CDTM) for unsupervised text classification, which is able to produce a concentrated and sparse document topic distribution. In particular, an exponential entropy penalty is imposed on the…

Machine Learning · Statistics 2021-02-10 Hao Lei , Ying Chen

Topic modeling, a method for extracting the underlying themes from a collection of documents, is an increasingly important component of the design of intelligent systems enabling the sense-making of highly dynamic and diverse streams of…

Information Retrieval · Computer Science 2019-10-07 Chris Gropp , Alexander Herzog , Ilya Safro , Paul W. Wilson , Amy W. Apon

Recent advancements in QA with LLM, like GPT-4, have shown limitations in handling complex multi-hop queries. We propose AT-RAG, a novel multistep RAG incorporating topic modeling for efficient document retrieval and reasoning. Using…

Computation and Language · Computer Science 2024-10-18 Mohammad Reza Rezaei , Maziar Hafezi , Amit Satpathy , Lovell Hodge , Ebrahim Pourjafari

The Topics over Time (ToT) model captures thematic changes in timestamped datasets by explicitly modeling publication dates jointly with word co-occurrence patterns. However, ToT was not approached in a fully Bayesian fashion, a flaw that…

Computation and Language · Computer Science 2025-04-22 Julián Cendrero , Julio Gonzalo , Ivar Zapata

A lot of manual work goes into identifying a topic for an article. With a large volume of articles, the manual process can be exhausting. Our approach aims to address this issue by automatically extracting topics from the text of large…

Computation and Language · Computer Science 2021-10-25 Linkai Zhu , Maoyi Huang , Maomao Chen , Wennan Wang

The explosion of big social data has created a scalability trap for traditional qualitative research, as manual coding remains labor-intensive and conventional topic models often suffer from semantic thinning and a lack of domain awareness.…

Computers and Society · Computer Science 2026-04-15 Zhenke Duan , Xin Li

Existing topic modeling methods, from LDA to recent neural and LLM-based approaches, which focus mainly on statistical coherence, often produce redundant or off-target topics that miss the user's underlying intent. We introduce…

Artificial Intelligence · Computer Science 2026-04-15 Rui Wang , Yi Zheng , Dongxin Wang , Haiping Huang , Yuanzhi Yao , Yuxiang Zhou , Jialin Yu , Philip Torr

Topic models are a useful analysis tool to uncover the underlying themes within document collections. The dominant approach is to use probabilistic topic models that posit a generative story, but in this paper we propose an alternative way…

Computation and Language · Computer Science 2020-10-08 Suzanna Sia , Ayush Dalmia , Sabrina J. Mielke

Latent Dirichlet analysis, or topic modeling, is a flexible latent variable framework for modeling high-dimensional sparse count data. Various learning algorithms have been developed in recent years, including collapsed Gibbs sampling,…

Machine Learning · Computer Science 2012-05-14 Arthur Asuncion , Max Welling , Padhraic Smyth , Yee Whye Teh

Probabilistic topic models like Latent Dirichlet Allocation (LDA) have been previously extended to the bilingual setting. A fundamental modeling assumption in several of these extensions is that the input corpora are in the form of document…

Computation and Language · Computer Science 2021-12-01 Georgios Balikas , Massih-Reza Amini , Marianne Clausel

Topic modeling is a powerful technique for uncovering hidden themes within a collection of documents. However, the effectiveness of traditional topic models often relies on sufficient word co-occurrence, which is lacking in short texts.…

Computation and Language · Computer Science 2024-10-22 Pritom Saha Akash , Kevin Chen-Chuan Chang

The topic modeling discovers the latent topic probability of the given text documents. To generate the more meaningful topic that better represents the given document, we proposed a new feature extraction technique which can be used in the…

Machine Learning · Computer Science 2018-04-13 Ziyi Zhao , Krittaphat Pugdeethosapol , Sheng Lin , Zhe Li , Caiwen Ding , Yanzhi Wang , Qinru Qiu