English
Related papers

Related papers: Effective Neural Topic Modeling with Embedding Clu…

200 papers

We propose Sentence Level Recurrent Topic Model (SLRTM), a new topic model that assumes the generation of each word within a sentence to depend on both the topic of the sentence and the whole history of its preceding words in the sentence.…

Machine Learning · Computer Science 2016-04-11 Fei Tian , Bin Gao , Di He , Tie-Yan Liu

Mining the hierarchical structure of Internet review topics and realizing a fine classification of review texts can help alleviate users' information overload. However, existing hierarchical topic classification methods primarily rely on…

Adaptation and Self-Organizing Systems · Physics 2024-01-03 Lin Qi , Feiyan Guo , Jian Zhang , Yuwei Wang

Though word embeddings and topics are complementary representations, several past works have only used pre-trained word embeddings in (neural) topic modeling to address data sparsity problem in short text or small collection of documents.…

Computation and Language · Computer Science 2019-09-18 Pankaj Gupta , Yatin Chaudhary , Hinrich Schütze

The explosion of e-commerce has caused the need for processing and analysis of product titles, like entity typing in product titles. However, the rapid activity in e-commerce has led to the rapid emergence of new entities, which is…

Computation and Language · Computer Science 2022-11-07 Yibo Wang , Congying Xia , Guan Wang , Philip Yu

Word embedding maps words into a low-dimensional continuous embedding space by exploiting the local word collocation patterns in a small context window. On the other hand, topic modeling maps documents onto a low-dimensional topic space, by…

Computation and Language · Computer Science 2016-08-09 Shaohua Li , Tat-Seng Chua , Jun Zhu , Chunyan Miao

Most unsupervised NLP models represent each word with a single point or single region in semantic space, while the existing multi-sense word embeddings cannot represent longer word sequences like phrases or sentences. We propose a novel…

Computation and Language · Computer Science 2021-12-30 Haw-Shiuan Chang , Amol Agrawal , Andrew McCallum

Word embedding models offer continuous vector representations that can capture rich contextual semantics based on their word co-occurrence patterns. While these word vectors can provide very effective features used in many NLP tasks such as…

Computation and Language · Computer Science 2017-02-27 Cem Safak Sahin , Rajmonda S. Caceres , Brandon Oselio , William M. Campbell

Data mining and knowledge discovery are essential aspects of extracting valuable insights from vast datasets. Neural topic models (NTMs) have emerged as a valuable unsupervised tool in this field. However, the predominant objective in NTMs,…

Artificial Intelligence · Computer Science 2024-12-24 Xin Gao , Yang Lin , Ruiqing Li , Yasha Wang , Xu Chu , Xinyu Ma , Hailong Yu

Emotion recognition in conversation (ERC) has emerged as a research hotspot in domains such as conversational robots and question-answer systems. How to efficiently and adequately retrieve contextual emotional cues has been one of the key…

Computation and Language · Computer Science 2024-01-26 Jiang Li , Xiaoping Wang , Yingjian Liu , Zhigang Zeng

Recent advances in neural topic models have concentrated on two primary directions: the integration of the inference network (encoder) with a pre-trained language model (PLM) and the modeling of the relationship between words and topics in…

Computation and Language · Computer Science 2024-10-01 Duy-Tung Pham , Thien Trang Nguyen Vu , Tung Nguyen , Linh Ngo Van , Duc Anh Nguyen , Thien Huu Nguyen

Deep clustering is a deep neural network-based speech separation algorithm that first trains the mixed component of signals with high-dimensional embeddings, and then uses a clustering algorithm to separate each mixture of sources. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2019-01-16 Soyeon Choe , Soo-Whan Chung , Youna Ji , Hong-Goo Kang

Taxonomy construction is not only a fundamental task for semantic analysis of text corpora, but also an important step for applications such as information filtering, recommendation, and Web search. Existing pattern-based methods extract…

Databases · Computer Science 2018-12-27 Chao Zhang , Fangbo Tao , Xiusi Chen , Jiaming Shen , Meng Jiang , Brian Sadler , Michelle Vanni , Jiawei Han

The time at which a message is communicated is a vital piece of metadata in many real-world natural language processing tasks such as Topic Detection and Tracking (TDT). TDT systems aim to cluster a corpus of news articles by event, and in…

Computation and Language · Computer Science 2024-03-27 Hang Jiang , Doug Beeferman , Weiquan Mao , Deb Roy

Traditional neural topic models are typically optimized by reconstructing the document's Bag-of-Words (BoW) representations, overlooking contextual information and struggling with data sparsity. In this work, we propose a novel approach to…

Computation and Language · Computer Science 2026-02-23 Raymond Li , Amirhossein Abaskohi , Chuyuan Li , Gabriel Murray , Giuseppe Carenini

Learning word embeddings has received a significant amount of attention recently. Often, word embeddings are learned in an unsupervised manner from a large collection of text. The genre of the text typically plays an important role in the…

Computation and Language · Computer Science 2019-02-04 Wei Yang , Wei Lu , Vincent W. Zheng

We introduce CEMTM, a context-enhanced multimodal topic model designed to infer coherent and interpretable topic structures from both short and long documents containing text and images. CEMTM builds on fine-tuned large vision language…

Computation and Language · Computer Science 2025-10-07 Amirhossein Abaskohi , Raymond Li , Chuyuan Li , Shafiq Joty , Giuseppe Carenini

Detecting and tracking emerging trends and weak signals in large, evolving text corpora is vital for applications such as monitoring scientific literature, managing brand reputation, surveilling critical infrastructure and more generally to…

Computation and Language · Computer Science 2024-11-22 Allaa Boutaleb , Jerome Picault , Guillaume Grosjean

Topic models can be useful tools to discover latent topics in collections of documents. Recent studies have shown the feasibility of approach topic modeling as a clustering task. We present BERTopic, a topic model that extends this process…

Computation and Language · Computer Science 2022-03-14 Maarten Grootendorst

Research in CDCR remains fragmented due to heterogeneous dataset formats, varying annotation standards, and the predominance of the CDCR definition as the event coreference resolution (ECR). To address these challenges, we introduce uCDCR,…

Computation and Language · Computer Science 2026-03-04 Anastasia Zhukova , Terry Ruas , Jan Philip Wahle , Bela Gipp

Topic modeling refers to the task of discovering the underlying thematic structure in a text corpus, where the output is commonly presented as a report of the top terms appearing in each topic. Despite the diversity of topic modeling…

Machine Learning · Computer Science 2014-06-20 Derek Greene , Derek O'Callaghan , Pádraig Cunningham