English
Related papers

Related papers: Effective Neural Topic Modeling with Embedding Clu…

200 papers

In this multi-task learning study on simultaneous analysis of emotions and their underlying causes in conversational contexts, deep neural network methods were employed to effectively process and train large labeled datasets. However, these…

Computation and Language · Computer Science 2024-03-19 J. K. Lee , T. M. Chung

In this work, we consider the medical concept normalization problem, i.e., the problem of mapping a disease mention in free-form text to a concept in a controlled vocabulary, usually to the standard thesaurus in the Unified Medical Language…

Computation and Language · Computer Science 2018-11-30 Elena Tutubalina , Zulfat Miftahutdinov , Sergey Nikolenko , Valentin Malykh

Concept bottleneck models (CBMs) have emerged as critical tools in domains where interpretability is paramount. These models rely on predefined textual descriptions, referred to as concepts, to inform their decision-making process and offer…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Maor Dikter , Tsachi Blau , Chaim Baskin

Topic modeling is traditionally applied to word counts without accounting for the context in which words appear. Recent advancements in large language models (LLMs) offer contextualized word embeddings, which capture deeper meaning and…

Machine Learning · Statistics 2025-12-30 Morgane Austern , Yuanchuan Guo , Zheng Tracy Ke , Tianle Liu

Question paraphrase identification is a key task in Community Question Answering (CQA) to determine if an incoming question has been previously asked. Many current models use word embeddings to identify duplicate questions, but the use of…

Computation and Language · Computer Science 2020-07-23 Nicole Peinelt , Dong Nguyen , Maria Liakata

In NLP, Event Coreference Resolution (ECR) is the task of connecting event clusters that refer to the same underlying real-life event, usually via neural systems. In this work, we investigate using abductive free-text rationales (FTRs)…

Computation and Language · Computer Science 2024-04-05 Abhijnan Nath , Shadi Manafi , Avyakta Chelle , Nikhil Krishnaswamy

Topic models have evolved from conventional Bayesian probabilistic models to recent Neural Topic Models (NTMs). Although NTMs have shown promising performance when trained and tested on a specific corpus, their generalisation ability across…

Computation and Language · Computer Science 2024-06-14 Xiaohao Yang , He Zhao , Dinh Phung , Lan Du

Comparative text mining extends from genre analysis and political bias detection to the revelation of cultural and geographic differences, through to the search for prior art across patents and scientific papers. These applications use…

Information Retrieval · Computer Science 2019-11-27 Julian Risch , Ralf Krestel

Topic detection is a challenging task, especially without knowing the exact number of topics. In this paper, we present a novel approach based on neural network to detect topics in the micro-blogging dataset. We use an unsupervised neural…

Information Retrieval · Computer Science 2020-06-18 Cong Wan , Shan Jiang , Cuirong Wang , Cong Wang , Changming Xu , Xianxia Chen , Ying Yuan

Recent works using artificial neural networks based on word distributed representation greatly boost the performance of various natural language learning tasks, especially question answering. Though, they also carry along with some…

Computation and Language · Computer Science 2016-12-23 Lingxun Meng , Yan Li , Mengyi Liu , Peng Shu

Deep learning methods are highly accurate, yet their opaque decision process prevents them from earning full human trust. Concept-based models aim to address this issue by learning tasks based on a set of human-understandable concepts.…

The best-performing approaches for scholarly document quality prediction are based on embedding models. In addition to their performance when used in classifiers, embedding models can also provide predictions even for words that were not…

Computation and Language · Computer Science 2025-08-29 Lucie Dvorackova , Marcin P. Joachimiak , Michal Cerny , Adriana Kubecova , Vilem Sklenak , Tomas Kliegr

In this paper, we formulate keyphrase extraction from scholarly articles as a sequence labeling task solved using a BiLSTM-CRF, where the words in the input text are represented using deep contextualized embeddings. We evaluate the proposed…

Text embedding models enable semantic search, powering several NLP applications like Retrieval Augmented Generation by efficient information retrieval (IR). However, text embedding models are commonly studied in scenarios where the training…

Information Retrieval · Computer Science 2025-10-07 Dipam Goswami , Liying Wang , Bartłomiej Twardowski , Joost van de Weijer

Advances on deep generative models have attracted significant research interest in neural topic modeling. The recently proposed Adversarial-neural Topic Model models topics with an adversarially trained generator network and employs…

Computation and Language · Computer Science 2020-09-30 Xuemeng Hu , Rui Wang , Deyu Zhou , Yuxuan Xiong

Marrying topic models and language models exposes language understanding to a broader source of document-level context beyond sentences via topics. While introducing topical semantics in language models, existing approaches incorporate…

Computation and Language · Computer Science 2023-06-28 Yatin Chaudhary , Hinrich Schütze , Pankaj Gupta

Many word clouds provide no semantics to the word placement, but use a random layout optimized solely for aesthetic purposes. We propose a novel approach to model word significance and word affinity within a document, and in comparison to a…

Information Retrieval · Computer Science 2017-08-14 Erich Schubert , Andreas Spitz , Michael Weiler , Johanna Geiß , Michael Gertz

Deep learning models achieve strong performance across various domains but often rely on spurious correlations, making them vulnerable to distribution shifts. This issue is particularly severe in subpopulation shift scenarios, where models…

Machine Learning · Computer Science 2026-03-03 Subeen Park , Joowang Kim , Hakyung Lee , Sunjae Yoo , Kyungwoo Song

Contextualised word vectors obtained via pre-trained language models encode a variety of knowledge that has already been exploited in applications. Complementary to these language models are probabilistic topic models that learn thematic…

Computation and Language · Computer Science 2023-01-12 Mozhgan Talebpour , Alba Garcia Seco de Herrera , Shoaib Jameel

End-to-end speaker diarization approaches have shown exceptional performance over the traditional modular approaches. To further improve the performance of the end-to-end speaker diarization for real speech recordings, recently works have…

Sound · Computer Science 2022-04-19 Chenyu Yang , Yu Wang