English
Related papers

Related papers: Evaluating topic coherence measures

200 papers

With the growth of interpreting technologies, from remote interpreting and Computer-Aided Interpreting to automated speech translation and interpreting avatars, there is now a high demand for ways to quickly and efficiently measure the…

Computation and Language · Computer Science 2026-01-12 Jonathan Downie , Joss Moorkens

In this paper, we pose the question: do people talk about women and men in different ways? We introduce two datasets and a novel integration of approaches for automatically inferring gender associations from language, discovering coherent…

Computation and Language · Computer Science 2019-09-04 Serina Chang , Kathleen McKeown

Recent dialogue coherence models use the coherence features designed for monologue texts, e.g. nominal entities, to represent utterances and then explicitly augment them with dialogue-relevant features, e.g., dialogue act labels. It…

Computation and Language · Computer Science 2020-06-04 Mohsen Mesgar , Sebastian Bücker , Iryna Gurevych

Classic Topic Models are built under the Bag Of Words assumption, in which word position is ignored for simplicity. Besides, symmetric priors are typically used in most applications. In order to easily learn topics with different properties…

Computation and Language · Computer Science 2018-06-27 Simón Roca-Sotelo , Jerónimo Arenas-García

Languages vary widely in how meanings map to word forms. These mappings have been found to support efficient communication; however, this theory does not account for systematic relations within word forms. We examine how a restricted set of…

Computation and Language · Computer Science 2026-01-27 Doreen Osmelak , Yang Xu , Michael Hahn , Kate McCurdy

Opinion mining and Sentiment analysis have emerged as a field of study since the widespread of World Wide Web and internet. Opinion refers to extraction of those lines or phrase in the raw and huge data which express an opinion. Sentiment…

Information Retrieval · Computer Science 2014-01-14 Deepali Virmani , Vikrant Malhotra , Ridhi Tyagi

Developers of text generation models rely on automated evaluation metrics as a stand-in for slow and expensive manual evaluations. However, image captioning metrics have struggled to give accurate learned estimates of the semantic and…

Computation and Language · Computer Science 2022-03-21 Mert İnan , Piyush Sharma , Baber Khalid , Radu Soricut , Matthew Stone , Malihe Alikhani

Well-defined formal definitions for sentiment and opinion are extended to incorporate the necessary elements to provide a formal quantitative definition of reputation. This definition takes the form of a time-based index, in which each…

Computational Finance · Quantitative Finance 2017-05-30 Peter Mitic

Fusing sentences containing disparate content is a remarkable human ability that helps create informative and succinct summaries. Such a simple task for humans has remained challenging for modern abstractive summarizers, substantially…

Computation and Language · Computer Science 2020-06-11 Logan Lebanoff , John Muchovej , Franck Dernoncourt , Doo Soon Kim , Lidan Wang , Walter Chang , Fei Liu

In this paper, we present a set of measures to quantify certain properties of threaded discussions, which are ubiquitous in online learn-ing platforms. In particular, we address how to measure the redundancy of posts, the compactness of…

Computers and Society · Computer Science 2017-02-08 Ricky J Sethi , Lorenzo A Rossi , Yolanda Gil

Latent Dirichlet Allocation (LDA) models trained without stopword removal often produce topics with high posterior probabilities on uninformative words, obscuring the underlying corpus content. Even when canonical stopwords are manually…

Computation and Language · Computer Science 2017-10-17 Angela Fan , Finale Doshi-Velez , Luke Miratrix

Divergent word usages reflect differences among people. In this paper, we present a novel angle for studying word usage divergence -- word interpretations. We propose an approach that quantifies semantic differences in interpretations among…

Computation and Language · Computer Science 2017-03-30 Tianran Hu , Ruihua Song , Maya Abtahian , Philip Ding , Xing Xie , Jiebo Luo

To measure the similarity of two documents in the bag-of-words (BoW) vector representation, different term weighting schemes are used to improve the performance of cosine similarity---the most widely used inter-document similarity measure…

Information Retrieval · Computer Science 2019-02-12 Sunil Aryal , Kai Ming Ting , Takashi Washio , Gholamreza Haffari

Topics play an important role in the global organisation of a conversation as what is currently discussed constrains the possible contributions of the participant. Understanding the way topics are organised in interaction would provide…

Computation and Language · Computer Science 2024-02-06 Amandine Decker , Maxime Amblard

The top word list, i.e., the top-M words with highest marginal probability in a given topic, is the standard topic representation in topic models. Most of recent automatical topic labeling algorithms and popular topic quality metrics are…

Information Retrieval · Computer Science 2018-10-25 Jinjin Chi , Jihong Ouyang , Changchun Li , Xueyang Dong , Ximing Li , Xinhua Wang

An important aspect of text mining involves information retrieval in form of discovery of semantic themes (topics) from documents using topic modelling. While generative topic models like Latent Dirichlet Allocation (LDA) or Latent Semantic…

Machine Learning · Computer Science 2025-11-04 Satyajeet Sahoo , Jhareswar Maiti

Previous research on word embeddings has shown that sparse representations, which can be either learned on top of existing dense embeddings or obtained through model constraints during training time, have the benefit of increased…

Computation and Language · Computer Science 2018-09-26 Valentin Trifonov , Octavian-Eugen Ganea , Anna Potapenko , Thomas Hofmann

Topic models are statistical tools that allow their users to gain qualitative and quantitative insights into the contents of textual corpora without the need for close reading. They can be applied in a wide range of settings from discourse…

Computation and Language · Computer Science 2025-05-20 Márton Kardos , Kenneth C. Enevoldsen , Kristoffer Laigaard Nielbo

Several performance measures can be used for evaluating classification results: accuracy, F-measure, and many others. Can we say that some of them are better than others, or, ideally, choose one measure that is best in all situations? To…

Machine Learning · Computer Science 2022-01-25 Martijn Gösgens , Anton Zhiyanov , Alexey Tikhonov , Liudmila Prokhorenkova

With the widespread use of social networks, detecting the topics discussed on these platforms has become a significant challenge. Current approaches primarily rely on frequent pattern mining or semantic relations, often neglecting the…

Computation and Language · Computer Science 2024-08-22 Mehrdad Ranjbar Khadivi , Shahin Akbarpour , Mohammad-Reza Feizi-Derakhshi , Babak Anari