English
Related papers

Related papers: My Approach = Your Apparatus? Entropy-Based Topic …

200 papers

Given a controversial target such as ``nuclear energy'', argument mining aims to identify the argumentative text from heterogeneous sources. Current approaches focus on exploring better ways of integrating the target-associated semantic…

Computation and Language · Computer Science 2023-07-25 Jiasheng Si , Yingjie Zhu , Xingyu Shi , Deyu Zhou , Yulan He

One of the main tasks in argument mining is the retrieval of argumentative content pertaining to a given topic. Most previous work addressed this task by retrieving a relatively small number of relevant documents as the initial source for…

Topic models are probabilistic models for discovering topical themes in collections of documents. In real world applications, these models provide us with the means of organizing what would otherwise be unstructured collections. They can…

Information Retrieval · Computer Science 2015-03-06 Wesam Elshamy

To study social, economic, and historical questions, researchers in the social sciences and humanities have started to use increasingly large unstructured textual datasets. While recent advances in NLP provide many tools to efficiently…

In this paper, we extend some usual techniques of classification resulting from a large-scale data-mining and network approach. This new technology, which in particular is designed to be suitable to big data, is used to construct an open…

Physics and Society · Physics 2017-07-05 Antonin Bergeaud , Yoann Potiron , Juste Raimbault

Statistical topic models efficiently facilitate the exploration of large-scale data sets. Many models have been developed and broadly used to summarize the semantic structure in news, science, social media, and digital humanities. However,…

Machine Learning · Computer Science 2016-12-02 Jian Tang , Cheng Li , Ming Zhang , Qiaozhu Mei

Topic models jointly learn topics and document-level topic distribution. Extrinsic evaluation of topic models tends to focus exclusively on topic-level evaluation, e.g. by assessing the coherence of topics. We demonstrate that there can be…

Computation and Language · Computer Science 2017-06-19 Shraey Bhatia , Jey Han Lau , Timothy Baldwin

We propose a Concentrated Document Topic Model(CDTM) for unsupervised text classification, which is able to produce a concentrated and sparse document topic distribution. In particular, an exponential entropy penalty is imposed on the…

Machine Learning · Statistics 2021-02-10 Hao Lei , Ying Chen

Topic models represent groups of documents as a list of words (the topic labels). This work asks whether an alternative approach to topic labeling can be developed that is closer to a natural language description of a topic than a word…

Computation and Language · Computer Science 2022-11-11 Domenic Rosati

Topic models are popular statistical tools for detecting latent semantic topics in a text corpus. They have been utilized in various applications across different fields. However, traditional topic models have some limitations, including…

Computation and Language · Computer Science 2023-10-10 Pritom Saha Akash , Trisha Das , Kevin Chen-Chuan Chang

Social scientists analyze citation networks to study how documents influence subsequent work across various domains such as judicial politics and international relations. However, conventional approaches that summarize document attributes…

Applications · Statistics 2025-02-26 ByungKoo Kim , Saki Kuzushima , Yuki Shiraito

Topic models are popular models for analyzing a collection of text documents. The models assert that documents are distributions over latent topics and latent topics are distributions over words. A nested document collection is where…

Information Retrieval · Computer Science 2021-04-05 Jason Wang , Robert E. Weiss

Document collections of various domains, e.g., legal, medical, or financial, often share some underlying collection-wide structure, which captures information that can aid both human users and structure-aware models. We propose to identify…

Computation and Language · Computer Science 2025-08-27 Gili Lior , Yoav Goldberg , Gabriel Stanovsky

A plethora of sentence embedding models makes it challenging to choose one, especially for technical domains rich with specialized vocabulary. In this work, we domain adapt embeddings using telecom data for question answering. We evaluate…

It has been reported that clustering-based topic models, which cluster high-quality sentence embeddings with an appropriate word selection method, can generate better topics than generative probabilistic topic models. However, these…

Computation and Language · Computer Science 2023-06-07 Leihang Zhang , Jiapeng Liu , Qiang Yan

Beyond bibliometrics, there is interest in characterizing the evolution of the number of ideas in scientific papers. A common approach for investigating this involves analyzing the titles of publications to detect vocabulary changes over…

Computation and Language · Computer Science 2022-08-31 James Powell , Martin Klein , Lyudmila Balakireva

Topic models are often used to identify human-interpretable topics to help make sense of large document collections. We use knowledge distillation to combine the best attributes of probabilistic topic models and pretrained transformers. Our…

Computation and Language · Computer Science 2020-10-07 Alexander Hoyle , Pranav Goel , Philip Resnik

Though word embeddings and topics are complementary representations, several past works have only used pre-trained word embeddings in (neural) topic modeling to address data sparsity problem in short text or small collection of documents.…

Computation and Language · Computer Science 2019-09-18 Pankaj Gupta , Yatin Chaudhary , Hinrich Schütze

Topic models provide a useful tool to organize and understand the structure of large corpora of text documents, in particular, to discover hidden thematic structure. Clustering documents from big unstructured corpora into topics is an…

Statistics Theory · Mathematics 2021-07-09 Olga Klopp , Maxim Panov , Suzanne Sigalla , Alexandre Tsybakov

Argument mining is a core technology for automating argument search in large document collections. Despite its usefulness for this task, most current approaches to argument mining are designed for use only with specific text types and fall…

Computation and Language · Computer Science 2018-02-19 Christian Stab , Tristan Miller , Iryna Gurevych