English
Related papers

Related papers: ANTM: An Aligned Neural Topic Model for Exploring …

200 papers

Retrieval and recommendation are two essential tasks in modern search tools. This paper introduces a novel retrieval-reranking framework leveraging Large Language Models (LLMs) to enhance the spatiotemporal and semantic associated mining…

Information Retrieval · Computer Science 2024-11-21 Yuanyuan Tian , Wenwen Li , Lei Hu , Xiao Chen , Michael Brook , Michael Brubaker , Fan Zhang , Anna K. Liljedahl

Diffusion Language Models (DLMs) promise parallel generation and bidirectional context, yet they underperform autoregressive (AR) models in both likelihood modeling and generated text quality. We identify that this performance gap arises…

Computation and Language · Computer Science 2025-05-27 Litu Rout , Constantine Caramanis , Sanjay Shakkottai

As a core cognitive skill that enables the transferability of information across domains, analogical reasoning has been extensively studied for both humans and computational models. However, while cognitive theories of analogy often focus…

Computation and Language · Computer Science 2024-09-05 Zhivar Sourati , Filip Ilievski , Pia Sommerauer , Yifan Jiang

As we continue to collect and store textual data in a multitude of domains, we are regularly confronted with material whose largely unknown thematic structure we want to uncover. With unsupervised, exploratory analysis, no prior knowledge…

Information Retrieval · Computer Science 2015-07-20 Samuel Rönnqvist

Retrieval-augmented generation (RAG) systems rely on accurate document retrieval to ground large language models (LLMs) in external knowledge, yet retrieval quality often degrades in corpora where topics overlap and thematic variation is…

Information Retrieval · Computer Science 2026-01-06 Rodrigo Kataishi

Extracting coherent and human-understandable themes from large collections of unstructured historical newspaper archives presents significant challenges due to topic evolution, Optical Character Recognition (OCR) noise, and the sheer volume…

Computation and Language · Computer Science 2025-12-15 Keerthana Murugaraj , Salima Lamsiyah , Marten During , Martin Theobald

We propose a novel generative model to explore both local and global context for joint learning topics and topic-specific word embeddings. In particular, we assume that global latent topics are shared across documents, a word is generated…

Computation and Language · Computer Science 2020-08-12 Lixing Zhu , Yulan He , Deyu Zhou

Topic models are often used to identify human-interpretable topics to help make sense of large document collections. We use knowledge distillation to combine the best attributes of probabilistic topic models and pretrained transformers. Our…

Computation and Language · Computer Science 2020-10-07 Alexander Hoyle , Pranav Goel , Philip Resnik

With the success of pre-trained visual-language (VL) models such as CLIP in visual representation tasks, transferring pre-trained models to downstream tasks has become a crucial paradigm. Recently, the prompt tuning paradigm, which draws…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Jingsheng Gao , Jiacheng Ruan , Suncheng Xiang , Zefang Yu , Ke Ji , Mingye Xie , Ting Liu , Yuzhuo Fu

Documents exhibit sequential structure at multiple levels of abstraction (e.g., sentences, paragraphs, sections). These abstractions constitute a natural hierarchy for representing the context in which to infer the meaning of words and…

Computation and Language · Computer Science 2016-06-01 Shalini Ghosh , Oriol Vinyals , Brian Strope , Scott Roy , Tom Dean , Larry Heck

One of the challenges for text analysis in medical domains is analyzing large-scale medical documents. As a consequence, finding relevant documents has become more difficult. One of the popular methods to retrieve information based on…

Information Retrieval · Computer Science 2019-11-26 Amir Karami , Aryya Gangopadhyay , Bin Zhou , Hadi Kharrazi

There is an escalating need for methods to identify latent patterns in text data from many domains. We introduce a new method to identify topics in a corpus and represent documents as topic sequences. Discourse Atom Topic Modeling draws on…

Computation and Language · Computer Science 2022-10-06 Alina Arseniev-Koehler , Susan D. Cochran , Vickie M. Mays , Kai-Wei Chang , Jacob Gates Foster

Time-series anomaly detection plays a central role across a wide range of application domains. With the increasing proliferation of the Internet of Things (IoT) and smart manufacturing, time-series data has dramatically increased in both…

Machine Learning · Computer Science 2025-10-13 Yuan-Cheng Yu , Yen-Chieh Ouyang , Chun-An Lin

Extracting and identifying latent topics in large text corpora has gained increasing importance in Natural Language Processing (NLP). Most models, whether probabilistic models similar to Latent Dirichlet Allocation (LDA) or neural topic…

Computation and Language · Computer Science 2023-03-31 Anton Thielmann , Quentin Seifert , Arik Reuter , Elisabeth Bergherr , Benjamin Säfken

The advent of the Transformer architecture has propelled the growth of natural language processing (NLP) models, leading to remarkable achievements in numerous NLP tasks. Yet, the absence of specialized hardware like expansive GPU memory…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-18 Xiaofeng Wu , Jia Rao , Wei Chen

While diffusion models advance text-to-motion generation, their static semantic conditioning ignores temporal-frequency demands: early denoising requires structural semantics for motion foundations while later stages need localized details…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Wenshuo Chen , Kuimou Yu , Haozhe Jia , Kaishen Yuan , Zexu Huang , Bowen Tian , Songning Lai , Hongru Xiao , Erhang Zhang , Lei Wang , Yutao Yue

The present study proposes a novel method of trend detection and visualization - more specifically, modeling the change in a topic over time. Where current models used for the identification and visualization of trends only convey the…

Computation and Language · Computer Science 2023-09-19 Angad Sandhu , Aneesh Edara , Vishesh Narayan , Faizan Wajid , Ashok Agrawala

Early detection and precise characterization of emerging topics in text streams can be highly useful in applications such as timely and targeted public health interventions and discovering evolving regional business trends. Many methods…

Information Retrieval · Computer Science 2016-02-16 Abhinav Maurya , Kenton Murray , Yandong Liu , Chris Dyer , William W. Cohen , Daniel B. Neill

This study utilizes machine learning algorithms to analyze and organize knowledge in the field of algorithmic trading. By filtering a dataset of 136 million research papers, we identified 14,342 relevant articles published between 1956 and…

Statistical Finance · Quantitative Finance 2024-11-11 Stanisław Łaniewski , Robert Ślepaczuk

Topic modeling is a popular method used to describe biological count data. With topic models, the user must specify the number of topics $K$. Since there is no definitive way to choose $K$ and since a true value might not exist, we develop…

Applications · Statistics 2022-03-10 Julia Fukuyama , Kris Sankaran , Laura Symul