English
Related papers

Related papers: Clustering Words with the MDL Principle

200 papers

This paper describes experiments showing that some tasks in natural language processing (NLP) can already be performed using quantum computers, though so far only with small datasets. We demonstrate various approaches to topic…

Computation and Language · Computer Science 2024-04-17 Dominic Widdows , Aaranya Alexander , Daiwei Zhu , Chase Zimmerman , Arunava Majumder

Typical deep clustering methods, while achieving notable progress, can only provide one clustering result per dataset. This limitation arises from their assumption of a fixed underlying data distribution, which may fail to meet user needs…

Machine Learning · Computer Science 2025-12-02 Xinyue Wang , Yuheng Jia , Hui Liu , Junhui Hou

We propose a theoretical framework within which information on the vocabulary of a given corpus can be inferred on the basis of statistical information gathered on that corpus. Inferences can be made on the categories of the words in the…

Computation and Language · Computer Science 2008-10-08 Pascal Vaillant , Richard Nock , Claudia Henry

Data plays a fundamental role in the training of Large Language Models (LLMs). While attention has been paid to the collection and composition of datasets, determining the data sampling strategy in training remains an open question. Most…

Computation and Language · Computer Science 2024-06-04 Yunfan Shao , Linyang Li , Zhaoye Fei , Hang Yan , Dahua Lin , Xipeng Qiu

Much of information sits in an unprecedented amount of text data. Managing allocation of these large scale text data is an important problem for many areas. Topic modeling performs well in this problem. The traditional generative models…

Machine Learning · Computer Science 2015-11-30 Guorui Zhou , Guang Chen

Clustering is often used for discovering structure in data. Clustering systems differ in the objective function used to evaluate clustering quality and the control strategy used to search the space of clusterings. Ideally, the search…

Artificial Intelligence · Computer Science 2014-11-17 D. Fisher

In this paper we present a model for unsupervised topic discovery in texts corpora. The proposed model uses documents, words, and topics lookup table embedding as neural network model parameters to build probabilities of words given topics,…

Computation and Language · Computer Science 2019-11-26 Sileye 0. Ba

Compounding is a highly productive word-formation process in some languages that is often problematic for natural language processing applications. In this paper, we investigate whether distributional semantics in the form of word…

Computation and Language · Computer Science 2015-09-16 Joachim Daiber , Lautaro Quiroz , Roger Wechsler , Stella Frank

This paper studies fast fusion of dense retrieval and sparse lexical retrieval, and proposes a cluster-based selective dense retrieval method called CluSD guided by sparse lexical retrieval. CluSD takes a lightweight cluster-based approach…

Information Retrieval · Computer Science 2025-02-18 Yingrui Yang , Parker Carlson , Yifan Qiao , Wentai Xie , Shanxiu He , Tao Yang

Evaluating the performance of clustering models is a challenging task where the outcome depends on the definition of what constitutes a cluster. Due to this design, current existing metrics rarely handle multiple clustering models with…

Machine Learning · Computer Science 2025-05-08 Louis Ohl , Fredrik Lindsten

Hierarchical clustering is a class of algorithms that seeks to build a hierarchy of clusters. It has been the dominant approach to constructing embedded classification schemes since it outputs dendrograms, which capture the hierarchical…

Machine Learning · Statistics 2018-08-28 Xiaofei Ma , Satya Dhavala

The problem of optimizing distributed database includes: fragmentation and positioning data. Several different approaches and algorithms have been proposed to solve this problem. In this paper, we propose an algorithm that builds the…

Databases · Computer Science 2015-05-08 Van Nghia Luong , Ha Huy Cuong Nguyen , Van Son Le

Classifying the same event reported by different countries is of significant importance for public opinion control and intelligence gathering. Due to the diverse types of news, relying solely on transla-tors would be costly and inefficient,…

Computation and Language · Computer Science 2023-05-31 Lin Wu , Rui Li , Wong-Hing Lam

This work addresses the problem of learning sparse representations of tensor data using structured dictionary learning. It proposes learning a mixture of separable dictionaries to better capture the structure of tensor data by generalizing…

Machine Learning · Computer Science 2020-06-16 Mohsen Ghassemi , Zahra Shakeri , Anand D. Sarwate , Waheed U. Bajwa

In this paper, we describe a research method that generates Bangla word clusters on the basis of relating to meaning in language and contextual similarity. The importance of word clustering is in parts of speech (POS) tagging, word sense…

Computation and Language · Computer Science 2017-01-31 Dipaloke Saha , Md Saddam Hossain , MD. Saiful Islam , Sabir Ismail

The goal of clustering is to group similar objects into meaningful partitions. This process is well understood when an explicit similarity measure between the objects is given. However, far less is known when this information is not readily…

Machine Learning · Computer Science 2020-10-12 Michaël Perrot , Pascal Mattia Esser , Debarghya Ghoshdastidar

We propose a Topic Compositional Neural Language Model (TCNLM), a novel method designed to simultaneously capture both the global semantic meaning and the local word ordering structure in a document. The TCNLM learns the global semantic…

Machine Learning · Computer Science 2018-02-27 Wenlin Wang , Zhe Gan , Wenqi Wang , Dinghan Shen , Jiaji Huang , Wei Ping , Sanjeev Satheesh , Lawrence Carin

Predicting the thermodynamic properties of mixtures is crucial for process design and optimization in chemical engineering. Machine learning (ML) methods are gaining increasing attention in this field, but experimental data for training are…

Machine Learning · Computer Science 2024-10-10 Dominik Gond , Jan-Tobias Sohns , Heike Leitte , Hans Hasse , Fabian Jirasek

Dictionaries are often developed using tools that save to Extensible Markup Language (XML)-based standards. These standards often allow high-level repeating elements to represent lexical entries, and utilize descendants of these repeating…

Computation and Language · Computer Science 2016-02-18 Paul Rodrigues , David Zajic , David Doermann , Michael Bloodgood , Peng Ye

The paper tackles the problem of clustering multiple networks, directed or not, that do not share the same set of vertices, into groups of networks with similar topology. A statistical model-based approach based on a finite mixture of…

Statistics Theory · Mathematics 2023-11-07 Tabea Rebafka