English
Related papers

Related papers: SDEC: Semantic Deep Embedded Clustering

200 papers

Teachers often conduct surveys in order to collect data from a predefined group of students to gain insights into topics of interest. When analyzing surveys with open-ended textual responses, it is extremely time-consuming, labor-intensive,…

Machine Learning · Computer Science 2022-10-11 Soheil Esmaeilzadeh , Brian Williams , Davood Shamsi , Onar Vikingstad

In this work, we propose a semi-supervised method for short text clustering, where we represent texts as distributed vectors with neural networks, and use a small amount of labeled data to specify our intention for clustering. We design a…

Computation and Language · Computer Science 2017-07-18 Zhiguo Wang , Haitao Mi , Abraham Ittycheriah

Many complex systems in the real world can be characterized by attributed networks. To mine the potential information in these networks, deep embedded clustering, which obtains node representations and clusters simultaneously, has been paid…

Machine Learning · Computer Science 2022-05-31 Yimei Zheng , Caiyan Jia , Jian Yu , Xuanya Li

Text embeddings are commonly evaluated on a small set of datasets from a single task not covering their possible applications to other tasks. It is unclear whether state-of-the-art embeddings on semantic textual similarity (STS) can be…

Computation and Language · Computer Science 2023-03-21 Niklas Muennighoff , Nouamane Tazi , Loïc Magne , Nils Reimers

Text clustering is today the most popular paradigm for topic modelling, both in academia and industry. Despite clustering topic models' apparent success, we identify a number of issues in Top2Vec and BERTopic, which remain largely unsolved.…

Artificial Intelligence · Computer Science 2026-01-30 Márton Kardos

In this paper we propose a Deep Autoencoder MIxture Clustering (DAMIC) algorithm based on a mixture of deep autoencoders where each cluster is represented by an autoencoder. A clustering network transforms the data into another space and…

Machine Learning · Computer Science 2019-03-28 Shlomo E. Chazan , Sharon Gannot , Jacob Goldberger

Achieving reliable communication has long been a fundamental challenge in networked systems. Semantic Error Correction (SEC) leverages the semantic understanding capabilities of language models (LMs) to perform application-layer error…

Information Theory · Computer Science 2026-03-30 Yirun Wang , Yuyang Du , Soung Chang Liew , Yuchen Pan , Feifan Zhang , Lihao Zhang

Text clustering aims to automatically partition a collection of documents into coherent groups based on their linguistic features. In the literature, this task is formulated either as metric clustering over pre-trained text embeddings or as…

Computation and Language · Computer Science 2025-08-22 Hongtao Wang , Taiyan Zhang , Renchi Yang , Jianliang Xu

We study semantic compression for text where meanings contained in the text are conveyed to a source decoder, e.g., for classification. The main motivator to move to such an approach of recovering the meaning without requiring exact…

Information Theory · Computer Science 2023-09-20 Emrecan Kutay , Aylin Yener

Ambiguity is ubiquitous in natural language. Resolving ambiguous meanings is especially important in information retrieval tasks. While word embeddings carry semantic information, they fail to handle ambiguity well. Transformer models have…

Computation and Language · Computer Science 2023-07-26 Matthias Thurnbauer , Johannes Reisinger , Christoph Goller , Andreas Fischer

Autoencoders offer a general way of learning low-dimensional, non-linear representations from data without labels. This is achieved without making any particular assumptions about the data type or other domain knowledge. The generality and…

Machine Learning · Computer Science 2025-05-27 Collin Leiber , Lukas Miklautz , Claudia Plant , Christian Böhm

Topic modeling is a key method in text analysis, but existing approaches fail to efficiently scale to large datasets or are limited by assuming one topic per document. Overcoming these limitations, we introduce Semantic Component Analysis…

Computation and Language · Computer Science 2025-09-29 Florian Eichin , Carolin M. Schuster , Georg Groh , Michael A. Hedderich

The abundance of text data being produced in the modern age makes it increasingly important to intuitively group, categorize, or classify text data by theme for efficient retrieval and search. Yet, the high dimensionality and imprecision of…

Computation and Language · Computer Science 2018-11-07 Robert Frank Martorano

Sentence embeddings are an important component of many natural language processing (NLP) systems. Like word embeddings, sentence embeddings are typically learned on large text corpora and then transferred to various downstream tasks, such…

Computation and Language · Computer Science 2021-05-28 John Giorgi , Osvald Nitski , Bo Wang , Gary Bader

Tasks such as semantic search and clustering on crisis-related social media texts enhance our comprehension of crisis discourse, aiding decision-making and targeted interventions. Pre-trained language models have advanced performance in…

Computation and Language · Computer Science 2024-03-26 Rabindra Lamsal , Maria Rodriguez Read , Shanika Karunasekera

We introduce a novel approach to text classification by combining doc2vec embeddings with advanced clustering techniques to improve the analysis of specialized, high-dimensional textual data. We integrate unsupervised methods such as…

Computational Engineering, Finance, and Science · Computer Science 2025-01-08 Nathan Monnet , Loïc Maréchal , Julian Jang-Jaccard , Alain Mermoud

Modern graph embedding procedures can efficiently process graphs with millions of nodes. In this paper, we propose GEMSEC -- a graph embedding algorithm which learns a clustering of the nodes simultaneously with computing their embedding.…

Social and Information Networks · Computer Science 2019-07-26 Benedek Rozemberczki , Ryan Davies , Rik Sarkar , Charles Sutton

Deep learning methods are primarily proposed for supervised learning of images or text with limited applications to clustering problems. In contrast, tabular data with heterogeneous features pose unique challenges in representation…

Machine Learning · Computer Science 2024-05-20 Shourav B. Rabbani , Ivan V. Medri , Manar D. Samad

In this paper, we present a novel cross-consistency based semi-supervised approach for semantic segmentation. Consistency training has proven to be a powerful semi-supervised learning framework for leveraging unlabeled data under the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Yassine Ouali , Céline Hudelot , Myriam Tami

Heterogeneous data, which encompass both numerical financial variables and textual records, present substantial challenges for credit monitoring. To address this issue, we propose Advanced Spectral Clustering (ASC), a method that integrates…

Machine Learning · Computer Science 2025-09-03 Lu Han , Mengyan Li , Jiping Qiang , Zhi Su