English
Related papers

Related papers: Unsupervised Word Segmentation using K Nearest Nei…

200 papers

Zero-resource word segmentation and clustering systems aim to tokenise speech into word-like units without access to text labels. Despite progress, the induced lexicons are still far from perfect. In an idealised setting with gold word…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-28 Danel Slabbert , Simon Malan , Herman Kamper

This paper presents a model-based, unsupervised algorithm for recovering word boundaries in a natural-language text from which they have been deleted. The algorithm is derived from a probability model of the source that generated the text.…

Computation and Language · Computer Science 2007-05-23 Michael R. Brent

We apply transfer learning to the task of phoneme segmentation and demonstrate the utility of representations learned in self-supervised pre-training for the task. Our model extends transformer-style encoders with strategically placed…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-04 Luke Strgar , David Harwath

Human infants acquire their verbal lexicon with minimal prior knowledge of language based on the statistical properties of phonological distributions and the co-occurrence of other sensory stimuli. This study proposes a novel fully…

Artificial Intelligence · Computer Science 2023-08-22 Akira Taniguchi , Hiroaki Murakami , Ryo Ozaki , Tadahiro Taniguchi

k is the most important parameter in a text categorization system based on k-Nearest Neighbor algorithm (kNN).In the classification process, k nearest documents to the test one in the training set are determined firstly. Then, the…

Computation and Language · Computer Science 2007-05-23 Baoli Li , Shiwen Yu , Qin Lu

While Word2Vec represents words (in text) as vectors carrying semantic information, audio Word2Vec was shown to be able to represent signal segments of spoken words as vectors carrying phonetic structure information. Audio Word2Vec can be…

Computation and Language · Computer Science 2018-08-08 Yu-Hsuan Wang , Hung-yi Lee , Lin-shan Lee

A statistical model for segmentation and word discovery in child directed speech is presented. An incremental unsupervised learning algorithm to infer word boundaries based on this model is described and results of empirical tests showing…

Computation and Language · Computer Science 2007-05-23 Anand Venkataraman

Unsupervised automatic speech recognition (ASR) aims to learn the mapping between the speech signal and its corresponding textual transcription without the supervision of paired speech-text data. A word/phoneme in the speech signal is…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-18 Liang-Hsuan Tseng , En-Pei Hu , Cheng-Han Chiang , Yuan Tseng , Hung-yi Lee , Lin-shan Lee , Shao-Hua Sun

To improve the efficiency of surgical trajectory segmentation for robot learning in robot-assisted minimally invasive surgery, this paper presents a fast unsupervised method using video and kinematic data, followed by a promoting procedure…

Computer Vision and Pattern Recognition · Computer Science 2018-10-02 Zhenzhou Shao , Hongfa Zhao , Jiexin Xie , Ying Qu , Yong Guan , Jindong Tan

We propose a self-supervised representation learning model for the task of unsupervised phoneme boundary detection. The model is a convolutional neural network that operates directly on the raw waveform. It is optimized to identify spectral…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-07 Felix Kreuk , Joseph Keshet , Yossi Adi

Prior methods to text segmentation are mostly at token level. Despite the adequacy, this nature limits their full potential to capture the long-term dependencies among segments. In this work, we propose a novel framework that incrementally…

Computation and Language · Computer Science 2021-04-16 Yangming Li , Lemao Liu , Kaisheng Yao

Unsupervised image segmentation is an important task in many real-world scenarios where labelled data is of scarce availability. In this paper we propose a novel approach that harnesses recent advances in unsupervised learning using a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Moshe Eliasof , Nir Ben Zikri , Eran Treister

k Nearest Neighbor (kNN) method is a simple and popular statistical method for classification and regression. For both classification and regression problems, existing works have shown that, if the distribution of the feature vector has…

Statistics Theory · Mathematics 2019-10-24 Puning Zhao , Lifeng Lai

Documenting languages helps to prevent the extinction of endangered dialects, many of which are otherwise expected to disappear by the end of the century. When documenting oral languages, unsupervised word segmentation (UWS) from speech is…

Computation and Language · Computer Science 2022-05-19 Marcely Zanon Boito , Bolaji Yusuf , Lucas Ondel , Aline Villavicencio , Laurent Besacier

The recent tremendous success of unsupervised word embeddings in a multitude of applications raises the obvious question if similar methods could be derived to improve embeddings (i.e. semantic representations) of word sequences as well. We…

Computation and Language · Computer Science 2018-12-31 Matteo Pagliardini , Prakhar Gupta , Martin Jaggi

We propose a novel unsupervised keyphrase extraction approach that filters candidate keywords using outlier detection. It starts by training word embeddings on the target document to capture semantic regularities among the words. It then…

Computation and Language · Computer Science 2020-07-14 Eirini Papagiannopoulou , Grigorios Tsoumakas

Unsupervised discovery of acoustic tokens from audio corpora without annotation and learning vector representations for these tokens have been widely studied. Although these techniques have been shown successful in some applications such as…

Computation and Language · Computer Science 2018-04-03 Da-Rong Liu , Kuan-Yu Chen , Hung-Yi Lee , Lin-shan Lee

Approximate Nearest Neighbor Search (ANNS) in high dimensional spaces is crucial for many real-life applications (e.g., e-commerce, web, multimedia, etc.) dealing with an abundance of data. This paper proposes an end-to-end learning…

Machine Learning · Computer Science 2022-10-20 Abrar Fahim , Mohammed Eunus Ali , Muhammad Aamir Cheema

This paper presents a new approach for unsupervised Spoken Term Detection with spoken queries using multiple sets of acoustic patterns automatically discovered from the target corpus. The different pattern HMM configurations(number of…

Computation and Language · Computer Science 2015-09-09 Cheng-Tao Chung , Chun-an Chan , Lin-shan Lee

Previous traditional approaches to unsupervised Chinese word segmentation (CWS) can be roughly classified into discriminative and generative models. The former uses the carefully designed goodness measures for candidate segmentation, while…

Computation and Language · Computer Science 2018-10-09 Zhiqing Sun , Zhi-Hong Deng