English
Related papers

Related papers: Unsupervised Neural Word Segmentation for Chinese …

200 papers

Chinese word segmentation has entered the deep learning era which greatly reduces the hassle of feature engineering. Recently, some researchers attempted to treat it as character-level translation, which further simplified model designing,…

Computation and Language · Computer Science 2022-10-12 Pinzhen Chen , Kenneth Heafield

Taking greedy decoding algorithm as it should be, this work focuses on further strengthening the model itself for Chinese word segmentation (CWS), which results in an even more fast and more accurate CWS model. Our model consists of an…

Computation and Language · Computer Science 2020-10-07 Sufeng Duan , Hai Zhao

We investigate a lattice LSTM network for Chinese word segmentation (CWS) to utilize words or subwords. It integrates the character sequence features with all subsequences information matched from a lexicon. The matched subsequences serve…

Computation and Language · Computer Science 2018-10-31 Jie Yang , Yue Zhang , Shuailong Liang

Chinese word segmentation (CWS) is a fundamental task for Chinese language understanding. Recently, neural network-based models have attained superior performance in solving the in-domain CWS task. Last year, Bidirectional Encoder…

Computation and Language · Computer Science 2019-09-23 Haiqin Yang

Recent researches show that pre-trained models (PTMs) are beneficial to Chinese Word Segmentation (CWS). However, PTMs used in previous works usually adopt language modeling as pre-training tasks, lacking task-specific prior segmentation…

Computation and Language · Computer Science 2021-03-16 Zhen Ke , Liang Shi , Songtao Sun , Erli Meng , Bin Wang , Xipeng Qiu

Cross-domain Chinese Word Segmentation (CWS) remains a challenge despite recent progress in neural-based CWS. The limited amount of annotated data in the target domain has been the key obstacle to a satisfactory performance. In this paper,…

Computation and Language · Computer Science 2019-08-07 Yuxiao Ye , Yue Zhang , Weikang Li , Likun Qiu , Jian Sun

The prevalent approaches of Chinese word segmentation task almost rely on the Bi-LSTM neural network. However, the methods based the Bi-LSTM have some inherent drawbacks: hard to parallel computing, little efficient in applying the Dropout…

Computation and Language · Computer Science 2019-05-22 Wei Jiang , Yan Tang

Neural models with minimal feature engineering have achieved competitive performance against traditional methods for the task of Chinese word segmentation. However, both training and working procedures of the current neural models are…

Computation and Language · Computer Science 2017-04-25 Deng Cai , Hai Zhao , Zhisong Zhang , Yuan Xin , Yongjian Wu , Feiyue Huang

We propose a segmental neural language model that combines the generalization power of neural networks with the ability to discover word-like units that are latent in unsegmented character sequences. In contrast to previous segmentation…

Computation and Language · Computer Science 2019-06-19 Kazuya Kawakami , Chris Dyer , Phil Blunsom

Recurrent neural network(RNN) has been broadly applied to natural language processing(NLP) problems. This kind of neural network is designed for modeling sequential data and has been testified to be quite efficient in sequential tagging…

Machine Learning · Computer Science 2016-02-22 Yushi Yao , Zheng Huang

Sindhi word segmentation is a challenging task due to space omission and insertion issues. The Sindhi language itself adds to this complexity. It's cursive and consists of characters with inherent joining and non-joining properties,…

Computation and Language · Computer Science 2024-09-05 Wazir Ali , Jay Kumar , Saifullah Tumrani , Redhwan Nour , Adeeb Noor , Zenglin Xu

Recently, neural network models for natural language processing tasks have been increasingly focused on for their ability of alleviating the burden of manual feature engineering. However, the previous neural models cannot extract the…

Computation and Language · Computer Science 2017-07-04 Xinchi Chen , Xipeng Qiu , Xuanjing Huang

Most previous approaches to Chinese word segmentation can be roughly classified into character-based and word-based methods. The former regards this task as a sequence-labeling problem, while the latter directly segments character sequence…

Computation and Language · Computer Science 2017-12-29 Zhiqing Sun , Gehui Shen , Zhihong Deng

In this paper, we introduce an unsupervised approach for Speech Segmentation, which builds on previously researched approaches, e.g., Speaker Diarization, while being applicable to an inclusive set of acoustic-semantic distinctions, paving…

Computation and Language · Computer Science 2025-01-08 Avishai Elmakies , Omri Abend , Yossi Adi

The ambiguous annotation criteria lead to divergence of Chinese Word Segmentation (CWS) datasets in various granularities. Multi-criteria Chinese word segmentation aims to capture various annotation criteria among datasets and leverage…

Computation and Language · Computer Science 2020-10-12 Weipeng Huang , Xingyi Cheng , Kunlong Chen , Taifeng Wang , Wei Chu

We present a novel incremental learning approach for unsupervised word segmentation that combines features from probabilistic modeling and model selection. This includes super-additive penalties for addressing the cognitive burden imposed…

Computation and Language · Computer Science 2016-09-26 Ruey-Cheng Chen

Many natural language processing (NLP) tasks can be generalized into segmentation problem. In this paper, we combine semi-CRF with neural network to solve NLP segmentation tasks. Our model represents a segment both by composing the input…

Computation and Language · Computer Science 2016-04-20 Yijia Liu , Wanxiang Che , Jiang Guo , Bing Qin , Ting Liu

Prior methods to text segmentation are mostly at token level. Despite the adequacy, this nature limits their full potential to capture the long-term dependencies among segments. In this work, we propose a novel framework that incrementally…

Computation and Language · Computer Science 2021-04-16 Yangming Li , Lemao Liu , Kaisheng Yao

Benefiting from the strong ability of the pre-trained model, the research on Chinese Word Segmentation (CWS) has made great progress in recent years. However, due to massive computation, large and complex models are incapable of empowering…

Artificial Intelligence · Computer Science 2021-11-18 Yulan Hu , Yong Liu

Subwords have become the standard units of text in NLP, enabling efficient open-vocabulary models. With algorithms like byte-pair encoding (BPE), subword segmentation is viewed as a preprocessing step applied to the corpus before training.…

Computation and Language · Computer Science 2022-10-14 Francois Meyer , Jan Buys