English
Related papers

Related papers: Neural Chinese Word Segmentation with Dictionary K…

200 papers

Character-based sequence labeling framework is flexible and efficient for Chinese word segmentation (CWS). Recently, many character-based neural models have been applied to CWS. While they obtain good performance, they have two obvious…

Computation and Language · Computer Science 2017-11-15 Chunqi Wang , Bo Xu

Chinese word segmentation is necessary to provide word-level information for Chinese named entity recognition (NER) systems. However, segmentation error propagation is a challenge for Chinese NER while processing colloquial data like social…

Computation and Language · Computer Science 2020-06-16 Shengbin Jia , Ling Ding , Xiaojun Chen , Shijia E , Yang Xiang

In recent years, neural networks have proven to be effective in Chinese word segmentation. However, this promising performance relies on large-scale training data. Neural networks with conventional architectures cannot achieve the desired…

Computation and Language · Computer Science 2017-11-07 Jingjing Xu , Xu Sun , Sujian Li , Xiaoyan Cai , Bingzhen Wei

Electronic Health Records (EHRs) in hospital information systems contain patients' diagnosis and treatments, so EHRs are essential to clinical data mining. Of all the tasks in the mining process, Chinese Word Segmentation (CWS) is a…

Computation and Language · Computer Science 2020-07-20 Tingting Cai , Zhiyuan Ma , Hong Zheng , Yangming Zhou

Recent studies have shown effectiveness in using neural networks for Chinese word segmentation. However, these models rely on large-scale data and are less effective for low-resource datasets because of insufficient training data. We…

Computation and Language · Computer Science 2017-09-15 Jingjing Xu , Xu Sun

We present a simple yet elegant solution to train a single joint model on multi-criteria corpora for Chinese Word Segmentation (CWS). Our novel design requires no private layers in model architecture, instead, introduces two artificial…

Computation and Language · Computer Science 2018-01-08 Han He , Lei Wu , Hua Yan , Zhimin Gao , Yi Feng , George Townsend

Neural network has become the dominant method for Chinese word segmentation. Most existing models cast the task as sequence labeling, using BiLSTM-CRF for representing the input and making output predictions. Recently, attention-based…

Computation and Language · Computer Science 2019-07-29 Leilei Gan , Yue Zhang

Fully supervised neural approaches have achieved significant progress in the task of Chinese word segmentation (CWS). Nevertheless, the performance of supervised models tends to drop dramatically when they are applied to out-of-domain data.…

Computation and Language · Computer Science 2020-09-03 Ning Ding , Dingkun Long , Guangwei Xu , Muhua Zhu , Pengjun Xie , Xiaobin Wang , Hai-Tao Zheng

Neural models with minimal feature engineering have achieved competitive performance against traditional methods for the task of Chinese word segmentation. However, both training and working procedures of the current neural models are…

Computation and Language · Computer Science 2017-04-25 Deng Cai , Hai Zhao , Zhisong Zhang , Yuan Xin , Yongjian Wu , Feiyue Huang

Recurrent neural network(RNN) has been broadly applied to natural language processing(NLP) problems. This kind of neural network is designed for modeling sequential data and has been testified to be quite efficient in sequential tagging…

Machine Learning · Computer Science 2016-02-22 Yushi Yao , Zheng Huang

Chinese word segmentation is a foundational task in natural language processing (NLP), with far-reaching effects on syntactic analysis. Unlike alphabetic languages like English, Chinese lacks explicit word boundaries, making segmentation…

Computation and Language · Computer Science 2025-07-08 Yige Chen , Zelong Li , Cindy Zhang , Changbing Yang , Amandisa Cady , Ai Ka Lee , Zejiao Zeng , Eunkyul Leah Jo , Haihua Pan , Jungyeul Park

In recent years, after the neural-network-based method was proposed, the accuracy of the Chinese word segmentation task has made great progress. However, when dealing with out-of-vocabulary words, there is still a large error rate. We used…

Computation and Language · Computer Science 2019-01-18 Yung-Sung Chuang

Inspired by early research on exploring naturally annotated data for Chinese word segmentation (CWS), and also by recent research on integration of speech and text processing, this work for the first time proposes to mine word boundaries…

Computation and Language · Computer Science 2023-10-31 Lei Zhang , Zhenghua Li , Shilin Zhou , Chen Gong , Zhefeng Wang , Baoxing Huai , Min Zhang

Chinese word segmentation and part-of-speech tagging are necessary tasks in terms of computational linguistics and application of natural language processing. Many re-searchers still debate the demand for Chinese word segmentation and…

Computation and Language · Computer Science 2021-12-20 Duc-Vu Nguyen , Linh-Bao Vo , Ngoc-Linh Tran , Kiet Van Nguyen , Ngan Luu-Thuy Nguyen

Multi-criteria Chinese word segmentation (MCCWS) aims to exploit the relations among the multiple heterogeneous segmentation criteria and further improve the performance of each single criterion. Previous work usually regards MCCWS as…

Computation and Language · Computer Science 2020-10-06 Xipeng Qiu , Hengzhi Pei , Hang Yan , Xuanjing Huang

Recently, neural network models for natural language processing tasks have been increasingly focused on for their ability of alleviating the burden of manual feature engineering. However, the previous neural models cannot extract the…

Computation and Language · Computer Science 2017-07-04 Xinchi Chen , Xipeng Qiu , Xuanjing Huang

Multi-Criteria Chinese Word Segmentation (MCCWS) aims at finding word boundaries in a Chinese sentence composed of continuous characters while multiple segmentation criteria exist. The unified framework has been widely used in MCCWS and…

Computation and Language · Computer Science 2020-04-14 Zhen Ke , Liang Shi , Erli Meng , Bin Wang , Xipeng Qiu , Xuanjing Huang

We investigate a lattice LSTM network for Chinese word segmentation (CWS) to utilize words or subwords. It integrates the character sequence features with all subsequences information matched from a lexicon. The matched subsequences serve…

Computation and Language · Computer Science 2018-10-31 Jie Yang , Yue Zhang , Shuailong Liang

Most previous approaches to Chinese word segmentation can be roughly classified into character-based and word-based methods. The former regards this task as a sequence-labeling problem, while the latter directly segments character sequence…

Computation and Language · Computer Science 2017-12-29 Zhiqing Sun , Gehui Shen , Zhihong Deng

Chinese named entity recognition (CNER) is an important task in Chinese natural language processing field. However, CNER is very challenging since Chinese entity names are highly context-dependent. In addition, Chinese texts lack delimiters…

Computation and Language · Computer Science 2019-05-07 Fangzhao Wu , Junxin Liu , Chuhan Wu , Yongfeng Huang , Xing Xie