English
Related papers

Related papers: Bidirectional LSTM-CRF Attention-based Model for C…

200 papers

We present a simple yet elegant solution to train a single joint model on multi-criteria corpora for Chinese Word Segmentation (CWS). Our novel design requires no private layers in model architecture, instead, introduces two artificial…

Computation and Language · Computer Science 2018-01-08 Han He , Lei Wu , Hua Yan , Zhimin Gao , Yi Feng , George Townsend

Chinese word segmentation has entered the deep learning era which greatly reduces the hassle of feature engineering. Recently, some researchers attempted to treat it as character-level translation, which further simplified model designing,…

Computation and Language · Computer Science 2022-10-12 Pinzhen Chen , Kenneth Heafield

Taking greedy decoding algorithm as it should be, this work focuses on further strengthening the model itself for Chinese word segmentation (CWS), which results in an even more fast and more accurate CWS model. Our model consists of an…

Computation and Language · Computer Science 2020-10-07 Sufeng Duan , Hai Zhao

We investigate a lattice LSTM network for Chinese word segmentation (CWS) to utilize words or subwords. It integrates the character sequence features with all subsequences information matched from a lexicon. The matched subsequences serve…

Computation and Language · Computer Science 2018-10-31 Jie Yang , Yue Zhang , Shuailong Liang

Lexical analysis is believed to be a crucial step towards natural language understanding and has been widely studied. Recent years, end-to-end lexical analysis models with recurrent neural networks have gained increasing attention. In this…

Computation and Language · Computer Science 2018-07-06 Zhenyu Jiao , Shuqi Sun , Ke Sun

Many natural language processing (NLP) tasks can be generalized into segmentation problem. In this paper, we combine semi-CRF with neural network to solve NLP segmentation tasks. Our model represents a segment both by composing the input…

Computation and Language · Computer Science 2016-04-20 Yijia Liu , Wanxiang Che , Jiang Guo , Bing Qin , Ting Liu

Rapidly developed neural models have achieved competitive performance in Chinese word segmentation (CWS) as their traditional counterparts. However, most of methods encounter the computational inefficiency especially for long sentences…

Computation and Language · Computer Science 2019-01-30 Sufeng Duan , Jiangtong Li , Hai Zhao

In this paper, we propose a variety of Long Short-Term Memory (LSTM) based models for sequence tagging. These models include LSTM networks, bidirectional LSTM (BI-LSTM) networks, LSTM with a Conditional Random Field (CRF) layer (LSTM-CRF)…

Computation and Language · Computer Science 2015-08-11 Zhiheng Huang , Wei Xu , Kai Yu

The ambiguous annotation criteria lead to divergence of Chinese Word Segmentation (CWS) datasets in various granularities. Multi-criteria Chinese word segmentation aims to capture various annotation criteria among datasets and leverage…

Computation and Language · Computer Science 2020-10-12 Weipeng Huang , Xingyi Cheng , Kunlong Chen , Taifeng Wang , Wei Chu

We investigate a lattice-structured LSTM model for Chinese NER, which encodes a sequence of input characters as well as all potential words that match a lexicon. Compared with character-based methods, our model explicitly leverages word and…

Computation and Language · Computer Science 2018-07-06 Yue Zhang , Jie Yang

Chinese named entity recognition (CNER) is an important task in Chinese natural language processing field. However, CNER is very challenging since Chinese entity names are highly context-dependent. In addition, Chinese texts lack delimiters…

Computation and Language · Computer Science 2019-05-07 Fangzhao Wu , Junxin Liu , Chuhan Wu , Yongfeng Huang , Xing Xie

Named entity recognition (NER) in Chinese is essential but difficult because of the lack of natural delimiters. Therefore, Chinese Word Segmentation (CWS) is usually considered as the first step for Chinese NER. However, models based on…

Computation and Language · Computer Science 2020-07-16 Yuying Zhu , Guoxin Wang , Börje F. Karlsson

Cross-domain Chinese Word Segmentation (CWS) remains a challenge despite recent progress in neural-based CWS. The limited amount of annotated data in the target domain has been the key obstacle to a satisfactory performance. In this paper,…

Computation and Language · Computer Science 2019-08-07 Yuxiao Ye , Yue Zhang , Weikang Li , Likun Qiu , Jian Sun

Characters have commonly been regarded as the minimal processing unit in Natural Language Processing (NLP). But many non-latin languages have hieroglyphic writing systems, involving a big alphabet with thousands or millions of characters.…

Computation and Language · Computer Science 2018-01-08 Han He , Lei Wu , Xiaokun Yang , Hua Yan , Zhimin Gao , Yi Feng , George Townsend

As an important part of speech recognition technology, automatic speech keyword recognition has been intensively studied in recent years. Such technology becomes especially pivotal under situations with limited infrastructures and…

Machine Learning · Computer Science 2019-07-11 Ruisen Luo , Tianran Sun , Chen Wang , Miao Du , Zuodong Tang , Kai Zhou , Xiaofeng Gong , Xiaomei Yang

Electronic Health Records (EHRs) in hospital information systems contain patients' diagnosis and treatments, so EHRs are essential to clinical data mining. Of all the tasks in the mining process, Chinese Word Segmentation (CWS) is a…

Computation and Language · Computer Science 2020-07-20 Tingting Cai , Zhiyuan Ma , Hong Zheng , Yangming Zhou

Chinese word segmentation (CWS) is often regarded as a character-based sequence labeling task in most current works which have achieved great success with the help of powerful neural networks. However, these works neglect an important clue:…

Computation and Language · Computer Science 2019-05-31 Jingkang Wang , Jianing Zhou , Jie Zhou , Gongshen Liu

We propose a Long Short-Term Memory (LSTM) with attention mechanism to classify psychological stress from self-conducted interview transcriptions. We apply distant supervision by automatically labeling tweets based on their hashtag content,…

Computation and Language · Computer Science 2018-10-11 Genta Indra Winata , Onno Pepijn Kampman , Pascale Fung

Prior methods to text segmentation are mostly at token level. Despite the adequacy, this nature limits their full potential to capture the long-term dependencies among segments. In this work, we propose a novel framework that incrementally…

Computation and Language · Computer Science 2021-04-16 Yangming Li , Lemao Liu , Kaisheng Yao

In recent years, deep learning has achieved significant success in the Chinese word segmentation (CWS) task. Most of these methods improve the performance of CWS by leveraging external information, e.g., words, sub-words, syntax. However,…

Computation and Language · Computer Science 2022-01-25 Xuemei Tang , Jun Wang , Qi Su