English
Related papers

Related papers: Sentence Segmentation for Classical Chinese Based …

200 papers

We consider three major text sources about the Tang Dynasty of China in our experiments that aim to segment text written in classical Chinese. These corpora include a collection of Tang Tomb Biographies, the New Tang Book, and the Old Tang…

Computation and Language · Computer Science 2020-07-23 Chao-Lin Liu , Chang-Ting Chu , Wei-Ting Chang , Ti-Yong Zheng

Chinese word segmentation has entered the deep learning era which greatly reduces the hassle of feature engineering. Recently, some researchers attempted to treat it as character-level translation, which further simplified model designing,…

Computation and Language · Computer Science 2022-10-12 Pinzhen Chen , Kenneth Heafield

Intent classification has been widely researched on English data with deep learning approaches that are based on neural networks and word embeddings. The challenge for Chinese intent classification stems from the fact that, unlike English…

Computation and Language · Computer Science 2018-05-24 Ruixi Lin , Charles Costello , Charles Jankowski

In constituency parsing, span-based decoding is an important direction. However, for Chinese sentences, because of their linguistic characteristics, it is necessary to utilize other models to perform word segmentation first, which…

Computation and Language · Computer Science 2022-12-01 Zhicheng Wang , Tianyu Shi , Cong Liu

We convert the Chinese medical text attributes extraction task into a sequence tagging or machine reading comprehension task. Based on BERT pre-trained models, we have not only tried the widely used LSTM-CRF sequence tagging model, but also…

Computation and Language · Computer Science 2020-08-25 Gang Zhao , Teng Zhang , Chenxiao Wang , Ping Lv , Ji Wu

Most previous approaches to Chinese word segmentation can be roughly classified into character-based and word-based methods. The former regards this task as a sequence-labeling problem, while the latter directly segments character sequence…

Computation and Language · Computer Science 2017-12-29 Zhiqing Sun , Gehui Shen , Zhihong Deng

Recently, many works have tried to augment the performance of Chinese named entity recognition (NER) using word lexicons. As a representative, Lattice-LSTM (Zhang and Yang, 2018) has achieved new benchmark results on several public Chinese…

Computation and Language · Computer Science 2020-10-15 Ruotian Ma , Minlong Peng , Qi Zhang , Xuanjing Huang

Rapidly developed neural models have achieved competitive performance in Chinese word segmentation (CWS) as their traditional counterparts. However, most of methods encounter the computational inefficiency especially for long sentences…

Computation and Language · Computer Science 2019-01-30 Sufeng Duan , Jiangtong Li , Hai Zhao

Chinese is a logographic writing system, and the shape of Chinese characters contain rich syntactic and semantic information. In this paper, we propose a model to learn Chinese word embeddings via three-level composition: (1) a…

Computation and Language · Computer Science 2019-03-26 Chi Sun , Xipeng Qiu , Xuanjing Huang

Multi-criteria Chinese word segmentation is a promising but challenging task, which exploits several different segmentation criteria and mines their common underlying knowledge. In this paper, we propose a flexible multi-criteria learning…

Computation and Language · Computer Science 2018-12-20 Jingjing Gong , Xinchi Chen , Tao Gui , Xipeng Qiu

One-hot CNN (convolutional neural network) has been shown to be effective for text categorization (Johnson & Zhang, 2015). We view it as a special case of a general framework which jointly trains a linear model with a non-linear feature…

Machine Learning · Statistics 2016-05-27 Rie Johnson , Tong Zhang

Online and offline handwritten Chinese text recognition (HTCR) has been studied for decades. Early methods adopted oversegmentation-based strategies but suffered from low speed, insufficient accuracy, and high cost of character segmentation…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Dezhi Peng , Lianwen Jin , Weihong Ma , Canyu Xie , Hesuo Zhang , Shenggao Zhu , Jing Li

Character-based sequence labeling framework is flexible and efficient for Chinese word segmentation (CWS). Recently, many character-based neural models have been applied to CWS. While they obtain good performance, they have two obvious…

Computation and Language · Computer Science 2017-11-15 Chunqi Wang , Bo Xu

In this paper, we propose a joint algorithm for the word segmentation on Chinese social media. Previous work mainly focus on word segmentation for plain Chinese text, in order to develop a Chinese social media processing tool, we need to…

Computation and Language · Computer Science 2015-10-27 Yao Yushi , Huang Zheng

Cross-domain Chinese Word Segmentation (CWS) remains a challenge despite recent progress in neural-based CWS. The limited amount of annotated data in the target domain has been the key obstacle to a satisfactory performance. In this paper,…

Computation and Language · Computer Science 2019-08-07 Yuxiao Ye , Yue Zhang , Weikang Li , Likun Qiu , Jian Sun

Automatic analysis for modern Chinese has greatly improved the accuracy of text mining in related fields, but the study of ancient Chinese is still relatively rare. Ancient text division and lexical annotation are important parts of…

Computation and Language · Computer Science 2023-10-13 Pengyu Wang , Zhichen Ren

In this article I proposed a new model to achieve Chinese word segmentation(CWS),which may have the potentiality to apply in other domains in the future.It is a new thinking in CWS compared to previous works,to consider it as a clustering…

Computation and Language · Computer Science 2020-02-19 Yuze Zhao

Distributed word representations are very useful for capturing semantic information and have been successfully applied in a variety of NLP tasks, especially on English. In this work, we innovatively develop two component-enhanced Chinese…

Computation and Language · Computer Science 2015-08-28 Yanran Li , Wenjie Li , Fei Sun , Sujian Li

Existing methods for CWS usually rely on a large number of labeled sentences to train word segmentation models, which are expensive and time-consuming to annotate. Luckily, the unlabeled data is usually easy to collect and many high-quality…

Computation and Language · Computer Science 2019-05-07 Junxin Liu , Fangzhao Wu , Chuhan Wu , Yongfeng Huang , Xing Xie

Chinese word segmentation and part-of-speech tagging are necessary tasks in terms of computational linguistics and application of natural language processing. Many re-searchers still debate the demand for Chinese word segmentation and…

Computation and Language · Computer Science 2021-12-20 Duc-Vu Nguyen , Linh-Bao Vo , Ngoc-Linh Tran , Kiet Van Nguyen , Ngan Luu-Thuy Nguyen