English
Related papers

Related papers: Parsing Through Boundaries in Chinese Word Segment…

200 papers

Cross-lingual Natural Language Processing (NLP) has gained significant traction in recent years, offering practical solutions in low-resource settings by transferring linguistic knowledge from resource-rich to low-resource languages. This…

Computation and Language · Computer Science 2025-11-14 Rocco Tripodi , Xiaoyu Liu

Chinese word segmentation and part-of-speech tagging are necessary tasks in terms of computational linguistics and application of natural language processing. Many re-searchers still debate the demand for Chinese word segmentation and…

Computation and Language · Computer Science 2021-12-20 Duc-Vu Nguyen , Linh-Bao Vo , Ngoc-Linh Tran , Kiet Van Nguyen , Ngan Luu-Thuy Nguyen

Rapidly developed neural models have achieved competitive performance in Chinese word segmentation (CWS) as their traditional counterparts. However, most of methods encounter the computational inefficiency especially for long sentences…

Computation and Language · Computer Science 2019-01-30 Sufeng Duan , Jiangtong Li , Hai Zhao

Previous work has predominantly focused on monolingual English semantic parsing. We, instead, explore the feasibility of Chinese semantic parsing in the absence of labeled data for Chinese meaning representations. We describe the pipeline…

Computation and Language · Computer Science 2023-06-19 Chunliu Wang , Xiao Zhang , Johan Bos

The task of semantic parsing is highly useful for dialogue and question answering systems. Many datasets have been proposed to map natural language text into SQL, among which the recent Spider dataset provides cross-domain samples with…

Computation and Language · Computer Science 2019-10-17 Qingkai Min , Yuefeng Shi , Yue Zhang

This paper reviews the development of Chinese word segmentation (CWS) in the most recent decade, 2007-2017. Special attention was paid to the deep learning technologies that has already permeated into most areas of natural language…

Computation and Language · Computer Science 2019-01-21 Hai Zhao , Deng Cai , Changning Huang , Chunyu Kit

Named entity recognition, and other information extraction tasks, frequently use linguistic features such as part of speech tags or chunkings. For languages where word boundaries are not readily identified in text, word segmentation is a…

Computation and Language · Computer Science 2017-03-30 Nanyun Peng , Mark Dredze

Prior methods to text segmentation are mostly at token level. Despite the adequacy, this nature limits their full potential to capture the long-term dependencies among segments. In this work, we propose a novel framework that incrementally…

Computation and Language · Computer Science 2021-04-16 Yangming Li , Lemao Liu , Kaisheng Yao

Multi-criteria Chinese word segmentation is a promising but challenging task, which exploits several different segmentation criteria and mines their common underlying knowledge. In this paper, we propose a flexible multi-criteria learning…

Computation and Language · Computer Science 2018-12-20 Jingjing Gong , Xinchi Chen , Tao Gui , Xipeng Qiu

Recently, it is quite common to integrate Chinese sequence labeling results to enhance syntactic and semantic parsing. However, little attention has been paid to the utility of hierarchy and structure information encoded in syntactic and…

Computation and Language · Computer Science 2023-06-06 Xuemei Tang , Jun Wang , Qi Su

In recent years, after the neural-network-based method was proposed, the accuracy of the Chinese word segmentation task has made great progress. However, when dealing with out-of-vocabulary words, there is still a large error rate. We used…

Computation and Language · Computer Science 2019-01-18 Yung-Sung Chuang

We present a machine learning approach to distinguish texts translated to Chinese (by humans) from texts originally written in Chinese, with a focus on a wide range of syntactic features. Using Support Vector Machines (SVMs) as classifier…

Computation and Language · Computer Science 2018-04-25 Hai Hu , Wen Li , Sandra Kübler

Chinese parsing has traditionally been solved by three pipeline systems including word-segmentation, part-of-speech tagging and dependency parsing modules. In this paper, we propose an end-to-end Chinese parsing model based on character…

Computation and Language · Computer Science 2020-12-09 Yuan Zhang , Zhiyang Teng , Yue Zhang

Word segmentation is the task of inserting or deleting word boundary characters in order to separate character sequences that correspond to words in some language. In this article we propose an approach based on a beam search algorithm and…

Computation and Language · Computer Science 2018-12-04 Yerai Doval , Carlos Gómez-Rodríguez

Recently, Chinese word segmentation (CWS) methods using neural networks have made impressive progress. Most of them regard the CWS as a sequence labeling problem which construct models based on local features rather than considering global…

Computation and Language · Computer Science 2019-12-02 Xuewen Shi , Heyan Huang , Ping Jian , Yuhang Guo , Xiaochi Wei , Yi-Kun Tang

We present a stochastic finite-state model for segmenting Chinese text into dictionary entries and productively derived words, and providing pronunciations for these words; the method incorporates a class-based model in its treatment of…

cmp-lg · Computer Science 2008-02-03 Richard Sproat , Chilin Shih , William Gale , Nancy Chang

Discourse segmentation aims to segment Elementary Discourse Units (EDUs) and is a fundamental task in discourse analysis. For Chinese, previous researches identify EDUs just through discriminating the functions of punctuations. In this…

Computation and Language · Computer Science 2018-09-06 Jingfeng Yang , Sujian Li

Lexical simplification has attracted much attention in many languages, which is the process of replacing complex words in a given sentence with simpler alternatives of equivalent meaning. Although the richness of vocabulary in Chinese makes…

Computation and Language · Computer Science 2020-10-15 Jipeng Qiang , Xinyu Lu , Yun Li , Yunhao Yuan , Yang Shi , Xindong Wu

Conventional statistics-based methods for joint Chinese word segmentation and part-of-speech tagging (S&T) have generalization ability to recognize new words that do not appear in the training data. An undesirable side effect is that a…

Computation and Language · Computer Science 2013-05-28 Kaixu Zhang , Maosong Sun

Neural network has become the dominant method for Chinese word segmentation. Most existing models cast the task as sequence labeling, using BiLSTM-CRF for representing the input and making output predictions. Recently, attention-based…

Computation and Language · Computer Science 2019-07-29 Leilei Gan , Yue Zhang