English
Related papers

Related papers: A Concise Model for Multi-Criteria Chinese Word Se…

200 papers

In this paper, we propose a joint algorithm for the word segmentation on Chinese social media. Previous work mainly focus on word segmentation for plain Chinese text, in order to develop a Chinese social media processing tool, we need to…

Computation and Language · Computer Science 2015-10-27 Yao Yushi , Huang Zheng

Existing methods for CWS usually rely on a large number of labeled sentences to train word segmentation models, which are expensive and time-consuming to annotate. Luckily, the unlabeled data is usually easy to collect and many high-quality…

Computation and Language · Computer Science 2019-05-07 Junxin Liu , Fangzhao Wu , Chuhan Wu , Yongfeng Huang , Xing Xie

Character-based sequence labeling framework is flexible and efficient for Chinese word segmentation (CWS). Recently, many character-based neural models have been applied to CWS. While they obtain good performance, they have two obvious…

Computation and Language · Computer Science 2017-11-15 Chunqi Wang , Bo Xu

In constituency parsing, span-based decoding is an important direction. However, for Chinese sentences, because of their linguistic characteristics, it is necessary to utilize other models to perform word segmentation first, which…

Computation and Language · Computer Science 2022-12-01 Zhicheng Wang , Tianyu Shi , Cong Liu

Neural models with minimal feature engineering have achieved competitive performance against traditional methods for the task of Chinese word segmentation. However, both training and working procedures of the current neural models are…

Computation and Language · Computer Science 2017-04-25 Deng Cai , Hai Zhao , Zhisong Zhang , Yuan Xin , Yongjian Wu , Feiyue Huang

Segmenting a chunk of text into words is usually the first step of processing Chinese text, but its necessity has rarely been explored. In this paper, we ask the fundamental question of whether Chinese word segmentation (CWS) is necessary…

Computation and Language · Computer Science 2019-10-08 Xiaoya Li , Yuxian Meng , Xiaofei Sun , Qinghong Han , Arianna Yuan , Jiwei Li

Chinese word segmentation (CWS) is often regarded as a character-based sequence labeling task in most current works which have achieved great success with the help of powerful neural networks. However, these works neglect an important clue:…

Computation and Language · Computer Science 2019-05-31 Jingkang Wang , Jianing Zhou , Jie Zhou , Gongshen Liu

Automatic abstractive text summarization is an important and challenging research topic of natural language processing. Among many widely used languages, the Chinese language has a special property that a Chinese character contains rich…

Computation and Language · Computer Science 2018-09-11 Chieh-Teng Chang , Chi-Chia Huang , Chih-Yuan Yang , Jane Yung-Jen Hsu

Breaking down the structure of long texts into semantically coherent segments makes the texts more readable and supports downstream applications like summarization and retrieval. Starting from an apparent link between text coherence and…

Computation and Language · Computer Science 2020-01-06 Goran Glavaš , Swapna Somasundaran

In recent years, neural networks have proven to be effective in Chinese word segmentation. However, this promising performance relies on large-scale training data. Neural networks with conventional architectures cannot achieve the desired…

Computation and Language · Computer Science 2017-11-07 Jingjing Xu , Xu Sun , Sujian Li , Xiaoyan Cai , Bingzhen Wei

Chinese word segmentation has entered the deep learning era which greatly reduces the hassle of feature engineering. Recently, some researchers attempted to treat it as character-level translation, which further simplified model designing,…

Computation and Language · Computer Science 2022-10-12 Pinzhen Chen , Kenneth Heafield

Effective representation of a text is critical for various natural language processing tasks. For the particular task of Chinese sentiment analysis, it is important to understand and choose an effective representation of a text from…

Computation and Language · Computer Science 2018-08-10 Pengfei Liu , Ji Zhang , Cane Wing-Ki Leung , Chao He , Thomas L. Griffiths

In this article I proposed a new model to achieve Chinese word segmentation(CWS),which may have the potentiality to apply in other domains in the future.It is a new thinking in CWS compared to previous works,to consider it as a clustering…

Computation and Language · Computer Science 2020-02-19 Yuze Zhao

A wide variety of neural-network architectures have been proposed for the task of Chinese word segmentation. Surprisingly, we find that a bidirectional LSTM model, when combined with standard deep learning techniques and best practices, can…

Computation and Language · Computer Science 2018-08-27 Ji Ma , Kuzman Ganchev , David Weiss

This research presents a fine-grained human evaluation to compare the Transformer and recurrent approaches to neural machine translation (MT), on the translation direction English-to-Chinese. To this end, we develop an error taxonomy…

Computation and Language · Computer Science 2020-06-16 Yuying Ye , Antonio Toral

A few-shot semantic segmentation model is typically composed of a CNN encoder, a CNN decoder and a simple classifier (separating foreground and background pixels). Most existing methods meta-learn all three model components for fast…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Zhihe Lu , Sen He , Xiatian Zhu , Li Zhang , Yi-Zhe Song , Tao Xiang

Chinese text segmentation is a well-known and difficult problem. On one side, there is not a simple notion of "word" in Chinese language making really hard to implement rule-based systems to segment written texts, thus lexicons and…

Computation and Language · Computer Science 2007-05-23 Daniel Gayo-Avello

This paper reviews the development of Chinese word segmentation (CWS) in the most recent decade, 2007-2017. Special attention was paid to the deep learning technologies that has already permeated into most areas of natural language…

Computation and Language · Computer Science 2019-01-21 Hai Zhao , Deng Cai , Changning Huang , Chunyu Kit

Most previous approaches to Chinese word segmentation can be roughly classified into character-based and word-based methods. The former regards this task as a sequence-labeling problem, while the latter directly segments character sequence…

Computation and Language · Computer Science 2017-12-29 Zhiqing Sun , Gehui Shen , Zhihong Deng

Multi-encoder models are a broad family of context-aware neural machine translation systems that aim to improve translation quality by encoding document-level contextual information alongside the current sentence. The context encoding is…

Computation and Language · Computer Science 2022-10-25 Lorenzo Lupo , Marco Dinarelli , Laurent Besacier