English
Related papers

Related papers: A Graph-based Model for Joint Chinese Word Segment…

200 papers

Existing Chinese text error detection mainly focuses on spelling and simple grammatical errors. These errors have been studied extensively and are relatively simple for humans. On the contrary, Chinese semantic errors are understudied and…

Computation and Language · Computer Science 2022-04-18 Bo Sun , Baoxin Wang , Wanxiang Che , Dayong Wu , Zhigang Chen , Ting Liu

We propose a new approach to the Chinese word segmentation problem that considers the sentence as an undirected graph, whose nodes are the characters. One can use various techniques to compute the edge weights that measure the connection…

Computation and Language · Computer Science 2018-04-06 Yuanhao Liu , Sheng Yu

In recent years, pre-trained models have been extensively studied, and several downstream tasks have benefited from their utilization. In this study, we verify the effectiveness of two methods that incorporate a BERT-based pre-trained model…

Computation and Language · Computer Science 2020-11-05 Hongfei Wang , Michiki Kurosawa , Satoru Katsumata , Mamoru Komachi

Story generation aims to generate a long narrative conditioned on a given input. In spite of the success of prior works with the application of pre-trained models, current neural models for Chinese stories still struggle to generate…

Computation and Language · Computer Science 2022-10-20 Henglin Huang , Chen Tang , Tyler Loakman , Frank Guerin , Chenghua Lin

In this paper, we present an approach to improve the accuracy of a strong transition-based dependency parser by exploiting dependency language models that are extracted from a large parsed corpus. We integrated a small number of features…

Computation and Language · Computer Science 2017-09-01 Juntao Yu , Bernd Bohnet

We propose a method for non-projective dependency parsing by incrementally predicting a set of edges. Since the edges do not have a pre-specified order, we propose a set-based learning method. Our method blends graph, transition, and…

Machine Learning · Computer Science 2019-10-25 Sean Welleck , Kyunghyun Cho

Chinese word segmentation is a fundamental task for Chinese language processing. The granularity mismatch problem is the main cause of the errors. This paper showed that the binary tree representation can store outputs with different…

Computation and Language · Computer Science 2013-05-20 Kaixu Zhang , Can Wang , Maosong Sun

Due to the absence of labeled data, discourse parsing still remains challenging in some languages. In this paper, we present a simple and efficient method to conduct zero-shot Chinese text-level dependency parsing by leveraging English…

Computation and Language · Computer Science 2019-11-28 Yi Cheng , Sujian Li

Conventional statistics-based methods for joint Chinese word segmentation and part-of-speech tagging (S&T) have generalization ability to recognize new words that do not appear in the training data. An undesirable side effect is that a…

Computation and Language · Computer Science 2013-05-28 Kaixu Zhang , Maosong Sun

Recently, Chinese word segmentation (CWS) methods using neural networks have made impressive progress. Most of them regard the CWS as a sequence labeling problem which construct models based on local features rather than considering global…

Computation and Language · Computer Science 2019-12-02 Xuewen Shi , Heyan Huang , Ping Jian , Yuhang Guo , Xiaochi Wei , Yi-Kun Tang

We present fastHan, an open-source toolkit for four basic tasks in Chinese natural language processing: Chinese word segmentation (CWS), Part-of-Speech (POS) tagging, named entity recognition (NER), and dependency parsing. The backbone of…

Computation and Language · Computer Science 2021-06-01 Zhichao Geng , Hang Yan , Xipeng Qiu , Xuanjing Huang

Most previous approaches to Chinese word segmentation formalize this problem as a character-based sequence labeling task where only contextual information within fixed sized local windows and simple interactions between adjacent tags can be…

Computation and Language · Computer Science 2016-12-05 Deng Cai , Hai Zhao

Dependency Grammar has been used by linguists as the basis of the syntactic components of their grammar formalisms. It has also been used in natural language parsing. In China, attempts have been made to use this grammar formalism to parse…

cmp-lg · Computer Science 2008-02-03 Bong Yeung Tom Lai , Changning Huang

Chinese word segmentation has entered the deep learning era which greatly reduces the hassle of feature engineering. Recently, some researchers attempted to treat it as character-level translation, which further simplified model designing,…

Computation and Language · Computer Science 2022-10-12 Pinzhen Chen , Kenneth Heafield

We present graph-based translation models which translate source graphs into target strings. Source graphs are constructed from dependency trees with extra links so that non-syntactic phrases are connected. Inspired by phrase-based models,…

Computation and Language · Computer Science 2021-03-23 Liangyou Li , Andy Way , Qun Liu

Character-based sequence labeling framework is flexible and efficient for Chinese word segmentation (CWS). Recently, many character-based neural models have been applied to CWS. While they obtain good performance, they have two obvious…

Computation and Language · Computer Science 2017-11-15 Chunqi Wang , Bo Xu

Chinese BERT models achieve remarkable progress in dealing with grammatical errors of word substitution. However, they fail to handle word insertion and deletion because BERT assumes the existence of a word at each position. To address…

Computation and Language · Computer Science 2022-04-27 Cong Zhou , Yong Dai , Duyu Tang , Enbo Zhao , Zhangyin Feng , Li Kuang , Shuming Shi

Unlike English letters, Chinese characters have rich and specific meanings. Usually, the meaning of a word can be derived from its constituent characters in some way. Several previous works on syntactic parsing propose to annotate shallow…

Computation and Language · Computer Science 2021-06-02 Chen Gong , Saihao Huang , Houquan Zhou , Zhenghua Li , Min Zhang , Zhefeng Wang , Baoxing Huai , Nicholas Jing Yuan

We present a Chinese BERT model dubbed MarkBERT that uses word information in this work. Existing word-based BERT models regard words as basic units, however, due to the vocabulary limit of BERT, they only cover high-frequency words and…

Computation and Language · Computer Science 2022-10-11 Linyang Li , Yong Dai , Duyu Tang , Xipeng Qiu , Zenglin Xu , Shuming Shi

Exploiting rich linguistic information in raw text is crucial for expressive text-to-speech (TTS). As large scale pre-trained text representation develops, bidirectional encoder representations from Transformers (BERT) has been proven to…

Computation and Language · Computer Science 2022-11-14 Yixuan Zhou , Changhe Song , Jingbei Li , Zhiyong Wu , Yanyao Bian , Dan Su , Helen Meng