English
Related papers

Related papers: End-to-End Chinese Parsing Exploiting Lexicons

200 papers

In cross-lingual dependency annotation projection, information is often lost during transfer because of early decoding. We present an end-to-end graph-based neural network dependency parser that can be trained to reproduce matrices of edge…

Computation and Language · Computer Science 2017-01-09 Michael Sejr Schlichtkrull , Anders Søgaard

Lexicon information and pre-trained models, such as BERT, have been combined to explore Chinese sequence labelling tasks due to their respective strengths. However, existing methods solely fuse lexicon features via a shallow and random…

Computation and Language · Computer Science 2021-12-28 Wei Liu , Xiyan Fu , Yue Zhang , Wenming Xiao

Language model is one of the most important modules in statistical machine translation and currently the word-based language model dominants this community. However, many translation models (e.g. phrase-based models) generate the target…

Computation and Language · Computer Science 2015-02-06 Jiajun Zhang , Shujie Liu , Mu Li , Ming Zhou , Chengqing Zong

Despite the increasing research interest in end-to-end learning systems for speech emotion recognition, conventional systems either suffer from the overfitting due in part to the limited training data, or do not explicitly consider the…

Computation and Language · Computer Science 2019-04-01 Zixing Zhang , Bingwen Wu , Bjoern Schuller

A wide variety of neural-network architectures have been proposed for the task of Chinese word segmentation. Surprisingly, we find that a bidirectional LSTM model, when combined with standard deep learning techniques and best practices, can…

Computation and Language · Computer Science 2018-08-27 Ji Ma , Kuzman Ganchev , David Weiss

Chinese pre-trained language models usually process text as a sequence of characters, while ignoring more coarse granularity, e.g., words. In this work, we propose a novel pre-training paradigm for Chinese -- Lattice-BERT, which explicitly…

Computation and Language · Computer Science 2021-05-31 Yuxuan Lai , Yijia Liu , Yansong Feng , Songfang Huang , Dongyan Zhao

This paper proposes to cast end-to-end span-based SRL as a word-based graph parsing task. The major challenge is how to represent spans at the word level. Borrowing ideas from research on Chinese word segmentation and named entity…

Computation and Language · Computer Science 2022-09-19 Shilin Zhou , Qingrong Xia , Zhenghua Li , Yu Zhang , Yu Hong , Min Zhang

Named entity recognition is a challenging task in Natural Language Processing, especially for informal and noisy social media text. Chinese word boundaries are also entity boundaries, therefore, named entity recognition for Chinese text can…

Computation and Language · Computer Science 2020-02-28 Zhaoheng Gong , Ping Chen , Jiang Zhou

A sequence-to-sequence learning with neural networks has empirically proven to be an effective framework for Chinese Spelling Correction (CSC), which takes a sentence with some spelling errors as input and outputs the corrected one.…

Computation and Language · Computer Science 2021-06-02 Chong Li , Cenyuan Zhang , Xiaoqing Zheng , Xuanjing Huang

Recent studies have consistently given positive hints that morphology is helpful in enriching word embeddings. In this paper, we argue that Chinese word embeddings can be substantially enriched by the morphological information hidden in…

Computation and Language · Computer Science 2019-06-12 Hanqing Tao , Shiwei Tong , Tong Xu , Qi Liu , Enhong Chen

Major progress on language models (LMs) in recent years has largely resulted from moving away from specialized models designed for specific tasks, to general models based on powerful architectures (e.g. the Transformer) that learn…

Machine Learning · Computer Science 2025-07-16 Sukjun Hwang , Brandon Wang , Albert Gu

At present, most Natural Language Processing technology is based on the results of Word Segmentation for Dependency Parsing, which mainly uses an end-to-end method based on supervised learning. There are two main problems with this method:…

Computation and Language · Computer Science 2020-07-08 Guang Liu , Gang Tu , Zheng Li , Yi-Jian Liu

We present a method to leverage radical for learning Chinese character embedding. Radical is a semantic and phonetic component of Chinese character. It plays an important role as characters with the same radical usually have similar…

Computation and Language · Computer Science 2014-04-21 Yaming Sun , Lei Lin , Duyu Tang , Nan Yang , Zhenzhou Ji , Xiaolong Wang

The ambiguous annotation criteria lead to divergence of Chinese Word Segmentation (CWS) datasets in various granularities. Multi-criteria Chinese word segmentation aims to capture various annotation criteria among datasets and leverage…

Computation and Language · Computer Science 2020-10-12 Weipeng Huang , Xingyi Cheng , Kunlong Chen , Taifeng Wang , Wei Chu

Chinese word segmentation (CWS) is often regarded as a character-based sequence labeling task in most current works which have achieved great success with the help of powerful neural networks. However, these works neglect an important clue:…

Computation and Language · Computer Science 2019-05-31 Jingkang Wang , Jianing Zhou , Jie Zhou , Gongshen Liu

Recently, it is quite common to integrate Chinese sequence labeling results to enhance syntactic and semantic parsing. However, little attention has been paid to the utility of hierarchy and structure information encoded in syntactic and…

Computation and Language · Computer Science 2023-06-06 Xuemei Tang , Jun Wang , Qi Su

We introduce a novel discriminative word alignment model, which we integrate into a Transformer-based machine translation model. In experiments based on a small number of labeled examples (~1.7K-5K sentences) we evaluate its performance…

Computation and Language · Computer Science 2019-09-04 Elias Stengel-Eskin , Tzu-Ray Su , Matt Post , Benjamin Van Durme

Named entity recognition (NER) in Chinese is essential but difficult because of the lack of natural delimiters. Therefore, Chinese Word Segmentation (CWS) is usually considered as the first step for Chinese NER. However, models based on…

Computation and Language · Computer Science 2020-07-16 Yuying Zhu , Guoxin Wang , Börje F. Karlsson

Recent deep learning based approaches have achieved great success on handwriting recognition. Chinese characters are among the most widely adopted writing systems in the world. Previous research has mainly focused on recognizing handwritten…

Computer Vision and Pattern Recognition · Computer Science 2016-06-22 Xu-Yao Zhang , Fei Yin , Yan-Ming Zhang , Cheng-Lin Liu , Yoshua Bengio

We investigate a lattice-structured LSTM model for Chinese NER, which encodes a sequence of input characters as well as all potential words that match a lexicon. Compared with character-based methods, our model explicitly leverages word and…

Computation and Language · Computer Science 2018-07-06 Yue Zhang , Jie Yang
‹ Prev 1 3 4 5 6 7 10 Next ›