English
Related papers

Related papers: Chinese Character Decomposition for Neural MT with…

200 papers

Representation learning is the foundation of machine reading comprehension and inference. In state-of-the-art models, character-level representations have been broadly adopted to alleviate the problem of effectively representing rare or…

Computation and Language · Computer Science 2019-06-12 Zhuosheng Zhang , Hai Zhao , Kangwei Ling , Jiangtong Li , Zuchao Li , Shexia He , Guohong Fu

Neural machine translation (NMT) is one of the best methods for understanding the differences in semantic rules between two languages. Especially for Indo-European languages, subword-level models have achieved impressive results. However,…

Computation and Language · Computer Science 2019-11-11 Wei Zhang , Feifei Lin , Xiaodong Wang , Zhenshuang Liang , Zhen Huang

Character-level Neural Machine Translation (NMT) models have recently achieved impressive results on many language pairs. They mainly do well for Indo-European language pairs, where the languages share the same writing system. However, for…

Computation and Language · Computer Science 2018-08-28 Nikola I. Nikolov , Yuhuang Hu , Mi Xue Tan , Richard H. R. Hahnloser

Existing research generally treats Chinese character as a minimum unit for representation. However, such Chinese character representation will suffer two bottlenecks: 1) Learning bottleneck, the learning cannot benefit from its rich…

Computation and Language · Computer Science 2022-11-24 Zhijun Wang , Xuebo Liu , Min Zhang

Characters have commonly been regarded as the minimal processing unit in Natural Language Processing (NLP). But many non-latin languages have hieroglyphic writing systems, involving a big alphabet with thousands or millions of characters.…

Computation and Language · Computer Science 2018-01-08 Han He , Lei Wu , Xiaokun Yang , Hua Yan , Zhimin Gao , Yi Feng , George Townsend

Character-based sequence labeling framework is flexible and efficient for Chinese word segmentation (CWS). Recently, many character-based neural models have been applied to CWS. While they obtain good performance, they have two obvious…

Computation and Language · Computer Science 2017-11-15 Chunqi Wang , Bo Xu

We systematically investigate geometric patterns in Chinese character embeddings using PHATE manifold analysis. Through cross-validation across seven embedding models and eight dimensionality reduction methods, we observe clustering…

Computation and Language · Computer Science 2025-10-03 Wen G. Gong

Recently, many studies incorporate external knowledge into character-level feature based models to improve the performance of Chinese relation extraction. However, these methods tend to ignore the internal information of the Chinese…

Computation and Language · Computer Science 2023-03-10 Jing Yang , Bin Ji , Shasha Li , Jun Ma , Long Peng , Jie Yu

Recent neural machine translation (NMT) systems have been greatly improved by encoder-decoder models with attention mechanisms and sub-word units. However, important differences between languages with logographic and alphabetic writing…

Computation and Language · Computer Science 2018-09-11 Longtu Zhang , Mamoru Komachi

Learning a distinct representation for each sense of an ambiguous word could lead to more powerful and fine-grained models of vector-space representations. Yet while `multi-sense' methods have been proposed and tested on artificial…

Computation and Language · Computer Science 2015-11-25 Jiwei Li , Dan Jurafsky

Whole word masking (WWM), which masks all subwords corresponding to a word at once, makes a better English BERT model. For the Chinese language, however, there is no subword because each token is an atomic character. The meaning of a word…

Computation and Language · Computer Science 2022-03-03 Yong Dai , Linyang Li , Cong Zhou , Zhangyin Feng , Enbo Zhao , Xipeng Qiu , Piji Li , Duyu Tang

Scene text recognition (STR) methods have demonstrated their excellent capability in English text images. However, due to the complex inner structures of Chinese and the extensive character categories, it poses challenges for recognizing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Qilong Li , Chongsheng Zhang

Chinese characters carry a wealth of morphological and semantic information; therefore, the semantic enhancement of the morphology of Chinese characters has drawn significant attention. The previous methods were intended to directly extract…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Zongze Chen , Wenxia Yang , Xin Li

The glyphic writing system of Chinese incorporates information-rich visual features in each character, such as radicals that provide hints about meaning or pronunciation. However, there has been no investigation into whether contemporary…

Computation and Language · Computer Science 2025-01-31 Xiaofeng Wu , Karl Stratos , Wei Xu

Multi-criteria Chinese word segmentation (MCCWS) aims to exploit the relations among the multiple heterogeneous segmentation criteria and further improve the performance of each single criterion. Previous work usually regards MCCWS as…

Computation and Language · Computer Science 2020-10-06 Xipeng Qiu , Hengzhi Pei , Hang Yan , Xuanjing Huang

Given the advantage and recent success of English character-level and subword-unit models in several NLP tasks, we consider the equivalent modeling problem for Chinese. Chinese script is logographic and many Chinese logograms are composed…

Computation and Language · Computer Science 2018-09-11 Falcon Z. Dai , Zheng Cai

Scene text recognition (STR) on Latin datasets has been extensively studied in recent years, and state-of-the-art (SOTA) models often reach high accuracy. However, the performance on non-Latin transcripts, such as Chinese, is not…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Liu Yongbin , Liu Qingjie , Chen Jiaxin , Wang Yunhong

The character vocabulary can be very large in non-alphabetic languages such as Chinese and Japanese, which makes neural network models huge to process such languages. We explored a model for sentiment classification that takes the…

Computation and Language · Computer Science 2017-08-11 Yuanzhi Ke , Masafumi Hagiwara

Multi-Criteria Chinese Word Segmentation (MCCWS) aims at finding word boundaries in a Chinese sentence composed of continuous characters while multiple segmentation criteria exist. The unified framework has been widely used in MCCWS and…

Computation and Language · Computer Science 2020-04-14 Zhen Ke , Liang Shi , Erli Meng , Bin Wang , Xipeng Qiu , Xuanjing Huang

Representation learning is the foundation of machine reading comprehension. In state-of-the-art models, deep learning methods broadly use word and character level representations. However, character is not naturally the minimal linguistic…

Computation and Language · Computer Science 2018-06-26 Zhuosheng Zhang , Yafang Huang , Hai Zhao