English
Related papers

Related papers: Sentence-level dialects identification in the grea…

200 papers

In recent years, deep learning has achieved significant success in the Chinese word segmentation (CWS) task. Most of these methods improve the performance of CWS by leveraging external information, e.g., words, sub-words, syntax. However,…

Computation and Language · Computer Science 2022-01-25 Xuemei Tang , Jun Wang , Qi Su

This paper compares large language models (LLMs) and traditional natural language processing (NLP) tools for performing word segmentation, part-of-speech (POS) tagging, and named entity recognition (NER) on Chinese texts from 1900 to 1950.…

Computation and Language · Computer Science 2025-03-26 Zhao Fang , Liang-Chun Wu , Xuening Kong , Spencer Dean Stewart

Distributed word representations are very useful for capturing semantic information and have been successfully applied in a variety of NLP tasks, especially on English. In this work, we innovatively develop two component-enhanced Chinese…

Computation and Language · Computer Science 2015-08-28 Yanran Li , Wenjie Li , Fei Sun , Sujian Li

Recent deep learning based approaches have achieved great success on handwriting recognition. Chinese characters are among the most widely adopted writing systems in the world. Previous research has mainly focused on recognizing handwritten…

Computer Vision and Pattern Recognition · Computer Science 2016-06-22 Xu-Yao Zhang , Fei Yin , Yan-Ming Zhang , Cheng-Lin Liu , Yoshua Bengio

Neural network has become the dominant method for Chinese word segmentation. Most existing models cast the task as sequence labeling, using BiLSTM-CRF for representing the input and making output predictions. Recently, attention-based…

Computation and Language · Computer Science 2019-07-29 Leilei Gan , Yue Zhang

Intent classification has been widely researched on English data with deep learning approaches that are based on neural networks and word embeddings. The challenge for Chinese intent classification stems from the fact that, unlike English…

Computation and Language · Computer Science 2018-05-24 Ruixi Lin , Charles Costello , Charles Jankowski

We present a machine learning approach to distinguish texts translated to Chinese (by humans) from texts originally written in Chinese, with a focus on a wide range of syntactic features. Using Support Vector Machines (SVMs) as classifier…

Computation and Language · Computer Science 2018-04-25 Hai Hu , Wen Li , Sandra Kübler

Online and offline handwritten Chinese text recognition (HTCR) has been studied for decades. Early methods adopted oversegmentation-based strategies but suffered from low speed, insufficient accuracy, and high cost of character segmentation…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Dezhi Peng , Lianwen Jin , Weihong Ma , Canyu Xie , Hesuo Zhang , Shenggao Zhu , Jing Li

A wide variety of neural-network architectures have been proposed for the task of Chinese word segmentation. Surprisingly, we find that a bidirectional LSTM model, when combined with standard deep learning techniques and best practices, can…

Computation and Language · Computer Science 2018-08-27 Ji Ma , Kuzman Ganchev , David Weiss

A novel, generic scheme for off-line handwritten English alphabets character images is proposed. The advantage of the technique is that it can be applied in a generic manner to different applications and is expected to perform better in…

Computer Vision and Pattern Recognition · Computer Science 2010-07-01 Sandhya Arora , Latesh Malik , Debotosh Bhattacharjee , Mita Nasipuri

Sign language recognition (SLR) is a challenging problem, involving complex manual features, i.e., hand gestures, and fine-grained non-manual features (NMFs), i.e., facial expression, mouth shapes, etc. Although manual features are…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Hezhen Hu , Wengang Zhou , Junfu Pu , Houqiang Li

Chinese Automatic Speech Recognition (ASR) error correction presents significant challenges due to the Chinese language's unique features, including a large character set and borderless, morpheme-based structure. Current mainstream models…

Computation and Language · Computer Science 2023-08-08 Jiaxin Fan , Yong Zhang , Hanzhang Li , Jianzong Wang , Zhitao Li , Sheng Ouyang , Ning Cheng , Jing Xiao

Character-based sequence labeling framework is flexible and efficient for Chinese word segmentation (CWS). Recently, many character-based neural models have been applied to CWS. While they obtain good performance, they have two obvious…

Computation and Language · Computer Science 2017-11-15 Chunqi Wang , Bo Xu

Segmentation remains an important preprocessing step both in languages where "words" or other important syntactic/semantic units (like morphemes) are not clearly delineated by white space, as well as when dealing with continuous speech…

Computation and Language · Computer Science 2021-09-07 C. M. Downey , Fei Xia , Gina-Anne Levow , Shane Steinert-Threlkeld

This paper proposes a unimodal aggregation (UMA) based nonautoregressive model for both English and Mandarin speech recognition. The original UMA explicitly segments and aggregates acoustic frames (with unimodal weights that first…

Computation and Language · Computer Science 2025-09-19 Ying Fang , Xiaofei Li

Word segmentation and part-of-speech tagging are two critical preliminary steps for downstream tasks in Vietnamese natural language processing. In reality, people tend to consider also the phrase boundary when performing word segmentation…

Computation and Language · Computer Science 2021-06-17 Duc-Vu Nguyen , Kiet Van Nguyen , Ngan Luu-Thuy Nguyen

Chinese word segmentation has entered the deep learning era which greatly reduces the hassle of feature engineering. Recently, some researchers attempted to treat it as character-level translation, which further simplified model designing,…

Computation and Language · Computer Science 2022-10-12 Pinzhen Chen , Kenneth Heafield

We introduce a general detection-based approach to text line recognition, be it printed (OCR) or handwritten (HTR), with Latin, Chinese, or ciphered characters. Detection-based approaches have until now been largely discarded for HTR…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Raphael Baena , Syrine Kalleli , Mathieu Aubry

The flourishing blossom of deep learning has witnessed the rapid development of text recognition in recent years. However, the existing text recognition methods are mainly proposed for English texts. As another widely-spoken language,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Haiyang Yu , Jingye Chen , Bin Li , Jianqi Ma , Mengnan Guan , Xixi Xu , Xiaocong Wang , Shaobo Qu , Xiangyang Xue

Online handwritten Chinese text recognition (OHCTR) is a challenging problem as it involves a large-scale character set, ambiguous segmentation, and variable-length input sequences. In this paper, we exploit the outstanding capability of…

Computer Vision and Pattern Recognition · Computer Science 2017-05-26 Zecheng Xie , Zenghui Sun , Lianwen Jin , Hao Ni , Terry Lyons