English
Related papers

Related papers: Exploring the Usage of Chinese Pinyin in Pretraini…

200 papers

Chinese word segmentation and part-of-speech tagging are necessary tasks in terms of computational linguistics and application of natural language processing. Many re-searchers still debate the demand for Chinese word segmentation and…

Computation and Language · Computer Science 2021-12-20 Duc-Vu Nguyen , Linh-Bao Vo , Ngoc-Linh Tran , Kiet Van Nguyen , Ngan Luu-Thuy Nguyen

The task of Chinese Spelling Check (CSC) is aiming to detect and correct spelling errors that can be found in the text. While manually annotating a high-quality dataset is expensive and time-consuming, thus the scale of the training dataset…

Computation and Language · Computer Science 2022-09-16 Piji Li

Grapheme-to-phoneme (G2P) conversion is an indispensable part of the Chinese Mandarin text-to-speech (TTS) system, and the core of G2P conversion is to solve the problem of polyphone disambiguation, which is to pick up the correct…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-26 Song Zhang , Ken Zheng , Xiaoxu Zhu , Baoxiang Li

Much of the recent literature on automatic speech recognition (ASR) is taking an end-to-end approach. Unlike English where the writing system is closely related to sound, Chinese characters (Hanzi) represent meaning, not sound. We propose…

Computation and Language · Computer Science 2021-08-04 Jiahong Yuan , Xingyu Cai , Dongji Gao , Renjie Zheng , Liang Huang , Kenneth Church

Grapheme-to-phoneme (G2P) conversion serves as an essential component in Chinese Mandarin text-to-speech (TTS) system, where polyphone disambiguation is the core issue. In this paper, we propose an end-to-end framework to predict the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-03 Dongyang Dai , Zhiyong Wu , Shiyin Kang , Xixin Wu , Jia Jia , Dan Su , Dong Yu , Helen Meng

Code-switching, or alternating between languages within a single conversation, presents challenges for multilingual language models on NLP tasks. This research investigates if pre-training Multilingual BERT (mBERT) on code-switched datasets…

Computation and Language · Computer Science 2025-03-12 Katherine Xie , Nitya Babbar , Vicky Chen , Yoanna Turura

We present a Chinese BERT model dubbed MarkBERT that uses word information in this work. Existing word-based BERT models regard words as basic units, however, due to the vocabulary limit of BERT, they only cover high-frequency words and…

Computation and Language · Computer Science 2022-10-11 Linyang Li , Yong Dai , Duyu Tang , Xipeng Qiu , Zenglin Xu , Shuming Shi

Chinese Automatic Speech Recognition (ASR) error correction presents significant challenges due to the Chinese language's unique features, including a large character set and borderless, morpheme-based structure. Current mainstream models…

Computation and Language · Computer Science 2023-08-08 Jiaxin Fan , Yong Zhang , Hanzhang Li , Jianzong Wang , Zhitao Li , Sheng Ouyang , Ning Cheng , Jing Xiao

Pre-trained Language Model (PLM) has become a representative foundation model in the natural language processing field. Most PLMs are trained with linguistic-agnostic pre-training tasks on the surface form of the text, such as the masked…

Computation and Language · Computer Science 2022-11-11 Yiming Cui , Wanxiang Che , Shijin Wang , Ting Liu

Korean-Chinese is a low resource language pair, but Korean and Chinese have a lot in common in terms of vocabulary. Sino-Korean words, which can be converted into corresponding Chinese characters, account for more than fifty of the entire…

Computation and Language · Computer Science 2019-11-26 Jeonghyeok Park , Hai Zhao

Chinese Spelling Check (CSC) is a meaningful task in the area of Natural Language Processing (NLP) which aims at detecting spelling errors in Chinese texts and then correcting these errors. However, CSC models are based on pretrained…

Computation and Language · Computer Science 2024-01-29 Xi Wang , Ruoqing Zhao , Hongliang Dai , Piji Li

Chinese word usage errors often occur in non-native Chinese learners' writing. It is very helpful for non-native Chinese learners to detect them automatically when learning writing. In this paper, we propose a novel approach, which takes…

Computation and Language · Computer Science 2019-04-04 Jinbin Zhang , Heng Wang

Simplified Chinese to Traditional Chinese character conversion is a common preprocessing step in Chinese NLP. Despite this, current approaches have poor performance because they do not take into account that a simplified Chinese character…

Computation and Language · Computer Science 2020-05-08 Pranav A , Isabelle Augenstein

As the structure of Chinese characters are very different, it is very difficult to input Chinese characters into computer quickly and conveniently. The conventional keyboard does not support the pictorial characters in Chinese language.…

Human-Computer Interaction · Computer Science 2013-10-14 Umakant Mishra

Deep learning has shown promising performance on various machine learning tasks. Nevertheless, the uninterpretability of deep learning models severely restricts the usage domains that require feature explanations, such as text correction.…

Computation and Language · Computer Science 2025-03-05 Fanyu Wang , Hangyu Zhu , Zhenping Xie

We demonstrate a program that learns to pronounce Chinese text in Mandarin, without a pronunciation dictionary. From non-parallel streams of Chinese characters and Chinese pinyin syllables, it establishes a many-to-many mapping between…

Computation and Language · Computer Science 2020-10-13 Christopher Chu , Scot Fang , Kevin Knight

Previous studies on Chinese semantic role labeling (SRL) have concentrated on single semantically annotated corpus. But the training data of single corpus is often limited. Meanwhile, there usually exists other semantically annotated…

Computation and Language · Computer Science 2017-03-16 Qiaolin Xia , Baobao Chang , Zhifang Sui

Chinese word segmentation (CWS) is often regarded as a character-based sequence labeling task in most current works which have achieved great success with the help of powerful neural networks. However, these works neglect an important clue:…

Computation and Language · Computer Science 2019-05-31 Jingkang Wang , Jianing Zhou , Jie Zhou , Gongshen Liu

The majority of Chinese characters are monophonic, while a special group of characters, called polyphonic characters, have multiple pronunciations. As a prerequisite of performing speech-related generative tasks, the correct pronunciation…

Computation and Language · Computer Science 2024-08-16 Yi Shi , Congyi Wang , Yu Chen , Bin Wang

In this paper, we present CSCD-NS, the first Chinese spelling check (CSC) dataset designed for native speakers, containing 40,000 samples from a Chinese social platform. Compared with existing CSC datasets aimed at Chinese learners, CSCD-NS…

Computation and Language · Computer Science 2024-05-24 Yong Hu , Fandong Meng , Jie Zhou