English
Related papers

Related papers: Exploring the Usage of Chinese Pinyin in Pretraini…

200 papers

Chinese pinyin input method engine (IME) converts pinyin into character so that Chinese characters can be conveniently inputted into computer through common keyboard. IMEs work relying on its core component, pinyin-to-character conversion…

Computation and Language · Computer Science 2018-09-10 Yafang Huang , Hai Zhao

Pinyin-to-character (P2C) conversion is the core component of pinyin-based Chinese input method engine (IME). However, the conversion is seriously compromised by the ambiguities of Chinese characters corresponding to pinyin as well as the…

Artificial Intelligence · Computer Science 2019-06-07 Zhuosheng Zhang , Yafang Huang , Hai Zhao

Chinese sequence labeling tasks are heavily reliant on accurate word boundary demarcation. Although current pre-trained language models (PLMs) have achieved substantial gains on these tasks, they rarely explicitly incorporate boundary…

Computation and Language · Computer Science 2024-04-09 Longhui Zhang , Dingkun Long , Meishan Zhang , Yanzhao Zhang , Pengjun Xie , Min Zhang

This work proposes a simple training-free prompt-free approach to leverage large language models (LLMs) for the Chinese spelling correction (CSC) task, which is totally different from all previous CSC approaches. The key idea is to use an…

Computation and Language · Computer Science 2024-10-08 Houquan Zhou , Zhenghua Li , Bo Zhang , Chen Li , Shaopeng Lai , Ji Zhang , Fei Huang , Min Zhang

Chinese Spelling Check (CSC) is a task to detect and correct spelling errors in Chinese natural language. Existing methods have made attempts to incorporate the similarity knowledge between Chinese characters. However, they take the…

Computation and Language · Computer Science 2020-05-14 Xingyi Cheng , Weidi Xu , Kunlong Chen , Shaohua Jiang , Feng Wang , Taifeng Wang , Wei Chu , Yuan Qi

We introduce CDBERT, a new learning paradigm that enhances the semantics understanding ability of the Chinese PLMs with dictionary knowledge and structure of Chinese characters. We name the two core modules of CDBERT as Shuowen and Jiezi,…

Computation and Language · Computer Science 2023-05-31 Yuxuan Wang , Jianghui Wang , Dongyan Zhao , Zilong Zheng

Chinese Spelling Correction (CSC) stands as a foundational Natural Language Processing (NLP) task, which primarily focuses on the correction of erroneous characters in Chinese texts. Certain existing methodologies opt to disentangle the…

Computation and Language · Computer Science 2024-09-09 Xiangke Zeng , Zuchao Li , Lefei Zhang , Ping Wang , Hongqiu Wu , Hai Zhao

Visual speech recognition (VSR) aims to transcribe spoken content from silent lip-motion videos and is particularly challenging in Mandarin due to severe viseme ambiguity and pervasive homophones. We propose VALLR-Pin, a two-stage Mandarin…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Chang Sun , Dongliang Xie , Wanpeng Xie , Bo Qin , Hong Yang

Unsupervised single-channel overlapped speech recognition is one of the hardest problems in automatic speech recognition (ASR). Permutation invariant training (PIT) is a state of the art model-based approach, which applies a single neural…

Computation and Language · Computer Science 2017-12-27 Zhehuai Chen , Jasha Droppo , Jinyu Li , Wayne Xiong

Chinese Spelling Correction (CSC) commonly lacks large-scale high-quality corpora, due to the labor-intensive labeling of spelling errors in real-life human writing or typing scenarios. Two data augmentation methods are widely adopted: (1)…

Computation and Language · Computer Science 2024-07-23 Dingyao Yu , Yang An , Wei Ye , Xiongfeng Xiao , Shaoguang Mao , Tao Ge , Shikun Zhang

Spelling error correction is an important yet challenging task because a satisfactory solution of it essentially needs human-level language understanding ability. Without loss of generality we consider Chinese spelling error correction…

Computation and Language · Computer Science 2020-05-18 Shaohua Zhang , Haoran Huang , Jicong Liu , Hang Li

The front-end module in a typical Mandarin text-to-speech system (TTS) is composed of a long pipeline of text processing components, which requires extensive efforts to build and is prone to large accumulative model size and cascade errors.…

Sound · Computer Science 2021-01-01 Yang Zhang , Liqun Deng , Yasheng Wang

Chinese Spelling Correction (CSC) aims to detect and correct spelling errors in Chinese sentences caused by phonetic or visual similarities. While current CSC models integrate pinyin or glyph features and have shown significant…

Computation and Language · Computer Science 2024-09-10 Lei Sheng , Shuai-Shuai Xu

Language models have demonstrated remarkable performance in solving reasoning tasks; however, even the strongest models still occasionally make reasoning mistakes. Recently, there has been active research aimed at improving reasoning…

Computation and Language · Computer Science 2024-08-30 Tian Ye , Zicheng Xu , Yuanzhi Li , Zeyuan Allen-Zhu

Biomedical text mining is becoming increasingly important as the number of biomedical documents and web data rapidly grows. Recently, word representation models such as BERT has gained popularity among researchers. However, it is difficult…

Computation and Language · Computer Science 2023-01-26 Ningyu Zhang , Qianghuai Jia , Kangping Yin , Liang Dong , Feng Gao , Nengwei Hua

In a realistic dialogue system, the input information from users is often subject to various types of input perturbations, which affects the slot-filling task. Although rule-based data augmentation methods have achieved satisfactory…

Computation and Language · Computer Science 2024-03-07 Jinxu Zhao , Guanting Dong , Yueyan Qiu , Tingfeng Hui , Xiaoshuai Song , Daichi Guo , Weiran Xu

Humor, a culturally nuanced aspect of human language, poses challenges for computational understanding and generation, especially in Chinese humor, which remains relatively unexplored in the NLP community. This paper investigates the…

Computation and Language · Computer Science 2024-03-19 Rongwu Xu

Bidirectional Encoder Representations from Transformers or BERT~\cite{devlin-etal-2019-bert} has been one of the base models for various NLP tasks due to its remarkable performance. Variants customized for different languages and tasks are…

Computation and Language · Computer Science 2022-11-22 Ting Han , Kunhao Pan , Xinyu Chen , Dingjie Song , Yuchen Fan , Xinyu Gao , Ruyi Gan , Jiaxing Zhang

Large Language Models (LLMs) have demonstrated substantial potential for error correction in Automatic Speech Recognition (ASR). However, most research focuses on utterances from short-duration speech recordings, which are the predominant…

Computation and Language · Computer Science 2024-12-24 Zhiyuan Tang , Dong Wang , Shen Huang , Shidong Shang

Chinese characters have a complex and hierarchical graphical structure carrying both semantic and phonetic information. We use this structure to enhance the text model and obtain better results in standard NLP operations. First of all, to…

Computation and Language · Computer Science 2014-05-22 Yannis Haralambous