中文
相关论文

相关论文: Multiple Character Embeddings for Chinese Word Seg…

200 篇论文

We present QZhou-Embedding, a general-purpose contextual text embedding model with exceptional text representation capabilities. Built upon the Qwen2.5-7B-Instruct foundation model, we designed a unified multi-task framework comprising…

计算与语言 · 计算机科学 2025-09-01 Peng Yu , En Xu , Bin Chen , Haibiao Chen , Yinfei Xu

Chinese named entity recognition (CNER) is an important task in Chinese natural language processing field. However, CNER is very challenging since Chinese entity names are highly context-dependent. In addition, Chinese texts lack delimiters…

计算与语言 · 计算机科学 2019-05-07 Fangzhao Wu , Junxin Liu , Chuhan Wu , Yongfeng Huang , Xing Xie

In Chinese Named Entity Recognition, character substitution is a complicated linguistic phenomenon. Some Chinese characters are quite similar as they share the same components or have similar pronunciations. People replace characters in a…

计算与语言 · 计算机科学 2024-04-19 Jiatong Li , Kui Meng

Chinese Spelling Correction (CSC) aims to detect and correct erroneous characters in Chinese texts. Although efforts have been made to introduce phonetic information (Hanyu Pinyin) in this task, they typically merge phonetic representations…

计算与语言 · 计算机科学 2023-05-25 Zihong Liang , Xiaojun Quan , Qifan Wang

Whole word masking (WWM), which masks all subwords corresponding to a word at once, makes a better English BERT model. For the Chinese language, however, there is no subword because each token is an atomic character. The meaning of a word…

计算与语言 · 计算机科学 2022-03-03 Yong Dai , Linyang Li , Cong Zhou , Zhangyin Feng , Enbo Zhao , Xipeng Qiu , Piji Li , Duyu Tang

Automatic abstractive text summarization is an important and challenging research topic of natural language processing. Among many widely used languages, the Chinese language has a special property that a Chinese character contains rich…

计算与语言 · 计算机科学 2018-09-11 Chieh-Teng Chang , Chi-Chia Huang , Chih-Yuan Yang , Jane Yung-Jen Hsu

We proposed a~new accurate aspect extraction method that makes use of both word and character-based embeddings. We have conducted experiments of various models of aspect extraction using LSTM and BiLSTM including CRF enhancement on five…

计算与语言 · 计算机科学 2019-09-04 Łukasz Augustyniak , Tomasz Kajdanowicz , Przemysław Kazienko

Recently, word enhancement has become very popular for Chinese Named Entity Recognition (NER), reducing segmentation errors and increasing the semantic and boundary information of Chinese words. However, these methods tend to ignore the…

计算与语言 · 计算机科学 2021-07-13 Shuang Wu , Xiaoning Song , Zhenhua Feng

Previous traditional approaches to unsupervised Chinese word segmentation (CWS) can be roughly classified into discriminative and generative models. The former uses the carefully designed goodness measures for candidate segmentation, while…

计算与语言 · 计算机科学 2018-10-09 Zhiqing Sun , Zhi-Hong Deng

In this paper, we improve Chinese spoken language understanding (SLU) by injecting word information. Previous studies on Chinese SLU do not consider the word information, failing to detect word boundaries that are beneficial for intent…

计算与语言 · 计算机科学 2022-03-29 Dechuan Teng , Libo Qin , Wanxiang Che , Sendong Zhao , Ting Liu

Neural word segmentation has attracted more and more research interests for its ability to alleviate the effort of feature engineering and utilize the external resource by the pre-trained character or word embeddings. In this paper, we…

计算与语言 · 计算机科学 2017-07-04 Xinchi Chen , Zhan Shi , Xipeng Qiu , Xuanjing Huang

The prevalent approaches of Chinese word segmentation task almost rely on the Bi-LSTM neural network. However, the methods based the Bi-LSTM have some inherent drawbacks: hard to parallel computing, little efficient in applying the Dropout…

计算与语言 · 计算机科学 2019-05-22 Wei Jiang , Yan Tang

Chinese word segmentation is necessary to provide word-level information for Chinese named entity recognition (NER) systems. However, segmentation error propagation is a challenge for Chinese NER while processing colloquial data like social…

计算与语言 · 计算机科学 2020-06-16 Shengbin Jia , Ling Ding , Xiaojun Chen , Shijia E , Yang Xiang

The integration of large language models (LLMs) with pre-trained speech models has opened up new avenues in automatic speech recognition (ASR). While LLMs excel in multimodal understanding tasks, effectively leveraging their capabilities…

计算与语言 · 计算机科学 2024-09-25 Yang Yuhang , Peng Yizhou , Eng Siong Chng , Xionghu Zhong

Most Chinese pre-trained models take character as the basic unit and learn representation according to character's external contexts, ignoring the semantics expressed in the word, which is the smallest meaningful utterance in Chinese.…

计算与语言 · 计算机科学 2020-04-30 Yanzeng Li , Bowen Yu , Mengge Xue , Tingwen Liu

Learning a distinct representation for each sense of an ambiguous word could lead to more powerful and fine-grained models of vector-space representations. Yet while `multi-sense' methods have been proposed and tested on artificial…

计算与语言 · 计算机科学 2015-11-25 Jiwei Li , Dan Jurafsky

End-to-end automatic speech recognition (ASR) has achieved promising results. However, most existing end-to-end ASR methods neglect the use of specific language characteristics. For Mandarin Chinese ASR tasks, there exist mutual promotion…

计算与语言 · 计算机科学 2022-03-31 Zhao Yang , Dianwen Ng , Xiao Fu , Liping Han , Wei Xi , Rui Wang , Rui Jiang , Jizhong Zhao

Chinese word segmentation has entered the deep learning era which greatly reduces the hassle of feature engineering. Recently, some researchers attempted to treat it as character-level translation, which further simplified model designing,…

计算与语言 · 计算机科学 2022-10-12 Pinzhen Chen , Kenneth Heafield

Previous works indicate that the glyph of Chinese characters contains rich semantic information and has the potential to enhance the representation of Chinese characters. The typical method to utilize the glyph features is by incorporating…

人工智能 · 计算机科学 2021-07-02 Yunxin Li , Yu Zhao , Baotian Hu , Qingcai Chen , Yang Xiang , Xiaolong Wang , Yuxin Ding , Lin Ma

Scene text recognition (STR) on Latin datasets has been extensively studied in recent years, and state-of-the-art (SOTA) models often reach high accuracy. However, the performance on non-Latin transcripts, such as Chinese, is not…

计算机视觉与模式识别 · 计算机科学 2022-10-07 Liu Yongbin , Liu Qingjie , Chen Jiaxin , Wang Yunhong