English
Related papers

Related papers: Multiple Character Embeddings for Chinese Word Seg…

200 papers

Previous studies on Chinese semantic role labeling (SRL) have concentrated on single semantically annotated corpus. But the training data of single corpus is often limited. Meanwhile, there usually exists other semantically annotated…

Computation and Language · Computer Science 2017-03-16 Qiaolin Xia , Baobao Chang , Zhifang Sui

Word embeddings are widely used in Natural Language Processing, mainly due to their success in capturing semantic information from massive corpora. However, their creation process does not allow the different meanings of a word to be…

Computation and Language · Computer Science 2017-06-22 Massimiliano Mancini , Jose Camacho-Collados , Ignacio Iacobacci , Roberto Navigli

Character-based neural models have recently proven very useful for many NLP tasks. However, there is a gap of sophistication between methods for learning representations of sentences and words. While most character models for learning…

Computation and Language · Computer Science 2018-10-31 Yingwei Xin , Ethan Hart , Vibhuti Mahajan , Jean-David Ruvini

Tokenization is fundamental to pretrained language models (PLMs). Existing tokenization methods for Chinese PLMs typically treat each character as an indivisible token. However, they ignore the unique feature of the Chinese writing system…

Computation and Language · Computer Science 2023-02-16 Chenglei Si , Zhengyan Zhang , Yingfa Chen , Fanchao Qi , Xiaozhi Wang , Zhiyuan Liu , Yasheng Wang , Qun Liu , Maosong Sun

Benefiting from the strong ability of the pre-trained model, the research on Chinese Word Segmentation (CWS) has made great progress in recent years. However, due to massive computation, large and complex models are incapable of empowering…

Artificial Intelligence · Computer Science 2021-11-18 Yulan Hu , Yong Liu

Word embedding is a fundamental natural language processing task which can learn feature of words. However, most word embedding methods assign only one vector to a word, even if polysemous words have multi-senses. To address this…

Computation and Language · Computer Science 2022-06-30 Yangxi Zhou , Junping Du , Zhe Xue , Ang Li , Zeli Guan

Effective representation of a text is critical for various natural language processing tasks. For the particular task of Chinese sentiment analysis, it is important to understand and choose an effective representation of a text from…

Computation and Language · Computer Science 2018-08-10 Pengfei Liu , Ji Zhang , Cane Wing-Ki Leung , Chao He , Thomas L. Griffiths

This study presents a Long Short-Term Memory (LSTM) neural network approach to Japanese word segmentation (JWS). Previous studies on Chinese word segmentation (CWS) succeeded in using recurrent neural networks such as LSTM and gated…

Computation and Language · Computer Science 2018-09-28 Yoshiaki Kitagawa , Mamoru Komachi

Online and offline handwritten Chinese text recognition (HTCR) has been studied for decades. Early methods adopted oversegmentation-based strategies but suffered from low speed, insufficient accuracy, and high cost of character segmentation…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Dezhi Peng , Lianwen Jin , Weihong Ma , Canyu Xie , Hesuo Zhang , Shenggao Zhu , Jing Li

Conventional statistics-based methods for joint Chinese word segmentation and part-of-speech tagging (S&T) have generalization ability to recognize new words that do not appear in the training data. An undesirable side effect is that a…

Computation and Language · Computer Science 2013-05-28 Kaixu Zhang , Maosong Sun

We propose a new approach for learning contextualised cross-lingual word embeddings based on a small parallel corpus (e.g. a few hundred sentence pairs). Our method obtains word embeddings via an LSTM encoder-decoder model that…

Computation and Language · Computer Science 2021-10-22 Takashi Wada , Tomoharu Iwata , Yuji Matsumoto , Timothy Baldwin , Jey Han Lau

We present Charagram embeddings, a simple approach for learning character-based compositional models to embed textual sequences. A word or sentence is represented using a character n-gram count vector, followed by a single nonlinear…

Computation and Language · Computer Science 2016-07-12 John Wieting , Mohit Bansal , Kevin Gimpel , Karen Livescu

With the development of pre-trained models and the incorporation of phonetic and graphic information, neural models have achieved high scores in Chinese Spelling Check (CSC). However, it does not provide a comprehensive reflection of the…

Computation and Language · Computer Science 2023-07-26 Xunjian Yin , Xiaojun Wan

We compare the use of LSTM-based and CNN-based character-level word embeddings in BiLSTM-CRF models to approach chemical and disease named entity recognition (NER) tasks. Empirical results over the BioCreative V CDR corpus show that the use…

Computation and Language · Computer Science 2018-08-28 Zenan Zhai , Dat Quoc Nguyen , Karin Verspoor

Chinese Spell Checking (CSC) is a widely used technology, which plays a vital role in speech to text (STT) and optical character recognition (OCR). Most of the existing CSC approaches relying on BERT architecture achieve excellent…

Computation and Language · Computer Science 2024-11-21 Ming Dong , Yujing Chen , Miao Zhang , Hao Sun , Tingting He

Integrating lexicon into character-level sequence has been proven effective to leverage word boundary and semantic information in Chinese named entity recognition (NER). However, prior approaches usually utilize feature weighting and…

Computation and Language · Computer Science 2023-12-29 Dixiang Zhang , Junyu Lu , Pingjian Zhang

A lot of prior work on event extraction has exploited a variety of features to represent events. Such methods have several drawbacks: 1) the features are often specific for a particular domain and do not generalize well; 2) the features are…

Computation and Language · Computer Science 2016-10-05 Yandi Xia , Yang Liu

We convert the Chinese medical text attributes extraction task into a sequence tagging or machine reading comprehension task. Based on BERT pre-trained models, we have not only tried the widely used LSTM-CRF sequence tagging model, but also…

Computation and Language · Computer Science 2020-08-25 Gang Zhao , Teng Zhang , Chenxiao Wang , Ping Lv , Ji Wu

The Chinese Spelling Correction (CSC) task focuses on detecting and correcting spelling errors in sentences. Current research primarily explores two approaches: traditional multimodal pre-trained models and large language models (LLMs).…

Computation and Language · Computer Science 2025-04-11 Xiaowu Zhang , Hongfei Zhao , Jingyi Hou , Zhijie Liu

Just like its remarkable achievements in many computer vision tasks, the convolutional neural networks (CNN) provide an end-to-end solution in handwritten Chinese character recognition (HCCR) with great success. However, the process of…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Zhiyuan Li , Min Jin , Qi Wu , Huaxiang Lu