English
Related papers

Related papers: A Multi-oriented Chinese Keyword Spotter Guided by…

200 papers

Chinese Spelling Correction (CSC) aims to detect and correct erroneous characters in Chinese texts. Although efforts have been made to introduce phonetic information (Hanyu Pinyin) in this task, they typically merge phonetic representations…

Computation and Language · Computer Science 2023-05-25 Zihong Liang , Xiaojun Quan , Qifan Wang

Chinese NER is a difficult undertaking due to the ambiguity of Chinese characters and the absence of word boundaries. Previous work on Chinese NER focus on lexicon-based methods to introduce boundary information and reduce out-of-vocabulary…

Computation and Language · Computer Science 2022-02-21 Zhichao Geng , Hang Yan , Zhangyue Yin , Chenxin An , Xipeng Qiu

Intent classification has been widely researched on English data with deep learning approaches that are based on neural networks and word embeddings. The challenge for Chinese intent classification stems from the fact that, unlike English…

Computation and Language · Computer Science 2018-05-24 Ruixi Lin , Charles Costello , Charles Jankowski

A realistic Chinese word segmentation tool must adapt to textual variations with minimal training input and yet robust enough to yield reliable segmentation result for all variants. Various lexicon-driven approaches to Chinese segmentation,…

Computation and Language · Computer Science 2019-05-22 Chu-Ren Huang , Ting-Shuo Yo , Petr Simon , Shu-Kai Hsieh

Unlike English letters, Chinese characters have rich and specific meanings. Usually, the meaning of a word can be derived from its constituent characters in some way. Several previous works on syntactic parsing propose to annotate shallow…

Computation and Language · Computer Science 2021-06-02 Chen Gong , Saihao Huang , Houquan Zhou , Zhenghua Li , Min Zhang , Zhefeng Wang , Baoxing Huai , Nicholas Jing Yuan

A lot of prior work on event extraction has exploited a variety of features to represent events. Such methods have several drawbacks: 1) the features are often specific for a particular domain and do not generalize well; 2) the features are…

Computation and Language · Computer Science 2016-10-05 Yandi Xia , Yang Liu

We present an iterative procedure to build a Chinese language model (LM). We segment Chinese text into words based on a word-based Chinese language model. However, the construction of a Chinese LM itself requires word boundaries. To get out…

cmp-lg · Computer Science 2008-02-03 Xiaoqiang Luo , Salim Roukos

Chinese sentence simplification faces challenges due to the lack of large-scale labeled parallel corpora and the prevalence of idioms. To address these challenges, we propose Readability-guided Idiom-aware Sentence Simplification (RISS), a…

Computation and Language · Computer Science 2024-06-06 Jingshen Zhang , Xinglu Chen , Xinying Qiu , Zhimin Wang , Wenhe Feng

Named entity recognition, and other information extraction tasks, frequently use linguistic features such as part of speech tags or chunkings. For languages where word boundaries are not readily identified in text, word segmentation is a…

Computation and Language · Computer Science 2017-03-30 Nanyun Peng , Mark Dredze

In recent years, deep learning has achieved significant success in the Chinese word segmentation (CWS) task. Most of these methods improve the performance of CWS by leveraging external information, e.g., words, sub-words, syntax. However,…

Computation and Language · Computer Science 2022-01-25 Xuemei Tang , Jun Wang , Qi Su

Chinese Spelling Correction (CSC) stands as a foundational Natural Language Processing (NLP) task, which primarily focuses on the correction of erroneous characters in Chinese texts. Certain existing methodologies opt to disentangle the…

Computation and Language · Computer Science 2024-09-09 Xiangke Zeng , Zuchao Li , Lefei Zhang , Ping Wang , Hongqiu Wu , Hai Zhao

We propose a new approach to the Chinese word segmentation problem that considers the sentence as an undirected graph, whose nodes are the characters. One can use various techniques to compute the edge weights that measure the connection…

Computation and Language · Computer Science 2018-04-06 Yuanhao Liu , Sheng Yu

Inspired by early research on exploring naturally annotated data for Chinese Word Segmentation (CWS), and also by recent research on integration of speech and text processing, this work for the first time proposes to explicitly mine word…

Computation and Language · Computer Science 2024-12-13 Xuebin Wang , Lei Zhang , Zhenghua Li , Shilin Zhou , Chen Gong , Yang Hou

This paper proposes an end-to-end framework, namely fully convolutional recurrent network (FCRN) for handwritten Chinese text recognition (HCTR). Unlike traditional methods that rely heavily on segmentation, our FCRN is trained with online…

Computer Vision and Pattern Recognition · Computer Science 2016-04-19 Zecheng Xie , Zenghui Sun , Lianwen Jin , Ziyong Feng , Shuye Zhang

Named entity recognition (NER) in Chinese is essential but difficult because of the lack of natural delimiters. Therefore, Chinese Word Segmentation (CWS) is usually considered as the first step for Chinese NER. However, models based on…

Computation and Language · Computer Science 2020-07-16 Yuying Zhu , Guoxin Wang , Börje F. Karlsson

Chinese spelling check is a task to detect and correct spelling mistakes in Chinese text. Existing research aims to enhance the text representation and use multi-source information to improve the detection and correction capabilities of…

Computation and Language · Computer Science 2023-07-07 Nankai Lin , Hongyan Wu , Sihui Fu , Shengyi Jiang , Aimin Yang

Previous traditional approaches to unsupervised Chinese word segmentation (CWS) can be roughly classified into discriminative and generative models. The former uses the carefully designed goodness measures for candidate segmentation, while…

Computation and Language · Computer Science 2018-10-09 Zhiqing Sun , Zhi-Hong Deng

Recently, large language models (LLMs) are capable of generating highly fluent textual content. While they offer significant convenience to humans, they also introduce various risks, like phishing and academic dishonesty. Numerous research…

Computation and Language · Computer Science 2026-05-20 Chenxi Qing , Junxi Wu , Zheng Liu , Yixiang Qiu , Hongyao Yu , Bin Chen , Hao Wu , Shu-Tao Xia

Chinese word segmentation and part-of-speech tagging are necessary tasks in terms of computational linguistics and application of natural language processing. Many re-searchers still debate the demand for Chinese word segmentation and…

Computation and Language · Computer Science 2021-12-20 Duc-Vu Nguyen , Linh-Bao Vo , Ngoc-Linh Tran , Kiet Van Nguyen , Ngan Luu-Thuy Nguyen

Chinese traditional poetry is an important intangible cultural heritage of China and an artistic carrier of thought, culture, spirit and emotion. However, due to the strict rules of ancient poetry, it is very difficult to write poetry by…

Computation and Language · Computer Science 2021-10-26 Chenlei Bao , Lican Huang