English
Related papers

Related papers: Statistical Augmentation of a Chinese Machine-Read…

200 papers

A wide variety of neural-network architectures have been proposed for the task of Chinese word segmentation. Surprisingly, we find that a bidirectional LSTM model, when combined with standard deep learning techniques and best practices, can…

Computation and Language · Computer Science 2018-08-27 Ji Ma , Kuzman Ganchev , David Weiss

Chinese Spelling Correction (CSC) is a critical task in natural language processing, aimed at detecting and correcting spelling errors in Chinese text. This survey provides a comprehensive overview of CSC, tracing its evolution from…

Computation and Language · Computer Science 2025-02-18 Changchun Liu , Kai Zhang , Junzhe Jiang , Zixiao Kong , Qi Liu , Enhong Chen

To acquire noun phrases from running texts is useful for many applications, such as word grouping,terminology indexing, etc. The reported literatures adopt pure probabilistic approach, or pure rule-based noun phrases grammar to tackle this…

cmp-lg · Computer Science 2008-02-03 Kuang-hua Chen , Hsin-Hsi Chen

Lexical analysis is believed to be a crucial step towards natural language understanding and has been widely studied. Recent years, end-to-end lexical analysis models with recurrent neural networks have gained increasing attention. In this…

Computation and Language · Computer Science 2018-07-06 Zhenyu Jiao , Shuqi Sun , Ke Sun

Chinese text segmentation is a well-known and difficult problem. On one side, there is not a simple notion of "word" in Chinese language making really hard to implement rule-based systems to segment written texts, thus lexicons and…

Computation and Language · Computer Science 2007-05-23 Daniel Gayo-Avello

Named entity recognition is a challenging task in Natural Language Processing, especially for informal and noisy social media text. Chinese word boundaries are also entity boundaries, therefore, named entity recognition for Chinese text can…

Computation and Language · Computer Science 2020-02-28 Zhaoheng Gong , Ping Chen , Jiang Zhou

State-of-the-art models for keyphrase generation require large amounts of training data to achieve good performance. However, obtaining keyphrase-labeled documents can be challenging and costly. To address this issue, we present a…

Computation and Language · Computer Science 2024-11-07 Mael Houbre , Florian Boudin , Beatrice Daille , Akiko Aizawa

Cross-domain Chinese Word Segmentation (CWS) remains a challenge despite recent progress in neural-based CWS. The limited amount of annotated data in the target domain has been the key obstacle to a satisfactory performance. In this paper,…

Computation and Language · Computer Science 2019-08-07 Yuxiao Ye , Yue Zhang , Weikang Li , Likun Qiu , Jian Sun

Intent classification has been widely researched on English data with deep learning approaches that are based on neural networks and word embeddings. The challenge for Chinese intent classification stems from the fact that, unlike English…

Computation and Language · Computer Science 2018-05-24 Ruixi Lin , Charles Costello , Charles Jankowski

Extracting cybersecurity entities such as attackers and vulnerabilities from unstructured network texts is an important part of security analysis. However, the sparsity of intelligence data resulted from the higher frequency variations and…

Cryptography and Security · Computer Science 2022-07-04 Peipei Liu , Hong Li , Zuoguang Wang , Jie Liu , Yimo Ren , Hongsong Zhu

Sentence Simplification is a valuable technique that can benefit language learners and children a lot. However, current research focuses more on English sentence simplification. The development of Chinese sentence simplification is…

Computation and Language · Computer Science 2023-06-08 Shiping Yang , Renliang Sun , Xiaojun Wan

Idioms, are a kind of idiomatic expression in Chinese, most of which consist of four Chinese characters. Due to the properties of non-compositionality and metaphorical meaning, Chinese Idioms are hard to be understood by children and…

Computation and Language · Computer Science 2022-04-21 Jipeng Qiang , Yang Li , Chaowei Zhang , Yun Li , Yunhao Yuan , Yi Zhu , Xindong Wu

Existing methods for CWS usually rely on a large number of labeled sentences to train word segmentation models, which are expensive and time-consuming to annotate. Luckily, the unlabeled data is usually easy to collect and many high-quality…

Computation and Language · Computer Science 2019-05-07 Junxin Liu , Fangzhao Wu , Chuhan Wu , Yongfeng Huang , Xing Xie

We propose a novel monolingual sentence paraphrasing method for augmenting the training data for statistical machine translation systems "for free" -- by creating it from data that is already available rather than having to create more…

Computation and Language · Computer Science 2021-10-01 Preslav Nakov

Acronyms are abbreviated units of a phrase constructed by using initial components of the phrase in a text. Automatic extraction of acronyms from a text can help various Natural Language Processing tasks like machine translation,…

Computation and Language · Computer Science 2022-01-11 Prashant Sharma , Hadeel Saadany , Leonardo Zilio , Diptesh Kanojia , Constantin Orăsan

The definition generation task aims to generate a word's definition within a specific context automatically. However, owing to the lack of datasets for different complexities, the definitions produced by models tend to keep the same…

Computation and Language · Computer Science 2022-09-30 Jiaxin Yuan , Cunliang Kong , Chenhui Xie , Liner Yang , Erhong Yang

Data augmentation, the artificial creation of training data for machine learning by transformations, is a widely studied research field across machine learning disciplines. While it is useful for increasing a model's generalization…

Computation and Language · Computer Science 2022-09-09 Markus Bayer , Marc-André Kaufhold , Christian Reuter

Text augmentation techniques are widely used in text classification problems to improve the performance of classifiers, especially in low-resource scenarios. Whilst lots of creative text augmentation methods have been designed, they augment…

Computation and Language · Computer Science 2021-09-02 Biyang Guo , Sonqiao Han , Hailiang Huang

We present an algorithm that acquires words (pairings of phonological forms and semantic representations) from larger utterances of unsegmented phoneme sequences and semantic representations. The algorithm maintains from utterance to…

cmp-lg · Computer Science 2008-02-03 Carl de Marcken

We propose and study a novel supervised approach to learning statistical semantic relatedness models from subjectively annotated training examples. The proposed semantic model consists of parameterized co-occurrence statistics associated…

Computation and Language · Computer Science 2013-11-12 Ran El-Yaniv , David Yanay