English
Related papers

Related papers: Improving Named Entity Recognition for Chinese Soc…

200 papers

We propose a new Named entity recognition (NER) method to effectively make use of the results of Part-of-speech (POS) tagging, Chinese word segmentation (CWS) and parsing while avoiding NER error caused by POS tagging error. This paper…

Computation and Language · Computer Science 2021-01-28 Xiao Fu , Guijun Zhang

Named Entity Recognition (NER) is an important subtask of information extraction that seeks to locate and recognise named entities. Despite recent achievements, we still face limitations with correctly detecting and classifying entities,…

Information Retrieval · Computer Science 2017-10-31 Diego Esteves , Rafael Peres , Jens Lehmann , Giulio Napolitano

Most Named Entity Recognition (NER) systems use additional features like part-of-speech (POS) tags, shallow parsing, gazetteers, etc. Such kind of information requires external knowledge like unlabeled texts and trained taggers. Adding…

Computation and Language · Computer Science 2020-02-13 Arijit Sehanobish , Chan Hee Song

Multimodal Named Entity Recognition (MNER) is a pivotal task designed to extract named entities from text with the support of pertinent images. Nonetheless, a notable paucity of data for Chinese MNER has considerably impeded the progress of…

Computation and Language · Computer Science 2024-03-04 Yuanze Ji , Bobo Li , Jun Zhou , Fei Li , Chong Teng , Donghong Ji

Word segmentation and part-of-speech tagging are two critical preliminary steps for downstream tasks in Vietnamese natural language processing. In reality, people tend to consider also the phrase boundary when performing word segmentation…

Computation and Language · Computer Science 2021-06-17 Duc-Vu Nguyen , Kiet Van Nguyen , Ngan Luu-Thuy Nguyen

Segmenting a chunk of text into words is usually the first step of processing Chinese text, but its necessity has rarely been explored. In this paper, we ask the fundamental question of whether Chinese word segmentation (CWS) is necessary…

Computation and Language · Computer Science 2019-10-08 Xiaoya Li , Yuxian Meng , Xiaofei Sun , Qinghong Han , Arianna Yuan , Jiwei Li

Prior methods to text segmentation are mostly at token level. Despite the adequacy, this nature limits their full potential to capture the long-term dependencies among segments. In this work, we propose a novel framework that incrementally…

Computation and Language · Computer Science 2021-04-16 Yangming Li , Lemao Liu , Kaisheng Yao

Neural word segmentation has attracted more and more research interests for its ability to alleviate the effort of feature engineering and utilize the external resource by the pre-trained character or word embeddings. In this paper, we…

Computation and Language · Computer Science 2017-07-04 Xinchi Chen , Zhan Shi , Xipeng Qiu , Xuanjing Huang

We propose a segmental neural language model that combines the generalization power of neural networks with the ability to discover word-like units that are latent in unsegmented character sequences. In contrast to previous segmentation…

Computation and Language · Computer Science 2019-06-19 Kazuya Kawakami , Chris Dyer , Phil Blunsom

This paper compares large language models (LLMs) and traditional natural language processing (NLP) tools for performing word segmentation, part-of-speech (POS) tagging, and named entity recognition (NER) on Chinese texts from 1900 to 1950.…

Computation and Language · Computer Science 2025-03-26 Zhao Fang , Liang-Chun Wu , Xuening Kong , Spencer Dean Stewart

Chinese word segmentation has entered the deep learning era which greatly reduces the hassle of feature engineering. Recently, some researchers attempted to treat it as character-level translation, which further simplified model designing,…

Computation and Language · Computer Science 2022-10-12 Pinzhen Chen , Kenneth Heafield

Chinese word segmentation (CWS) is an important task for Chinese NLP. Recently, many neural network based methods have been proposed for CWS. However, these methods require a large number of labeled sentences for model training, and usually…

Computation and Language · Computer Science 2018-07-17 Junxin Liu , Fangzhao Wu , Chuhan Wu , Yongfeng Huang , Xing Xie

Named entity recognition (NER) is the task to identify mentions of rigid designators from text belonging to predefined semantic types such as person, location, organization etc. NER always serves as the foundation for many natural language…

Computation and Language · Computer Science 2023-04-26 Jing Li , Aixin Sun , Jianglei Han , Chenliang Li

Named Entity Recognition (NER) is one of the most common tasks of the natural language processing. The purpose of NER is to find and classify tokens in text documents into predefined categories called tags, such as person names, quantity…

Computation and Language · Computer Science 2017-10-10 L. T. Anh , M. Y. Arkhipov , M. S. Burtsev

Rapidly developed neural models have achieved competitive performance in Chinese word segmentation (CWS) as their traditional counterparts. However, most of methods encounter the computational inefficiency especially for long sentences…

Computation and Language · Computer Science 2019-01-30 Sufeng Duan , Jiangtong Li , Hai Zhao

Named entity recognition (NER) is highly sensitive to sentential syntactic and semantic properties where entities may be extracted according to how they are used and placed in the running text. To model such properties, one could rely on…

Computation and Language · Computer Science 2020-10-30 Yuyang Nie , Yuanhe Tian , Yan Song , Xiang Ao , Xiang Wan

Named Entity Recognition (NER) is an important subtask of information extraction that seeks to locate and recognise named entities. Despite recent achievements, we still face limitations in correctly detecting and classifying entities,…

Information Retrieval · Computer Science 2018-09-07 Diego Esteves

Named Entity Recognition (NER) on social media refers to discovering and classifying entities from unstructured free-form content, and it plays an important role for various applications such as intention understanding and user…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Peipei Liu , Gaosheng Wang , Hong Li , Jie Liu , Yimo Ren , Hongsong Zhu , Limin Sun

Recognizing named entities in a document is a key task in many NLP applications. Although current state-of-the-art approaches to this task reach a high performance on clean text (e.g. newswire genres), those algorithms dramatically degrade…

Computation and Language · Computer Science 2019-06-11 Gustavo Aguilar , A. Pastor López-Monroy , Fabio A. González , Thamar Solorio

Neural models with minimal feature engineering have achieved competitive performance against traditional methods for the task of Chinese word segmentation. However, both training and working procedures of the current neural models are…

Computation and Language · Computer Science 2017-04-25 Deng Cai , Hai Zhao , Zhisong Zhang , Yuan Xin , Yongjian Wu , Feiyue Huang