English
Related papers

Related papers: FLAT: Chinese NER Using Flat-Lattice Transformer

200 papers

We investigate a lattice LSTM network for Chinese word segmentation (CWS) to utilize words or subwords. It integrates the character sequence features with all subsequences information matched from a lexicon. The matched subsequences serve…

Computation and Language · Computer Science 2018-10-31 Jie Yang , Yue Zhang , Shuailong Liang

Multi-modal named entity recognition (MNER) aims at identifying entity spans and recognizing their categories in social media posts with the aid of images. However, in dominant MNER approaches, the interaction of different modalities is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Junyu Lu , Dixiang Zhang , Pingjian Zhang

Spelling error detection serves as a crucial preprocessing in many natural language processing applications. Due to the characteristics of Chinese Language, Chinese spelling error detection is more challenging than error detection in…

Computation and Language · Computer Science 2019-11-26 Hao Wang , Bing Wang , Jianyong Duan , Jiajun Zhang

Transformer-based pre-trained models have gained much advance in recent years, becoming one of the most important backbones in natural language processing. Recent work shows that the attention mechanism inside Transformer may not be…

Computation and Language · Computer Science 2022-10-27 Yile Wang , Linyi Yang , Zhiyang Teng , Ming Zhou , Yue Zhang

In this work, we propose a new language modeling paradigm that has the ability to perform both prediction and moderation of information flow at multiple granularities: neural lattice language models. These models construct a lattice of…

Computation and Language · Computer Science 2018-03-15 Jacob Buckman , Graham Neubig

Named Entity Recognition (NER) is a fundamental task in Natural Language Processing, concerned with identifying spans of text expressing references to entities. NER research is often focused on flat entities only (flat NER), ignoring the…

Computation and Language · Computer Science 2020-06-16 Juntao Yu , Bernd Bohnet , Massimo Poesio

Named entity recognition (NER) is a foundational technology for information extraction. This paper presents a flexible NER framework compatible with different languages and domains. Inspired by the idea of distant supervision (DS), this…

Computation and Language · Computer Science 2019-08-15 Hongyin Zhu , Wenpeng Hu , Yi Zeng

Chinese word segmentation and dependency parsing are two fundamental tasks for Chinese natural language processing. The dependency parsing is defined on word-level. Therefore word segmentation is the precondition of dependency parsing,…

Computation and Language · Computer Science 2019-12-19 Hang Yan , Xipeng Qiu , Xuanjing Huang

Most Named Entity Recognition (NER) systems use additional features like part-of-speech (POS) tags, shallow parsing, gazetteers, etc. Such kind of information requires external knowledge like unlabeled texts and trained taggers. Adding…

Computation and Language · Computer Science 2020-02-13 Arijit Sehanobish , Chan Hee Song

Chinese Named Entity Recognition (NER) is an important task in information extraction, which has a significant impact on downstream applications. Due to the lack of natural separators in Chinese, previous NER methods mostly relied on…

Computation and Language · Computer Science 2024-12-17 Yaqiong Qiao , Shixuan Peng

Revealing the syntactic structure of sentences in Chinese poses significant challenges for word-level parsers due to the absence of clear word boundaries. To facilitate a transition from word-level to character-level Chinese dependency…

Computation and Language · Computer Science 2024-06-07 Yang Hou , Zhenghua Li

Identifying the named entities mentioned in text would enrich many semantic applications at the downstream level. However, due to the predominant usage of colloquial language in microblogs, the named entity recognition (NER) in Chinese…

Computation and Language · Computer Science 2019-08-29 Canwen Xu , Feiyang Wang , Jialong Han , Chenliang Li

We propose a new Named entity recognition (NER) method to effectively make use of the results of Part-of-speech (POS) tagging, Chinese word segmentation (CWS) and parsing while avoiding NER error caused by POS tagging error. This paper…

Computation and Language · Computer Science 2021-01-28 Xiao Fu , Guijun Zhang

Lattices are compact representations that encode multiple hypotheses, such as speech recognition results or different word segmentations. It is shown that encoding lattices as opposed to 1-best results generated by automatic speech…

Computation and Language · Computer Science 2020-11-03 Chao-Wei Huang , Yun-Nung Chen

It is intuitive that NLP tasks for logographic languages like Chinese should benefit from the use of the glyph information in those languages. However, due to the lack of rich pictographic evidence in glyphs and the weak generalization…

Computation and Language · Computer Science 2020-05-22 Yuxian Meng , Wei Wu , Fei Wang , Xiaoya Li , Ping Nie , Fan Yin , Muyu Li , Qinghong Han , Xiaofei Sun , Jiwei Li

The task of Named Entity Recognition (NER) is an important component of many natural language processing systems, such as relation extraction and knowledge graph construction. In this work, we present a simple and effective approach for…

Computation and Language · Computer Science 2022-03-29 Urchade Zaratiana , Pierre Holat , Nadi Tomeh , Thierry Charnois

Named entity recognition (NER) is highly sensitive to sentential syntactic and semantic properties where entities may be extracted according to how they are used and placed in the running text. To model such properties, one could rely on…

Computation and Language · Computer Science 2020-10-30 Yuyang Nie , Yuanhe Tian , Yan Song , Xiang Ao , Xiang Wan

Chinese named entity recognition (CNER) is an important task in Chinese natural language processing field. However, CNER is very challenging since Chinese entity names are highly context-dependent. In addition, Chinese texts lack delimiters…

Computation and Language · Computer Science 2019-05-07 Fangzhao Wu , Junxin Liu , Chuhan Wu , Yongfeng Huang , Xing Xie

Rapidly developed neural models have achieved competitive performance in Chinese word segmentation (CWS) as their traditional counterparts. However, most of methods encounter the computational inefficiency especially for long sentences…

Computation and Language · Computer Science 2019-01-30 Sufeng Duan , Jiangtong Li , Hai Zhao

Transformer-based language models utilize the attention mechanism for substantial performance improvements in almost all natural language processing (NLP) tasks. Similar attention structures are also extensively studied in several other…

Computation and Language · Computer Science 2023-05-17 Nurullah Sevim , Ege Ozan Özyedek , Furkan Şahinuç , Aykut Koç