English
Related papers

Related papers: Neural Chinese Word Segmentation with Dictionary K…

200 papers

Given the lack of word delimiters in written Japanese, word segmentation is generally considered a crucial first step in processing Japanese texts. Typical Japanese segmentation algorithms rely either on a lexicon and syntactic analysis or…

Computation and Language · Computer Science 2007-05-23 Rie Kubota Ando , Lillian Lee

The task of semantic parsing is highly useful for dialogue and question answering systems. Many datasets have been proposed to map natural language text into SQL, among which the recent Spider dataset provides cross-domain samples with…

Computation and Language · Computer Science 2019-10-17 Qingkai Min , Yuefeng Shi , Yue Zhang

Compared with English, Chinese suffers from more grammatical ambiguities, like fuzzy word boundaries and polysemous words. In this case, contextual information is not sufficient to support Chinese named entity recognition (NER), especially…

Computation and Language · Computer Science 2022-10-25 Qinghua Mao , Jiatong Li , Kui Meng

Measuring the salience of a word is an essential step in numerous NLP tasks. Heuristic approaches such as tfidf have been used so far to estimate the salience of words. We propose \emph{Neural Word Salience} (NWS) scores, unlike heuristics,…

Computation and Language · Computer Science 2017-09-06 Krasen Samardzhiev , Andrew Gargett , Danushka Bollegala

Effective representation of a text is critical for various natural language processing tasks. For the particular task of Chinese sentiment analysis, it is important to understand and choose an effective representation of a text from…

Computation and Language · Computer Science 2018-08-10 Pengfei Liu , Ji Zhang , Cane Wing-Ki Leung , Chao He , Thomas L. Griffiths

We present a system for bottom-up cumulative learning of myriad concepts corresponding to meaningful character strings, and their part-related and prediction edges. The learning is self-supervised in that the concepts discovered are used as…

Machine Learning · Computer Science 2021-12-20 Omid Madani

We introduce an attention-based Bi-LSTM for Chinese implicit discourse relations and demonstrate that modeling argument pairs as a joint sequence can outperform word order-agnostic approaches. Our model benefits from a partial sampling…

Computation and Language · Computer Science 2018-02-01 Samuel Rönnqvist , Niko Schenk , Christian Chiarcos

Most recent neural semi-supervised learning algorithms rely on adding small perturbation to either the input vectors or their representations. These methods have been successful on computer vision tasks as the images form a continuous…

Machine Learning · Computer Science 2019-11-27 Alexander Hanbo Li , Abhinav Sethy

Characters have commonly been regarded as the minimal processing unit in Natural Language Processing (NLP). But many non-latin languages have hieroglyphic writing systems, involving a big alphabet with thousands or millions of characters.…

Computation and Language · Computer Science 2018-01-08 Han He , Lei Wu , Xiaokun Yang , Hua Yan , Zhimin Gao , Yi Feng , George Townsend

Modern transformer-based neural architectures yield impressive results in nearly every NLP task and Word Sense Disambiguation, the problem of discerning the correct sense of a word in a given context, is no exception. State-of-the-art…

Computation and Language · Computer Science 2021-05-24 Harsh Kohli

Chinese word segmentation is especially fragile in non-standard text, where language learner errors and other character-level divergences disrupt the word boundaries assumed by downstream annotation and evaluation. This paper formulates…

Computation and Language · Computer Science 2026-05-28 Lusha Wang , Yuchen Li , Su Yuan , Jungyeul Park

Named Entity Recognition and Relation Extraction for Chinese literature text is regarded as the highly difficult problem, partially because of the lack of tagging sets. In this paper, we build a discourse-level dataset from hundreds of…

Computation and Language · Computer Science 2019-06-12 Jingjing Xu , Ji Wen , Xu Sun , Qi Su

Text segmentation, the task of dividing a document into contiguous segments based on its semantic structure, is a longstanding challenge in language understanding. Previous work on text segmentation focused on unsupervised methods such as…

Computation and Language · Computer Science 2018-03-28 Omri Koshorek , Adir Cohen , Noam Mor , Michael Rotman , Jonathan Berant

The success of deep learning methods hinges on the availability of large training datasets annotated for the task of interest. In contrast to human intelligence, these methods lack versatility and struggle to learn and adapt quickly to new…

Computation and Language · Computer Science 2020-10-13 Nithin Holla , Pushkar Mishra , Helen Yannakoudakis , Ekaterina Shutova

Keyword spotting (KWS) is an essential function that enables interaction with ubiquitous smart devices. However, in resource-limited devices, KWS models are often static and can thus not adapt to new scenarios, such as added keywords. To…

Recently, Chinese Spell Checking(CSC), a task to detect erroneous characters in a sentence and correct them, has attracted extensive interest because of its wide applications in various NLP tasks. Most of the existing methods have utilized…

Computation and Language · Computer Science 2023-05-08 Haiyun Yang

We study the problem of generating keyphrases that summarize the key points for a given document. While sequence-to-sequence (seq2seq) models have achieved remarkable performance on this task (Meng et al., 2017), model training often relies…

Computation and Language · Computer Science 2019-09-09 Hai Ye , Lu Wang

Word sense disambiguation (WSD) is a well researched problem in computational linguistics. Different research works have approached this problem in different ways. Some state of the art results that have been achieved for this problem are…

Computation and Language · Computer Science 2018-09-05 Mahtab Ahmed , Muhammad Rifayat Samee , Robert E. Mercer

This paper describes our system at NLPTEA-2020 Task: Chinese Grammatical Error Diagnosis (CGED). The goal of CGED is to diagnose four types of grammatical errors: word selection (S), redundant words (R), missing words (M), and disordered…

Computation and Language · Computer Science 2021-07-13 Jinhong Zhang

Complex Word Identification (CWI) is a task centered on detecting hard-to-understand words, or groups of words, in texts from different areas of expertise. The purpose of CWI is to highlight problematic structures that non-native speakers…

Computation and Language · Computer Science 2020-10-05 George-Eduard Zaharia , Dumitru-Clementin Cercel , Mihai Dascalu