English
Related papers

Related papers: Cross-lingual Word Segmentation and Morpheme Segme…

200 papers

Recurrent neural network(RNN) has been broadly applied to natural language processing(NLP) problems. This kind of neural network is designed for modeling sequential data and has been testified to be quite efficient in sequential tagging…

Machine Learning · Computer Science 2016-02-22 Yushi Yao , Zheng Huang

Even for common NLP tasks, sufficient supervision is not available in many languages -- morphological tagging is no exception. In the work presented here, we explore a transfer learning scheme, whereby we train character-level recurrent…

Computation and Language · Computer Science 2025-04-25 Ryan Cotterell , Georg Heigold

We present labeled morphological segmentation, an alternative view of morphological processing that unifies several tasks. From an annotation standpoint, we additionally introduce a new hierarchy of morphotactic tagsets. Finally, we develop…

Computation and Language · Computer Science 2024-04-16 Ryan Cotterell , Thomas Müller , Alexander Fraser , Hinrich Schütze

Topic segmentation and labeling is often considered a prerequisite for higher-level conversation analysis and has been shown to be useful in many Natural Language Processing (NLP) applications. We present two new corpora of email and blog…

Computation and Language · Computer Science 2014-02-05 Shafiq Rayhan Joty , Giuseppe Carenini , Raymond T Ng

Morphological segmentation for polysynthetic languages is challenging, because a word may consist of many individual morphemes and training data can be extremely scarce. Since neural sequence-to-sequence (seq2seq) models define the state of…

Computation and Language · Computer Science 2018-04-18 Katharina Kann , Manuel Mager , Ivan Meza-Ruiz , Hinrich Schütze

This work presents a fine-grained, text-chunking algorithm designed for the task of multiword expressions (MWEs) segmentation. As a lexical class, MWEs include a wide variety of idioms, whose automatic identification are a necessity for the…

Computation and Language · Computer Science 2017-06-12 Jake Ryland Williams

Semantic segmentation plays a crucial role in enabling machines to understand and interpret visual scenes at a pixel level. While traditional segmentation methods have achieved remarkable success, their generalization to diverse scenes and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Philip Hughes , Larry Burns , Luke Adams

Sequence labelling is the task of assigning categorical labels to a data sequence. In Natural Language Processing, sequence labelling can be applied to various fundamental problems, such as Part of Speech (POS) tagging, Named Entity…

Computation and Language · Computer Science 2018-07-31 Mahtab Ahmed , Muhammad Rifayat Samee , Robert E. Mercer

This paper describes our submission to CoNLL 2018 UD Shared Task. We have extended an LSTM-based neural network designed for sequence tagging to additionally generate character-level sequences. The network was jointly trained to produce…

Computation and Language · Computer Science 2018-09-11 Gor Arakelyan , Karen Hambardzumyan , Hrant Khachatrian

We present two methods for unsupervised segmentation of words into morpheme-like units. The model utilized is especially suited for languages with a rich morphology, such as Finnish. The first method is based on the Minimum Description…

Computation and Language · Computer Science 2007-05-23 Mathias Creutz , Krista Lagus

We present three innovations in tokenization and subword segmentation. First, we propose to use unsupervised morphological analysis with Morfessor as pre-tokenization. Second, we present an algebraic method for obtaining subword embeddings…

Computation and Language · Computer Science 2024-10-04 Jindřich Libovický , Jindřich Helcl

This paper describes our system designed for the NLPCC 2016 shared task on word segmentation on micro-blog texts.

Computation and Language · Computer Science 2016-09-30 Qingrong Xia , Zhenghua Li , Jiayuan Chao , Min Zhang

The prevalent approaches of Chinese word segmentation task almost rely on the Bi-LSTM neural network. However, the methods based the Bi-LSTM have some inherent drawbacks: hard to parallel computing, little efficient in applying the Dropout…

Computation and Language · Computer Science 2019-05-22 Wei Jiang , Yan Tang

We present a system for bottom-up cumulative learning of myriad concepts corresponding to meaningful character strings, and their part-related and prediction edges. The learning is self-supervised in that the concepts discovered are used as…

Machine Learning · Computer Science 2021-12-20 Omid Madani

We participated in the MLWS 2017 on Tibetan word segmentation task, our system is trained in a unrestricted way, by introducing a baseline system and 76w tibetan segmented sentences of ours. In the system character sequence is processed by…

Computation and Language · Computer Science 2017-10-18 Jiawei Hu , Qun Liu

Lexical semantic typology has identified important cross-linguistic generalizations about the variation and commonalities in polysemy patterns---how languages package up meanings into words. Recent computational research has enabled…

Computation and Language · Computer Science 2020-06-04 Ella Rabinovich , Yang Xu , Suzanne Stevenson

Morphological segmentation has traditionally been modeled with non-hierarchical models, which yield flat segmentations as output. In many cases, however, proper morphological analysis requires hierarchical structure -- especially in the…

Computation and Language · Computer Science 2021-02-16 Ryan Cotterell , Arun Kumar , Hinrich Schütze

Word segmentation, the problem of finding word boundaries in speech, is of interest for a range of tasks. Previous papers have suggested that for sequence-to-sequence models trained on tasks such as speech translation or speech recognition,…

Computation and Language · Computer Science 2021-09-22 Ramon Sanabria , Hao Tang , Sharon Goldwater

Morphological Segmentation involves decomposing words into morphemes, the smallest meaning-bearing units of language. This is an important NLP task for morphologically-rich agglutinative languages such as the Southern African Nguni language…

Computation and Language · Computer Science 2021-04-05 Tumi Moeng , Sheldon Reay , Aaron Daniels , Jan Buys

In this paper we are interested in the problem of image segmentation given natural language descriptions, i.e. referring expressions. Existing works tackle this problem by first modeling images and sentences independently and then segment…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Chenxi Liu , Zhe Lin , Xiaohui Shen , Jimei Yang , Xin Lu , Alan Yuille