English
Related papers

Related papers: Don't Just Scratch the Surface: Enhancing Word Rep…

200 papers

We introduce a morpheme-aware subword tokenization method that utilizes sub-character decomposition to address the challenges of applying Byte Pair Encoding (BPE) to Korean, a language characterized by its rich morphology and unique writing…

Computation and Language · Computer Science 2023-11-08 Taehee Jeon , Bongseok Yang , Changhwan Kim , Yoonseob Lim

Representation learning is the foundation of machine reading comprehension and inference. In state-of-the-art models, character-level representations have been broadly adopted to alleviate the problem of effectively representing rare or…

Computation and Language · Computer Science 2019-06-12 Zhuosheng Zhang , Hai Zhao , Kangwei Ling , Jiangtong Li , Zuchao Li , Shexia He , Guohong Fu

We propose a new method for learning word representations using hierarchical regularization in sparse coding inspired by the linguistic study of word meanings. We show an efficient learning algorithm based on stochastic proximal methods…

Computation and Language · Computer Science 2014-11-07 Dani Yogatama , Manaal Faruqui , Chris Dyer , Noah A. Smith

Chinese word usage errors often occur in non-native Chinese learners' writing. It is very helpful for non-native Chinese learners to detect them automatically when learning writing. In this paper, we propose a novel approach, which takes…

Computation and Language · Computer Science 2019-04-04 Jinbin Zhang , Heng Wang

Naively assuming English as a source language may hinder cross-lingual transfer for many languages by failing to consider the importance of language contact. Some languages are more well-connected than others, and target languages can…

Computation and Language · Computer Science 2024-04-22 Hoang H. Nguyen , Chenwei Zhang , Ye Liu , Natalie Parde , Eugene Rohrbaugh , Philip S. Yu

In this paper we propose a method that imitates a translation expert using the Korean translation information and analyse the performance. Korean is good at tagging than Chinese, so we can use this property in Chinese POS tagging.

Computation and Language · Computer Science 2015-11-10 Son-Il Kwak , O-Chol Kown , Chang-Sin Kim , Yong-Il Pak , Gum-Chol Son , Chol-Jun Hwang , Hyon-Chol Kim , Hyok-Chol Sin , Gyong-Il Hyon , Sok-Min Han

The Korean wave, which denotes the global popularity of South Korea's cultural economy, contributes to the increasing demand for the Korean language. However, as there does not exist any application for foreigners to learn Korean, this…

Computation and Language · Computer Science 2022-05-05 Minjong Cheon , Minseon Kim , Hanseon Joo

Transfer learning leverages the abundance of English data to address the scarcity of resources in modeling non-English languages, such as Korean. In this study, we explore the potential of Phrase Aligned Data (PAD) from standardized…

Computation and Language · Computer Science 2025-03-27 Jong Myoung Kim , Young-Jun_Lee , Ho-Jin Choi , Sangkeun Jung

Cross-language learning allows us to use training data from one language to build models for a different language. Many approaches to bilingual learning require that we have word-level alignment of sentences from parallel corpora. In this…

Computation and Language · Computer Science 2014-02-07 Sarath Chandar A P , Stanislas Lauly , Hugo Larochelle , Mitesh M. Khapra , Balaraman Ravindran , Vikas Raykar , Amrita Saha

We introduce a novel sub-character architecture that exploits a unique compositional structure of the Korean language. Our method decomposes each character into a small set of primitive phonetic units called jamo letters from which…

Computation and Language · Computer Science 2017-07-24 Karl Stratos

In the paper, we propose a novel way of improving named entity recognition in the Korean language using its language-specific features. While the field of named entity recognition has been studied extensively in recent years, the mechanism…

Computation and Language · Computer Science 2024-05-15 Yige Chen , KyungTae Lim , Jungyeul Park

The Sejong dictionary dataset offers a valuable resource, providing extensive coverage of morphology, syntax, and semantic representation. This dataset can be utilized to explore linguistic information in greater depth. The labeled…

Computation and Language · Computer Science 2025-04-04 Seohyun Song , Eunkyul Leah Jo , Yige Chen , Jeen-Pyo Hong , Kyuwon Kim , Jin Wee , Miyoung Kang , KyungTae Lim , Jungyeul Park , Chulwoo Park

Document-level Relation Extraction (DocRE) is the task of extracting all semantic relationships from a document. While studies have been conducted on English DocRE, limited attention has been given to DocRE in non-English languages. This…

Computation and Language · Computer Science 2024-04-26 Youmi Ma , An Wang , Naoaki Okazaki

Cross-lingual transfer between a high-resource language and its dialects or closely related language varieties should be facilitated by their similarity. However, current approaches that operate in the embedding space do not take surface…

Computation and Language · Computer Science 2022-03-14 Noëmi Aepli , Rico Sennrich

Incorporating information from other languages can improve the results of tasks in low-resource languages. A powerful method of building functional natural language processing systems for low-resource languages is to combine multilingual…

Computation and Language · Computer Science 2022-05-19 Heydar Soudani , Mohammad Hassan Mojab , Hamid Beigy

Learning to fuse vision and language information and representing them is an important research problem with many applications. Recent progresses have leveraged the ideas of pre-training (from language modeling) and attention layers in…

Computer Vision and Pattern Recognition · Computer Science 2020-10-08 Bowen Zhang , Hexiang Hu , Vihan Jain , Eugene Ie , Fei Sha

Methods for learning word representations using large text corpora have received much attention lately due to their impressive performance in numerous natural language processing (NLP) tasks such as, semantic similarity measurement, and…

Computation and Language · Computer Science 2015-11-23 Danushka Bollegala , Alsuhaibani Mohammed , Takanori Maehara , Ken-ichi Kawarabayashi

Contrastive learning is widely used for sentence representation learning. Despite this prevalence, most studies have focused exclusively on English and few concern domain adaptation for domain-specific downstream tasks, especially for…

Computation and Language · Computer Science 2023-01-20 Zihao Chen , Hisashi Handa , Kimiaki Shirahama

Anaphora resolution is one of the major problems in natural language processing. It is also one of the important tasks in machine translation and man/machine dialogue. We solve the problem by using surface expressions and examples. Surface…

Computation and Language · Computer Science 2009-09-25 Masaki Murata

Cross-lingual model transfer is a compelling and popular method for predicting annotations in a low-resource language, whereby parallel corpora provide a bridge to a high-resource language and its associated annotated corpora. However,…

Computation and Language · Computer Science 2017-05-02 Meng Fang , Trevor Cohn