English
Related papers

Related papers: Chinese Character Decomposition for Neural MT with…

200 papers

Neural machine translation (NMT) systems operate primarily on words (or sub-words), ignoring lower-level patterns of morphology. We present a character-aware decoder designed to capture such patterns when translating into morphologically…

Computation and Language · Computer Science 2019-06-20 Adithya Renduchintala , Pamela Shapiro , Kevin Duh , Philipp Koehn

Multiword expressions (MWEs) are a heterogeneous set with a glaring need for classifications. Designing a satisfactory classification involves choosing features. In the case of MWEs, many features are a priori available. Not all features…

Computation and Language · Computer Science 2026-05-13 Eric Laporte

Chinese pre-trained language models usually process text as a sequence of characters, while ignoring more coarse granularity, e.g., words. In this work, we propose a novel pre-training paradigm for Chinese -- Lattice-BERT, which explicitly…

Computation and Language · Computer Science 2021-05-31 Yuxuan Lai , Yijia Liu , Yansong Feng , Songfang Huang , Dongyan Zhao

In recent years, rapid advances in Multimodal Large Language Models (MLLMs) have increasingly stimulated research on ancient Chinese scripts. As the evolution of written characters constitutes a fundamental pathway for understanding…

Computation and Language · Computer Science 2026-04-14 Rui Song , Lida Shi , Ruihua Qi , Yingji Li , Hao Xu

Revealing the syntactic structure of sentences in Chinese poses significant challenges for word-level parsers due to the absence of clear word boundaries. To facilitate a transition from word-level to character-level Chinese dependency…

Computation and Language · Computer Science 2024-06-07 Yang Hou , Zhenghua Li

This paper explores predicting suitable prosodic features for fine-grained emotion analysis from the discourse-level text. To obtain fine-grained emotional prosodic features as predictive values for our model, we extract a phoneme-level…

Sound · Computer Science 2023-09-22 Xianhao Wei , Jia Jia , Xiang Li , Zhiyong Wu , Ziyi Wang

Chinese word segmentation and part-of-speech tagging are necessary tasks in terms of computational linguistics and application of natural language processing. Many re-searchers still debate the demand for Chinese word segmentation and…

Computation and Language · Computer Science 2021-12-20 Duc-Vu Nguyen , Linh-Bao Vo , Ngoc-Linh Tran , Kiet Van Nguyen , Ngan Luu-Thuy Nguyen

Multiword expressions (MWEs) represent lexemes that should be treated as single lexical units due to their idiosyncratic nature. Multiple NLP applications have been shown to benefit from MWE identification, however the research on lexical…

Computation and Language · Computer Science 2020-05-13 Ekaterina Kochmar , Sian Gooding , Matthew Shardlow

Different linguistic perspectives causes many diverse segmentation criteria for Chinese word segmentation (CWS). Most existing methods focus on improve the performance for each single criterion. However, it is interesting to exploit these…

Computation and Language · Computer Science 2017-04-26 Xinchi Chen , Zhan Shi , Xipeng Qiu , Xuanjing Huang

Multimodal sarcasm detection has recently garnered significant attention. However, existing benchmarks suffer from coarse-grained annotations and limited cultural coverage, which hinder research into fine-grained semantic understanding. To…

Computation and Language · Computer Science 2026-04-21 Junzhao Zhang , Hsiu-Yuan Huang , Chenming Tang , Yutong Yang , Yunfang Wu

Cross-domain Chinese Word Segmentation (CWS) remains a challenge despite recent progress in neural-based CWS. The limited amount of annotated data in the target domain has been the key obstacle to a satisfactory performance. In this paper,…

Computation and Language · Computer Science 2019-08-07 Yuxiao Ye , Yue Zhang , Weikang Li , Likun Qiu , Jian Sun

Multi-criteria Chinese word segmentation is a promising but challenging task, which exploits several different segmentation criteria and mines their common underlying knowledge. In this paper, we propose a flexible multi-criteria learning…

Computation and Language · Computer Science 2018-12-20 Jingjing Gong , Xinchi Chen , Tao Gui , Xipeng Qiu

Encoder-only Transformers have advanced along three axes -- architecture, data, and systems -- yielding Pareto gains in accuracy, speed, and memory efficiency. Yet these improvements have not fully transferred to Chinese, where tokenization…

Computation and Language · Computer Science 2025-10-15 Zeyu Zhao , Ningtao Wang , Xing Fu , Yu Cheng

Neural network models have been proposed to explain the grapheme-phoneme mapping process in humans for many alphabet languages. These models not only successfully learned the correspondence of the letter strings and their pronunciation, but…

Computation and Language · Computer Science 2023-05-16 Xiaomeng Ma , Lingyu Gao

Pinyin-to-character (P2C) conversion is the core component of pinyin-based Chinese input method engine (IME). However, the conversion is seriously compromised by the ambiguities of Chinese characters corresponding to pinyin as well as the…

Artificial Intelligence · Computer Science 2019-06-07 Zhuosheng Zhang , Yafang Huang , Hai Zhao

Based on network analysis of hierarchical structural relations among Chinese characters, we develop an efficient learning strategy of Chinese characters. We regard a more efficient learning method if one learns the same number of useful…

Physics and Society · Physics 2013-08-28 Xiao-Yong Yan , Ying Fan , Zengru Di , Shlomo Havlin , Jinshan Wu

One of the key issues in Mandarin Chinese text-to-speech (TTS) systems is polyphone disambiguation when doing grapheme-to-phoneme (G2P) conversion. In this paper, we introduce a novel method to solve the problem as a generation task.…

Computation and Language · Computer Science 2023-12-20 Chen Li

Recently, great progress has been made for online handwritten Chinese character recognition due to the emergence of deep learning techniques. However, previous research mostly treated each Chinese character as one class without explicitly…

Computer Vision and Pattern Recognition · Computer Science 2018-01-31 Jianshu Zhang , Yixing Zhu , Jun Du , Lirong Dai

Almost all existing machine translation models are built on top of character-based vocabularies: characters, subwords or words. Rare characters from noisy text or character-rich languages such as Japanese and Chinese however can…

Computation and Language · Computer Science 2019-12-09 Changhan Wang , Kyunghyun Cho , Jiatao Gu

Chinese word segmentation has entered the deep learning era which greatly reduces the hassle of feature engineering. Recently, some researchers attempted to treat it as character-level translation, which further simplified model designing,…

Computation and Language · Computer Science 2022-10-12 Pinzhen Chen , Kenneth Heafield