中文
相关论文

相关论文: Attention Is All You Need for Chinese Word Segment…

200 篇论文

Different linguistic perspectives causes many diverse segmentation criteria for Chinese word segmentation (CWS). Most existing methods focus on improve the performance for each single criterion. However, it is interesting to exploit these…

计算与语言 · 计算机科学 2017-04-26 Xinchi Chen , Zhan Shi , Xipeng Qiu , Xuanjing Huang

Existing methods for CWS usually rely on a large number of labeled sentences to train word segmentation models, which are expensive and time-consuming to annotate. Luckily, the unlabeled data is usually easy to collect and many high-quality…

计算与语言 · 计算机科学 2019-05-07 Junxin Liu , Fangzhao Wu , Chuhan Wu , Yongfeng Huang , Xing Xie

Chinese word segmentation (CWS) is a fundamental step of Chinese natural language processing. In this paper, we build a new toolkit, named PKUSEG, for multi-domain word segmentation. Unlike existing single-model toolkits, PKUSEG targets…

计算与语言 · 计算机科学 2022-05-31 Ruixuan Luo , Jingjing Xu , Yi Zhang , Zhiyuan Zhang , Xuancheng Ren , Xu Sun

A realistic Chinese word segmentation tool must adapt to textual variations with minimal training input and yet robust enough to yield reliable segmentation result for all variants. Various lexicon-driven approaches to Chinese segmentation,…

计算与语言 · 计算机科学 2019-05-22 Chu-Ren Huang , Ting-Shuo Yo , Petr Simon , Shu-Kai Hsieh

We demonstrate that an attention-based encoder-decoder model can be used for sentence-level grammatical error identification for the Automated Evaluation of Scientific Writing (AESW) Shared Task 2016. The attention-based encoder-decoder…

计算与语言 · 计算机科学 2016-04-19 Allen Schmaltz , Yoon Kim , Alexander M. Rush , Stuart M. Shieber

Multi-Criteria Chinese Word Segmentation (MCCWS) aims at finding word boundaries in a Chinese sentence composed of continuous characters while multiple segmentation criteria exist. The unified framework has been widely used in MCCWS and…

计算与语言 · 计算机科学 2020-04-14 Zhen Ke , Liang Shi , Erli Meng , Bin Wang , Xipeng Qiu , Xuanjing Huang

Chinese word segmentation and dependency parsing are two fundamental tasks for Chinese natural language processing. The dependency parsing is defined on word-level. Therefore word segmentation is the precondition of dependency parsing,…

计算与语言 · 计算机科学 2019-12-19 Hang Yan , Xipeng Qiu , Xuanjing Huang

A few-shot semantic segmentation model is typically composed of a CNN encoder, a CNN decoder and a simple classifier (separating foreground and background pixels). Most existing methods meta-learn all three model components for fast…

计算机视觉与模式识别 · 计算机科学 2021-08-13 Zhihe Lu , Sen He , Xiatian Zhu , Li Zhang , Yi-Zhe Song , Tao Xiang

Chinese word segmentation has entered the deep learning era which greatly reduces the hassle of feature engineering. Recently, some researchers attempted to treat it as character-level translation, which further simplified model designing,…

计算与语言 · 计算机科学 2022-10-12 Pinzhen Chen , Kenneth Heafield

In recent years, neural networks have proven to be effective in Chinese word segmentation. However, this promising performance relies on large-scale training data. Neural networks with conventional architectures cannot achieve the desired…

计算与语言 · 计算机科学 2017-11-07 Jingjing Xu , Xu Sun , Sujian Li , Xiaoyan Cai , Bingzhen Wei

Neural network has become the dominant method for Chinese word segmentation. Most existing models cast the task as sequence labeling, using BiLSTM-CRF for representing the input and making output predictions. Recently, attention-based…

计算与语言 · 计算机科学 2019-07-29 Leilei Gan , Yue Zhang

Copy mechanism allows sequence-to-sequence models to choose words from the input and put them directly into the output, which is finding increasing use in abstractive summarization. However, since there is no explicit delimiter in Chinese…

计算与语言 · 计算机科学 2021-12-22 Boyan Wan , Mishal Sohail

The quadratic cost of attention in transformers motivated the development of efficient approaches: namely sparse and sliding window attention, convolutions and linear attention. Although these approaches result in impressive reductions in…

机器学习 · 计算机科学 2025-11-10 Jatin Prakash , Aahlad Puli , Rajesh Ranganath

Most previous approaches to Chinese word segmentation can be roughly classified into character-based and word-based methods. The former regards this task as a sequence-labeling problem, while the latter directly segments character sequence…

计算与语言 · 计算机科学 2017-12-29 Zhiqing Sun , Gehui Shen , Zhihong Deng

A wide variety of neural-network architectures have been proposed for the task of Chinese word segmentation. Surprisingly, we find that a bidirectional LSTM model, when combined with standard deep learning techniques and best practices, can…

计算与语言 · 计算机科学 2018-08-27 Ji Ma , Kuzman Ganchev , David Weiss

This paper describes our system at NLPTEA-2020 Task: Chinese Grammatical Error Diagnosis (CGED). The goal of CGED is to diagnose four types of grammatical errors: word selection (S), redundant words (R), missing words (M), and disordered…

计算与语言 · 计算机科学 2021-07-13 Jinhong Zhang

Chinese parsing has traditionally been solved by three pipeline systems including word-segmentation, part-of-speech tagging and dependency parsing modules. In this paper, we propose an end-to-end Chinese parsing model based on character…

计算与语言 · 计算机科学 2020-12-09 Yuan Zhang , Zhiyang Teng , Yue Zhang

Deep learning, especially convolutional neural networks (CNNs) and Transformer architectures, have become the focus of extensive research in medical image segmentation, achieving impressive results. However, CNNs come with inductive biases…

图像与视频处理 · 电气工程与系统科学 2024-09-20 Xiao Liu , Peng Gao , Tao Yu , Fei Wang , Ru-Yue Yuan

In the past few years, attention mechanisms have become an indispensable component of end-to-end neural machine translation models. However, previous attention models always refer to some source words when predicting a target word, which…

计算与语言 · 计算机科学 2017-06-01 Junhui Li , Muhua Zhu

We investigate a lattice LSTM network for Chinese word segmentation (CWS) to utilize words or subwords. It integrates the character sequence features with all subsequences information matched from a lexicon. The matched subsequences serve…

计算与语言 · 计算机科学 2018-10-31 Jie Yang , Yue Zhang , Shuailong Liang