English
Related papers

Related papers: Character Feature Engineering for Japanese Word Se…

200 papers

The unprecedented pace of machine learning research has lead to incredible advances, but also poses hard challenges. At present, the field lacks strong theoretical underpinnings, and many important achievements stem from ad hoc design…

Machine Learning · Computer Science 2024-10-16 Francesco Riccardo Crescenzi

Recently, open-vocabulary learning has emerged to accomplish segmentation for arbitrary categories of text-based descriptions, which popularizes the segmentation system to more general-purpose application scenarios. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Jie Qin , Jie Wu , Pengxiang Yan , Ming Li , Ren Yuxi , Xuefeng Xiao , Yitong Wang , Rui Wang , Shilei Wen , Xin Pan , Xingang Wang

Language models typically tokenize text into subwords, using a deterministic, hand-engineered heuristic of combining characters into longer surface-level strings such as 'ing' or whole words. Recent literature has repeatedly shown the…

Computation and Language · Computer Science 2023-10-19 Avijit Thawani , Saurabh Ghanekar , Xiaoyuan Zhu , Jay Pujara

Traditional hand-crafted linguistically-informed features have often been used for distinguishing between translated and original non-translated texts. By contrast, to date, neural architectures without manual feature engineering have been…

Computation and Language · Computer Science 2021-09-17 Daria Pylypenko , Kwabena Amponsah-Kaakyire , Koel Dutta Chowdhury , Josef van Genabith , Cristina España-Bonet

Recent success of pre-trained foundation vision-language models makes Open-Vocabulary Segmentation (OVS) possible. Despite the promising performance, this approach introduces heavy computational overheads for two challenges: 1) large model…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Jingxuan Xu , Wuyang Chen , Yao Zhao , Yunchao Wei

The representation of feature space is a crucial environment where data points get vectorized and embedded for subsequent modeling. Thus the efficacy of machine learning (ML) algorithms is closely related to the quality of feature…

Machine Learning · Computer Science 2026-01-12 Xinhao Zhang , Jinghan Zhang , Banafsheh Rekabdar , Yuanchun Zhou , Pengfei Wang , Kunpeng Liu

A patent is a property right for an invention granted by the government to the inventor. An invention is a solution to a specific technological problem. So patents often have a high concentration of scientific and technical terms that are…

Computation and Language · Computer Science 2016-12-01 Si Li , Nianwen Xue

A discriminative structured analysis dictionary is proposed for the classification task. A structure of the union of subspaces (UoS) is integrated into the conventional analysis dictionary learning to enhance the capability of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Wen Tang , Ashkan Panahi , Hamid Krim , Liyi Dai

Modern language models are internally -- and mathematically -- distributions over $\it{token}$ strings rather than $\it{character}$ strings, posing numerous challenges for programmers building user applications on top of them. For example,…

Computation and Language · Computer Science 2025-06-11 Tim Vieira , Ben LeBrun , Mario Giulianelli , Juan Luis Gastaldi , Brian DuSell , John Terilla , Timothy J. O'Donnell , Ryan Cotterell

Urdu is a cursive script language and has similarities with Arabic and many other South Asian languages. Urdu is difficult to classify due to its complex geometrical and morphological structure. Character classification can be processed…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Sumaiya Fazal , Sheeraz Ahmed

This paper describes a system submitted by team BigGreen to LCP 2021 for predicting the lexical complexity of English words in a given context. We assemble a feature engineering-based model with a deep neural network model founded on BERT.…

Computation and Language · Computer Science 2021-07-29 Aadil Islam , Weicheng Ma , Soroush Vosoughi

Semantically-aligned $(speech, image)$ datasets can be used to explore "visually-grounded speech". In a majority of existing investigations, features of an image signal are extracted using neural networks "pre-trained" on other tasks (e.g.,…

Machine Learning · Computer Science 2020-10-30 Masood S. Mortazavi

Smart audio devices are gated by an always-on lightweight keyword spotting program to reduce power consumption. It is however challenging to design models that have both high accuracy and low latency for accurate and fast responsiveness.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-23 Bo Zhang , Wenfeng Li , Qingyuan Li , Weiji Zhuang , Xiangxiang Chu , Yujun Wang

Rapidly developed neural models have achieved competitive performance in Chinese word segmentation (CWS) as their traditional counterparts. However, most of methods encounter the computational inefficiency especially for long sentences…

Computation and Language · Computer Science 2019-01-30 Sufeng Duan , Jiangtong Li , Hai Zhao

We present an end-to-end trainable approach for Optical Character Recognition (OCR) on printed documents. Specifically, we propose a model that predicts a) a two-dimensional character grid (\emph{chargrid}) representation of a document…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Christian Reisswig , Anoop R Katti , Marco Spinaci , Johannes Höhne

This study investigates the vulnerability of semantic segmentation models to adversarial input perturbations, in the domain of off-road autonomous driving. Despite good performance in generic conditions, the state-of-the-art classifiers are…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Pankaj Deoli , Rohit Kumar , Axel Vierling , Karsten Berns

Japan is a unique country with a distinct cultural heritage, which is reflected in billions of historical documents that have been preserved. However, the change in Japanese writing system in 1900 made these documents inaccessible for the…

Computation and Language · Computer Science 2021-06-15 Alex Lamb , Tarin Clanuwat , Siyu Han , Mikel Bober-Irizar , Asanobu Kitamoto

This paper presents our segmentation system developed for the MLP 2017 shared tasks on cross-lingual word segmentation and morpheme segmentation. We model both word and morpheme segmentation as character-level sequence labelling tasks. The…

Computation and Language · Computer Science 2017-09-13 Yan Shao

Natural language processing systems often struggle with out-of-vocabulary (OOV) terms, which do not appear in training data. Blends, such as "innoventor", are one particularly challenging class of OOV, as they are formed by fusing together…

Computation and Language · Computer Science 2020-09-22 Yuval Pinter , Cassandra L. Jacobs , Jacob Eisenstein

Semantic segmentation is fundamental to vision systems requiring pixel-level scene understanding, yet deploying it on resource-constrained devices demands efficient architectures. Although existing methods achieve real-time inference…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Shi-Chen Zhang , Yunheng Li , Yu-Huan Wu , Qibin Hou , Ming-Ming Cheng