English
Related papers

Related papers: An Experimental Evaluation of Japanese Tokenizers …

200 papers

The performance of sentiment analysis methods has greatly increased in recent years. This is due to the use of various models based on the Transformer architecture, in particular BERT. However, deep neural network models are difficult to…

Computation and Language · Computer Science 2021-11-22 Anastasia Kotelnikova , Danil Paschenko , Klavdiya Bochenina , Evgeny Kotelnikov

Tokenization defines the foundation of multilingual language models by determining how words are represented and shared across languages. However, existing methods often fail to support effective cross-lingual transfer because semantically…

Computation and Language · Computer Science 2025-10-08 Muhammad Dehan Al Kautsar , Fajri Koto

Document categorization is a technique where the category of a document is determined. In this paper three well-known supervised learning techniques which are Support Vector Machine(SVM), Na\"ive Bayes(NB) and Stochastic Gradient…

Computation and Language · Computer Science 2017-01-31 Md. Saiful Islam , Fazla Elahi Md Jubayer , Syed Ikhtiar Ahmed

This work presents a new and simple approach for fine-tuning pretrained word embeddings for text classification tasks. In this approach, the class in which a term appears, acts as an additional contextual variable during the fine tuning…

Computation and Language · Computer Science 2019-12-17 Amr Al-Khatib , Samhaa R. El-Beltagy

The use of background knowledge is largely unexploited in text classification tasks. This paper explores word taxonomies as means for constructing new semantic features, which may improve the performance and robustness of the learned…

Computation and Language · Computer Science 2020-12-01 Blaž Škrlj , Matej Martinc , Jan Kralj , Nada Lavrač , Senja Pollak

Subword tokenization is a commonly used input pre-processing step in most recent NLP models. However, it limits the models' ability to leverage end-to-end task learning. Its frequency-based vocabulary creation compromises tokenization in…

Computation and Language · Computer Science 2022-04-25 Md Mofijul Islam , Gustavo Aguilar , Pragaash Ponnusamy , Clint Solomon Mathialagan , Chengyuan Ma , Chenlei Guo

The complexities of Arabic language in morphology, orthography and dialects makes sentiment analysis for Arabic more challenging. Also, text feature extraction from short messages like tweets, in order to gauge the sentiment, makes this…

Computation and Language · Computer Science 2018-10-17 Abdulaziz M. Alayba , Vasile Palade , Matthew England , Rahat Iqbal

Automatically mining sentiment tendency contained in natural language is a fundamental research to some artificial intelligent applications, where solutions alternate with challenges. Transfer learning and multi-task learning techniques…

Computation and Language · Computer Science 2022-04-01 Xin-Chun Li , Lan Li , De-Chuan Zhan , Yunfeng Shao , Bingshuai Li , Shaoming Song

This paper presents our approach for SemEval 2025 Task 11 Track A, focusing on multilabel emotion classification across 28 languages. We explore two main strategies: fully fine-tuning transformer models and classifier-only training,…

This paper proposes an analysis of classifiers into four major types: UNIT, METRIC, GROUP and SPECIES, based on properties of both Japanese and English. The analysis makes possible a uniform and straightforward treatment of noun phrases…

cmp-lg · Computer Science 2008-02-03 Francis Bond , Kentaro Ogura , Satoru Ikehara

This paper explores a simple and efficient baseline for text classification. Our experiments show that our fast text classifier fastText is often on par with deep learning classifiers in terms of accuracy, and many orders of magnitude…

Computation and Language · Computer Science 2016-08-10 Armand Joulin , Edouard Grave , Piotr Bojanowski , Tomas Mikolov

Sentiment analysis is a common task in natural language processing that aims to detect polarity of a text document (typically a consumer review). In the simplest settings, we discriminate only between positive and negative sentiment,…

Computation and Language · Computer Science 2015-05-28 Grégoire Mesnil , Tomas Mikolov , Marc'Aurelio Ranzato , Yoshua Bengio

In order to maximize the applicability of sentiment analysis results, it is necessary to not only classify the overall sentiment (positive/negative) of a given document but also to identify the main words that contribute to the…

Computation and Language · Computer Science 2017-10-02 Gichang Lee , Jaeyun Jeong , Seungwan Seo , CzangYeob Kim , Pilsung Kang

The stakeholders' needs in sentiment analysis for various issues, whether positive or negative, are speed and accuracy. One new challenge in sentiment analysis tasks is the limited training data, which often leads to suboptimal machine…

Computation and Language · Computer Science 2024-07-09 Surya Agustian , Muhammad Irfan Syah , Nurul Fatiara , Rahmad Abdillah

A great variety of text tasks such as topic or spam identification, user profiling, and sentiment analysis can be posed as a supervised learning problem and tackle using a text classifier. A text classifier consists of several subprocesses,…

Computation and Language · Computer Science 2017-09-18 Eric S. Tellez , Daniela Moctezuma , Sabino Miranda-Jímenez , Mario Graff

Recently, language representation techniques have achieved great performances in text classification. However, most existing representation models are specifically designed for English materials, which may fail in Chinese because of the…

Computation and Language · Computer Science 2022-12-19 Xunzhu Tang , Rujie Zhu , Tiezhu Sun , Shi Wang

The classic supervised classification algorithms are efficient, but time-consuming, complicated and not interpretable, which makes it difficult to analyze their results that limits the possibility to improve them based on real observations.…

Computation and Language · Computer Science 2018-03-05 Hussam Hamdan

Automatic scoring system is extremely complex for any language. Because natural language itself is a complex model. When we evaluate articles generated by natural language, we need to view the articles from many dimensions such as word…

Computation and Language · Computer Science 2020-08-27 Wanhong Huang

This paper benchmarks classical machine learning and deep learning approaches for three-class sentiment classification of Indonesian Spotify reviews. Using 100,000 scraped reviews and 70,155 cleaned samples, the study compares Support…

Text classification has become a crucial task in various fields, leading to a significant amount of research on developing automated text classification systems for national and international languages. However, there is a growing need for…

Computation and Language · Computer Science 2023-05-08 Mursal Dawodi , Jawid Ahmad Baktash