中文
相关论文

相关论文: An Experimental Evaluation of Japanese Tokenizers …

200 篇论文

Sentiment Analysis is a branch of Affective Computing usually considered a binary classification task. In this line of reasoning, Sentiment Analysis can be applied in several contexts to classify the attitude expressed in text samples, for…

信息检索 · 计算机科学 2020-08-13 Flavio Carvalho , Gustavo Paiva Guedes

This paper describes SentencePiece, a language-independent subword tokenizer and detokenizer designed for Neural-based text processing, including Neural Machine Translation. It provides open-source C++ and Python implementations for subword…

计算与语言 · 计算机科学 2018-08-21 Taku Kudo , John Richardson

Sentiment analysis is a domain of study that focuses on identifying and classifying the ideas expressed in the form of text into positive, negative and neutral polarities. Feature selection is a crucial process in machine learning. In this…

计算与语言 · 计算机科学 2020-02-04 Avinash Madasu , Sivasankar E

With the rapid growth of Text sentiment analysis, the demand for automatic classification of electronic documents has increased by leaps and bound. The paradigm of text classification or text mining has been the subject of many research…

计算与语言 · 计算机科学 2018-06-19 Bijoyan Das , Sarit Chakraborty

Text classification approaches have usually required task-specific model architectures and huge labeled datasets. Recently, thanks to the rise of text-based transfer learning techniques, it is possible to pre-train a language model in an…

计算与语言 · 计算机科学 2019-06-10 Enkhbold Bataa , Joshua Wu

Given the lack of word delimiters in written Japanese, word segmentation is generally considered a crucial first step in processing Japanese texts. Typical Japanese segmentation algorithms rely either on a lexicon and syntactic analysis or…

计算与语言 · 计算机科学 2007-05-23 Rie Kubota Ando , Lillian Lee

Code comments are a key resource for information about software artefacts. Depending on the use case, only some types of comments are useful. Thus, automatic approaches to classify these comments have been proposed. In this work, we address…

软件工程 · 计算机科学 2023-03-08 Ali Al-Kaswan , Maliheh Izadi , Arie van Deursen

In recent years, the use of machine learning classifiers is of great value in solving a variety of problems in text classification. Sentiment mining is a kind of text classification in which, messages are classified according to sentiment…

机器学习 · 计算机科学 2014-02-18 Vinodhini G Chandrasekaran RM

Sentiment Analysis refers to the study of systematically extracting the meaning of subjective text . When analysing sentiments from the subjective text using Machine Learning techniques,feature extraction becomes a significant part. We…

计算与语言 · 计算机科学 2019-06-05 Avinash Madasu , Sivasankar E

Emotion stimulus detection is the task of finding the cause of an emotion in a textual description, similar to target or aspect detection for sentiment analysis. Previous work approached this in three ways, namely (1) as text classification…

计算与语言 · 计算机科学 2020-11-10 Laura Oberländer , Roman Klinger

Tokenization is the act of breaking down text into smaller parts, or tokens, that are easier for machines to process. This is a key phase in machine translation (MT) models. Subword tokenization enhances this process by breaking down words…

计算与语言 · 计算机科学 2025-05-23 Sudhansu Bala Das , Samujjal Choudhury , Tapas Kumar Mishra , Bidyut Kr. Patra

Tokenization plays a critical role in language modeling, yet existing approaches such as Byte-Pair Encoding (BPE) or WordPiece operate purely on frequency statistics, ignoring the underlying semantic structure of text. This leads to…

计算与语言 · 计算机科学 2025-08-22 Dong Liu , Yanxuan Yu

Existing Machine Learning techniques yield close to human performance on text-based classification tasks. However, the presence of multi-modal noise in chat data such as emoticons, slang, spelling mistakes, code-mixed data, etc. makes…

计算与语言 · 计算机科学 2019-04-09 Parag Agrawal , Anshuman Suri

In this study, book summaries and categories taken from book sites were classified using word embedding methods, natural language processing techniques and machine learning algorithms. In addition, one hot encoding, Word2Vec and Term…

计算与语言 · 计算机科学 2025-07-30 Kerem Keskin , Mümine Kaya Keleş

In this study, we aimed to improve the performance results of Arabic sentiment analysis. This can be achieved by investigating the most successful machine learning method and the most useful feature vector to classify sentiments in both…

计算与语言 · 计算机科学 2022-05-26 Ahmed Nassar , Ebru Sezer

Tokenization is a crucial step in information retrieval, especially for lexical matching algorithms, where the quality of indexable tokens directly impacts the effectiveness of a retrieval system. Since different languages have unique…

计算与语言 · 计算机科学 2022-10-12 Odunayo Ogundepo , Xinyu Zhang , Jimmy Lin

We provide a simple but novel supervised weighting scheme for adjusting term frequency in tf-idf for sentiment analysis and text classification. We compare our method to baseline weighting schemes and find that it outperforms them on…

计算与语言 · 计算机科学 2014-07-01 Yoon Kim , Owen Zhang

Sentiment Analysis (SA) is a crucial aspect of Natural Language Processing (NLP), focusing on identifying and interpreting subjective assessments in textual content. Syntactic parsing is useful in SA as it improves accuracy and provides…

计算与语言 · 计算机科学 2026-02-04 Muhammad Imran , Olga Kellert , Carlos Gómez-Rodríguez

Citation sentiment analysis is an important task in scientific paper analysis. Existing machine learning techniques for citation sentiment analysis are focusing on labor-intensive feature engineering, which requires large annotated corpus.…

计算与语言 · 计算机科学 2017-04-04 Haixia Liu

Automated sentiment analysis and opinion mining is a complex process concerning the extraction of useful subjective information from text. The explosion of user generated content on the Web, especially the fact that millions of users, on a…

‹ 上一页 1 2 3 10 下一页 ›