English
Related papers

Related papers: An Experimental Evaluation of Japanese Tokenizers …

200 papers

Character-level language models obviate the need for separately trained tokenizers, but efficiency suffers from longer sequence lengths. Learning to combine character representations into tokens has made training these models more…

Computation and Language · Computer Science 2023-11-16 William Fleshman , Benjamin Van Durme

This paper presents AI Wizards' participation in the CLEF 2025 CheckThat! Lab Task 1: Subjectivity Detection in News Articles, classifying sentences as subjective/objective in monolingual, multilingual, and zero-shot settings.…

Computation and Language · Computer Science 2025-09-24 Matteo Fasulo , Luca Babboni , Luca Tedeschini

Tokenization is a foundational step in natural language processing (NLP) tasks, bridging raw text and language models. Existing tokenization approaches like Byte-Pair Encoding (BPE) originate from the field of data compression, and it has…

Computation and Language · Computer Science 2024-10-08 Craig W. Schmidt , Varshini Reddy , Haoran Zhang , Alec Alameddine , Omri Uzan , Yuval Pinter , Chris Tanner

Despite the success of distributional semantics, composing phrases from word vectors remains an important challenge. Several methods have been tried for benchmark tasks such as sentiment classification, including word vector averaging,…

Computation and Language · Computer Science 2015-12-14 Pranjal Singh , Amitabha Mukerjee

Unsupervised text classification, with its most common form being sentiment analysis, used to be performed by counting words in a text that were stored in a lexicon, which assigns each word to one class or as a neutral word. In recent…

Computation and Language · Computer Science 2025-06-26 Kai-Robin Lange , Jonas Rieger , Carsten Jentsch

With increasing globalization and immigration, various studies have estimated that about half of the world population is bilingual. Consequently, individuals concurrently use two or more languages or dialects in casual conversational…

Computation and Language · Computer Science 2022-11-01 Saurav K. Aryal , Howard Prioleau , Gloria Washington

Autoregressive (AR) encoder-decoder neural networks have proved successful in many NLP problems, including Semantic Parsing -- a task that translates natural language to machine-readable parse trees. However, the sequential prediction…

Computation and Language · Computer Science 2023-03-31 Sid Wang , Akshat Shrivastava , Sasha Livshits

Sentiment analysis is a key component in various text mining applications. Numerous sentiment classification techniques, including conventional and deep learning-based methods, have been proposed in the literature. In most existing methods,…

Computation and Language · Computer Science 2018-03-22 Ou Wu , Tao Yang , Mengyang Li , Ming Li

This study is main goal is to provide a comparative comparison of libraries using machine learning methods. Experts in natural language processing (NLP) are becoming more and more interested in sentiment analysis (SA) of text changes. The…

Computation and Language · Computer Science 2023-07-27 Wendy Ccoya , Edson Pinto

The long speech sequence has been troubling language models (LM) based TTS approaches in terms of modeling complexity and efficiency. This work proposes SoCodec, a semantic-ordered multi-stream speech codec, to address this issue. It…

Sound · Computer Science 2024-09-04 Haohan Guo , Fenglong Xie , Kun Xie , Dongchao Yang , Dake Guo , Xixin Wu , Helen Meng

Term weighting metrics assign weights to terms in order to discriminate the important terms from the less crucial ones. Due to this characteristic, these metrics have attracted growing attention in text classification and recently in…

Computation and Language · Computer Science 2016-10-12 Hussam Hamdan , Patrice Bellot , Frederic Bechet

Prompt-based learning has shown its effectiveness in few-shot text classification. One important factor in its success is a verbalizer, which translates output from a language model into a predicted class. Notably, the simplest and widely…

Computation and Language · Computer Science 2023-10-20 Thanakorn Thaminkaew , Piyawat Lertvittayakumjorn , Peerapon Vateekul

We undertake the task of comparing lexicon-based sentiment classification of film reviews with machine learning approaches. We look at existing methodologies and attempt to emulate and improve on them using a 'given' lexicon and a…

Computation and Language · Computer Science 2019-05-14 Milan Gritta

Text classification has seen an increased use in both academic and industry settings. Though rule based methods have been fairly successful, supervised machine learning has been shown to be most successful for most languages, where most…

Computation and Language · Computer Science 2021-04-26 Deniz Kavi

Nowadays, topic classification from tweets attracts considerable research attention. Different classification systems have been suggested thanks to these research efforts. Nevertheless, they face major challenges owing to low performance…

Computation and Language · Computer Science 2024-07-04 Kheir Eddine Daouadi , Yaakoub Boualleg , Oussama Guehairia

Recently, sentiment analysis has received a lot of attention due to the interest in mining opinions of social media users. Sentiment analysis consists in determining the polarity of a given text, i.e., its degree of positiveness or…

Computation and Language · Computer Science 2016-12-19 Eric S. Tellez , Sabino Miranda Jiménez , Mario Graff , Daniela Moctezuma , Ranyart R. Suárez , Oscar S. Siordia

Neural sequence models have achieved great success in sentence-level sentiment classification. However, some models are exceptionally complex or based on expensive features. Some other models recognize the value of existed linguistic…

Computation and Language · Computer Science 2019-10-21 Yan Zeng , Yangyang Lan , Yazhou Hao , Chen Li , Qinhua Zheng

Emotion detection from the text is an important and challenging problem in text analytics. The opinion-mining experts are focusing on the development of emotion detection applications as they have received considerable attention of online…

Though some recent works focus on injecting sentiment knowledge into pre-trained language models, they usually design mask and reconstruction tasks in the post-training phase. In this paper, we aim to benefit from sentiment knowledge in a…

Computation and Language · Computer Science 2022-02-25 Qinghua Zhao , Shuai Ma , Shuo Ren

This paper describes our multi-view ensemble approach to SemEval-2017 Task 4 on Sentiment Analysis in Twitter, specifically, the Message Polarity Classification subtask for English (subtask A). Our system is a voting ensemble, where each…

Computation and Language · Computer Science 2017-04-10 Edilson A. Corrêa , Vanessa Queiroz Marinho , Leandro Borges dos Santos