English
Related papers

Related papers: Investigating Monolingual and Multilingual BERTMod…

200 papers

Text classification is a typical natural language processing or computational linguistics task with various interesting applications. As the number of users on social media platforms increases, data acceleration promotes emerging studies on…

Computation and Language · Computer Science 2022-09-22 Luan Thanh Nguyen , Kiet Van Nguyen , Ngan Luu-Thuy Nguyen

Although the curse of multilinguality significantly restricts the language abilities of multilingual models in monolingual settings, researchers now still have to rely on multilingual models to develop state-of-the-art systems in Vietnamese…

Computation and Language · Computer Science 2023-03-24 Son Quoc Tran , Phong Nguyen-Thuan Do , Kiet Van Nguyen , Ngan Luu-Thuy Nguyen

Recent advances in contextualized word embeddings have greatly improved semantic tasks such as Word Sense Disambiguation (WSD) and contextual similarity, but most progress has been limited to high-resource languages like English.…

Computation and Language · Computer Science 2025-11-18 Khang T. Huynh , Dung H. Nguyen , Binh T. Nguyen

Aspect and opinion term extraction is a critical step in Aspect-Based Sentiment Analysis (ABSA). Our study focuses on evaluating transfer learning using pre-trained BERT (Devlin et al., 2018) to classify tokens from hotel reviews in bahasa…

Computation and Language · Computer Science 2020-10-02 Yosef Ardhito Winatmoko , Ali Akbar Septiandri , Arie Pratama Sutiono

Aspect level sentiment classification (ALSC) is a difficult problem with state-of-the-art models showing less than 80% macro-F1 score on benchmark datasets. Existing models do not incorporate information on aspect-aspect relations in…

Computation and Language · Computer Science 2022-02-15 Sk Mainul Islam , Sourangshu Bhattacharya

This paper explores the challenges posed by aspect-based sentiment classification (ABSC) within pretrained language models (PLMs), with a particular focus on contextualization and hallucination issues. In order to tackle these challenges,…

Computation and Language · Computer Science 2024-02-26 Dongjun Jang , Jean Seo , Sungjoo Byun , Taekyoung Kim , Minseok Kim , Hyopil Shin

The rapid advancement of information and communication technology has facilitated easier access to information. However, this progress has also necessitated more stringent verification measures to ensure the accuracy of information,…

Computation and Language · Computer Science 2025-03-04 Bao Tran , T. N. Khanh , Khang Nguyen Tuong , Thien Dang , Quang Nguyen , Nguyen T. Thinh , Vo T. Hung

In this paper, we present a process of building a social listening system based on aspect-based sentiment analysis in Vietnamese from creating a dataset to building a real application. Firstly, we create UIT-ViSFD, a Vietnamese Smartphone…

Determining the difficulty of a text involves assessing various textual features that may impact the reader's text comprehension, yet current research in Vietnamese has only focused on statistical features. This paper introduces a new…

Computation and Language · Computer Science 2024-11-08 Hung Tuan Le , Long Truong To , Manh Trong Nguyen , Quyen Nguyen , Trong-Hop Do

The emergence of multimodal data on social media platforms presents new opportunities to better understand user sentiments toward a given aspect. However, existing multimodal datasets for Aspect-Category Sentiment Analysis (ACSA) often…

Computation and Language · Computer Science 2025-04-08 Quy Hoang Nguyen , Minh-Van Truong Nguyen , Kiet Van Nguyen

Aspect-category sentiment analysis (ACSA) aims to predict sentiment polarities of sentences with respect to given aspect categories. To detect the sentiment toward a particular aspect category in a sentence, most previous methods first…

Computation and Language · Computer Science 2020-10-07 Yuncong Li , Cunxiang Yin , Sheng-hua Zhong , Xu Pan

Vietnamese, the 20th most spoken language with over 102 million native speakers, lacks robust resources for key natural language processing tasks such as text segmentation and machine reading comprehension (MRC). To address this gap, we…

Computation and Language · Computer Science 2025-06-23 Toan Nguyen Hai , Ha Nguyen Viet , Truong Quan Xuan , Duc Do Minh

Multilingual pretrained language models (such as multilingual BERT) have achieved impressive results for cross-lingual transfer. However, due to the constant model capacity, multilingual pre-training usually lags behind the monolingual…

Computation and Language · Computer Science 2019-11-12 Zewen Chi , Li Dong , Furu Wei , Xian-Ling Mao , Heyan Huang

Aspect-based sentiment analysis (ABSA) in natural language processing enables organizations to understand customer opinions on specific product aspects. While deep learning models are widely used for English ABSA, their application in…

Computation and Language · Computer Science 2025-09-23 Salha Alyami , Amani Jamal , Areej Alhothali

Our work addresses the problem of unsupervised Aspect Category Detection using a small set of seed words. Recent works have focused on learning embedding spaces for seed words and sentences to establish similarities between sentences and…

Computation and Language · Computer Science 2023-11-17 Thi-Nhung Nguyen , Hoang Ngo , Kiem-Hieu Nguyen , Tuan-Dung Cao

In the field of education, understanding students' opinions through their comments is crucial, especially in the Vietnamese language, where resources remain limited. Existing educational datasets often lack domain relevance and student…

Computation and Language · Computer Science 2025-07-01 Phan Quoc Hung Mai , Quang Hung Nguyen , Phuong Giang Duong , Hong Hanh Nguyen , Nguyen Tuan Long

Despite the rise of recent neural networks in machine translation, those networks do not work well if the training data is insufficient. In this paper, we proposed an approach for machine translation in low-resource languages such as…

Computation and Language · Computer Science 2025-02-03 Tran Ngoc Son , Nguyen Anh Tu , Nguyen Minh Tri

Aspect-based sentiment analysis plays an essential role in natural language processing and artificial intelligence. Recently, researchers only focused on aspect detection and sentiment classification but ignoring the sub-task of detecting…

Computation and Language · Computer Science 2021-10-18 Kim Thi-Thanh Nguyen , Sieu Khai Huynh , Luong Luc Phan , Phuc Huynh Pham , Duc-Vu Nguyen , Kiet Van Nguyen

This paper focuses on learning domain-oriented language models driven by end tasks, which aims to combine the worlds of both general-purpose language models (such as ELMo and BERT) and domain-specific language understanding. We propose…

Computation and Language · Computer Science 2020-04-30 Hu Xu , Bing Liu , Lei Shu , Philip S. Yu

Aspect category sentiment analysis has attracted increasing research attention. The dominant methods make use of pre-trained language models by learning effective aspect category-specific representations, and adding specific output layers…

Computation and Language · Computer Science 2021-10-15 Jian Liu , Zhiyang Teng , Leyang Cui , Hanmeng Liu , Yue Zhang