English
Related papers

Related papers: Ensemble BERT: A student social network text senti…

200 papers

The success of bidirectional encoders using masked language models, such as BERT, on numerous natural language processing tasks has prompted researchers to attempt to incorporate these pre-trained models into neural machine translation…

Computation and Language · Computer Science 2021-09-13 Haoran Xu , Benjamin Van Durme , Kenton Murray

Ensemble learning is a method that leverages weak learners to produce a strong learner. However, obtaining a large number of base learners requires substantial time and computational resources. Therefore, it is meaningful to study how to…

Machine Learning · Computer Science 2024-08-13 Jinghui Yuan , Weijin Jiang , Zhe Cao , Fangyuan Xie , Rong Wang , Feiping Nie , Yuan Yuan

Ensemble learning is a general technique to improve accuracy in machine learning. However, the heavy computation of a ConvNets ensemble limits its usage in deep learning. In this paper, we present Group Ensemble Network (GENet), an…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Hao Chen , Abhinav Shrivastava

Online education platforms are powered by various NLP pipelines, which utilize models like BERT to aid in content curation. Since the inception of the pre-trained language models like BERT, there have also been many efforts toward adapting…

Computation and Language · Computer Science 2022-05-26 Vasu Goel , Dhruv Sahnan , Venktesh V , Gaurav Sharma , Deep Dwivedi , Mukesh Mohania

Detecting depression from social media text is still a challenging task. This is due to different language styles, informal expression, and the lack of annotated data in many languages. To tackle these issues, we propose, Semi-SMDNet, a…

Computation and Language · Computer Science 2026-01-01 Mohammad Zia Ur Rehman , Velpuru Navya , Sanskar , Shuja Uddin Qureshi , Nagendra Kumar

Aspect-Based Sentiment Analysis (ABSA) deals with the extraction of sentiments and their targets. Collecting labeled data for this task in order to help neural networks generalize better can be laborious and time-consuming. As an…

Machine Learning · Computer Science 2020-10-26 Akbar Karimi , Leonardo Rossi , Andrea Prati

In recent years, multi-label classification problem has become a controversial issue. In this kind of classification, each sample is associated with a set of class labels. Ensemble approaches are supervised learning algorithms in which an…

Machine Learning · Computer Science 2018-01-09 Amirreza Mahdavi-Shahri , Mahboobeh Houshmand , Mahdi Yaghoobi , Mehrdad Jalali

Natural language understanding (NLU) has two core tasks: intent classification and slot filling. The success of pre-training language models resulted in a significant breakthrough in the two tasks. One of the promising solutions called BERT…

Computation and Language · Computer Science 2023-02-03 Yu Guo , Zhilong Xie , Xingyan Chen , Huangen Chen , Leilei Wang , Huaming Du , Shaopeng Wei , Yu Zhao , Qing Li , Gang Wu

In today's fast-paced world, the rates of stress and depression present a surge. Social media provide assistance for the early detection of mental health conditions. Existing methods mainly introduce feature extraction approaches and train…

Computation and Language · Computer Science 2023-07-07 Loukas Ilias , Spiros Mouzakitis , Dimitris Askounis

To accelerate learning process with few samples, meta-learning resorts to prior knowledge from previous tasks. However, the inconsistent task distribution and heterogeneity is hard to be handled through a global sharing model…

Machine Learning · Computer Science 2022-06-22 Geng Li , Boyuan Ren , Hongzhi Wang

In recent years, the growing ubiquity of Internet memes on social media platforms, such as Facebook, Instagram, and Twitter, has become a topic of immense interest. However, the classification and recognition of memes is much more…

Computation and Language · Computer Science 2020-07-29 Li Yuan , Jin Wang , Xuejie Zhang

Social media has become an essential part of the modern lifestyle, with its usage being highly prevalent. This has resulted in unprecedented amounts of data generated from users in social media, such as users' attitudes, opinions,…

Computation and Language · Computer Science 2022-11-04 Mohammad Wali Ur Rahman , Sicong Shao , Pratik Satam , Salim Hariri , Chris Padilla , Zoe Taylor , Carlos Nevarez

We propose a novel two-layered attention network based on Bidirectional Long Short-Term Memory for sentiment analysis. The novel two-layered attention network takes advantage of the external knowledge bases to improve the sentiment…

Computation and Language · Computer Science 2018-06-19 Abhishek Kumar , Daisuke Kawahara , Sadao Kurohashi

Large-scale pre-trained language model such as BERT has achieved great success in language understanding tasks. However, it remains an open question how to utilize BERT for language generation. In this paper, we present a novel approach,…

Computation and Language · Computer Science 2020-07-21 Yen-Chun Chen , Zhe Gan , Yu Cheng , Jingzhou Liu , Jingjing Liu

In this article, we propose a novel probabilistic framework to improve the accuracy of a weighted majority voting algorithm. In order to assign higher weights to the classifiers which can correctly classify hard-to-classify instances, we…

Machine Learning · Statistics 2019-11-13 Ziheng Chen , Hongshik Ahn

This paper presents our approach to the third YouTube-8M video understanding competition that challenges par-ticipants to localize video-level labels at scale to the pre-cise time in the video where the label actually occurs. Ourmodel is an…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Tianqi Liu , Qizhan Shao

Recently, the automatic prediction of personality traits has received increasing attention and has emerged as a hot topic within the field of affective computing. In this work, we present a novel deep learning-based approach for automated…

Computation and Language · Computer Science 2020-10-06 Amirmohammad Kazameini , Samin Fatehi , Yash Mehta , Sauleh Eetemadi , Erik Cambria

Online shopping stores have grown steadily over the past few years. Due to the massive growth of these businesses, the detection of fake reviews has attracted attention. Fake reviews are seriously trying to mislead customers and thereby…

Computation and Language · Computer Science 2023-01-10 Abrar Qadir Mir , Furqan Yaqub Khan , Mohammad Ahsan Chishti

This project performs multimodal sentiment analysis using the CMU-MOSEI dataset, using transformer-based models with early fusion to integrate text, audio, and visual modalities. We employ BERT-based encoders for each modality, extracting…

Computation and Language · Computer Science 2025-07-16 Jugal Gajjar , Kaustik Ranaware

We present BERTweet, the first public large-scale pre-trained language model for English Tweets. Our BERTweet, having the same architecture as BERT-base (Devlin et al., 2019), is trained using the RoBERTa pre-training procedure (Liu et al.,…

Computation and Language · Computer Science 2020-10-06 Dat Quoc Nguyen , Thanh Vu , Anh Tuan Nguyen