中文
相关论文

相关论文: Traditional Machine Learning Models and Bidirectio…

200 篇论文

We present a transformer-based sarcasm detection model that accounts for the context from the entire conversation thread for more robust predictions. Our model uses deep transformer layers to perform multi-head attentions among the target…

计算与语言 · 计算机科学 2020-05-26 Xiangjue Dong , Changmao Li , Jinho D. Choi

Nowadays, topic classification from tweets attracts considerable research attention. Different classification systems have been suggested thanks to these research efforts. Nevertheless, they face major challenges owing to low performance…

计算与语言 · 计算机科学 2024-07-04 Kheir Eddine Daouadi , Yaakoub Boualleg , Oussama Guehairia

Due to massive adoption of social media, detection of users' depression through social media analytics bears significant importance, particularly for underrepresented languages, such as Bangla. This study introduces a well-grounded approach…

计算与语言 · 计算机科学 2024-07-15 Saad Ahmed Sazan , Mahdi H. Miraz , A B M Muntasir Rahman

During the last two decades, we have progressively turned to the Internet and social media to find news, entertain conversations and share opinion. Recently, OpenAI has developed a ma-chine learning system called GPT-2 for Generative…

计算与语言 · 计算机科学 2021-01-26 Fouzi Harrag , Maria Debbah , Kareem Darwish , Ahmed Abdelali

Classification of crisis events, such as natural disasters, terrorist attacks and pandemics, is a crucial task to create early signals and inform relevant parties for spontaneous actions to reduce overall damage. Despite crisis such as…

计算与语言 · 计算机科学 2020-05-19 Junhua Liu , Trisha Singhal , Lucienne T. M. Blessing , Kristin L. Wood , Kwan Hui Lim

Objective: Leveraging machine learning methods, we aim to extract both explicit and implicit cause-effect associations in patient-reported, diabetes-related tweets and provide a tool to better understand opinion, feelings and observations…

Transfer learning has been widely used in natural language processing through deep pretrained language models, such as Bidirectional Encoder Representations from Transformers and Universal Sentence Encoder. Despite the great success,…

信息检索 · 计算机科学 2022-06-15 Maryam Hasan , Elke Rundensteiner , Emmanuel Agu

The bidirectional encoder representations from transformers (BERT) model has recently advanced the state-of-the-art in passage re-ranking. In this paper, we analyze the results produced by a fine-tuned BERT model to better understand the…

信息检索 · 计算机科学 2019-05-07 Harshith Padigela , Hamed Zamani , W. Bruce Croft

Depression detection from user-generated content on the internet has been a long-lasting topic of interest in the research community, providing valuable screening tools for psychologists. The ubiquitous use of social media platforms lays…

计算与语言 · 计算机科学 2023-02-07 Ana-Maria Bucur , Adrian Cosma , Paolo Rosso , Liviu P. Dinu

Pretrained contextualized text representation models learn an effective representation of a natural language to make it machine understandable. After the breakthrough of the attention mechanism, a new generation of pretrained models have…

This paper presents a transformer-based approach for classifying hope expressions in text. We developed and compared three architectures (BERT, GPT-2, and DeBERTa) for both binary classification (Hope vs. Not Hope) and multiclass…

计算与语言 · 计算机科学 2025-11-18 Chukwuebuka Fortunate Ijezue , Tania-Amanda Fredrick Eneye , Maaz Amjad

Purpose: Our study explored the use of artificial intelligence (AI) to diagnose autism spectrum disorder (ASD). It focused on machine learning (ML) and deep learning (DL) to detect ASD from text inputs on social media, addressing challenges…

Identifying feature requests and bug reports in user comments holds great potential for development teams. However, automated mining of RE-related information from social media and app stores is challenging since (1) about 70% of user…

计算与语言 · 计算机科学 2021-08-03 Pablo Restrepo Henao , Jannik Fischbach , Dominik Spies , Julian Frattini , Andreas Vogelsang

Speech-based algorithms have gained interest for the management of behavioral health conditions such as depression. We explore a speech-based transfer learning approach that uses a lightweight encoder and that transfers only the encoder…

音频与语音处理 · 电气工程与系统科学 2024-12-30 Amir Harati , Elizabeth Shriberg , Tomasz Rutowski , Piotr Chlebek , Yang Lu , Ricardo Oliveira

Social media currently provide a window on our lives, making it possible to learn how people from different places, with different backgrounds, ages, and genders use language. In this work we exploit a newly-created Arabic dataset with…

计算与语言 · 计算机科学 2019-11-05 Muhammad Abdul-Mageed , Chiyu Zhang , Arun Rajendran , AbdelRahim Elmadany , Michael Przystupa , Lyle Ungar

In the recent past, social media platforms have helped people in connecting and communicating to a wider audience. But this has also led to a drastic increase in cyberbullying. It is essential to detect and curb hate speech to keep the…

计算与语言 · 计算机科学 2021-11-02 Ravindra Nayak , Raviraj Joshi

Undoubtedly that the Bidirectional Encoder representations from Transformers is the most powerful technique in making Natural Language Processing tasks such as Named Entity Recognition, Question & Answers or Sentiment Analysis, however, the…

计算与语言 · 计算机科学 2023-12-14 Ibrahim Bouabdallaoui , Fatima Guerouate , Samya Bouhaddour , Chaimae Saadi , Mohammed Sbihi

This research investigates the performance of various machine learning algorithms (CNN, LSTM, VADER, and RoBERTa) for sentiment analysis of Twitter data related to imported food items in Trinidad and Tobago. The study addresses three…

计算与语言 · 计算机科学 2024-12-30 Cassandra Daniels , Koffka Khan

Recent years have witnessed a substantial increase in the use of deep learning to solve various natural language processing (NLP) problems. Early deep learning models were constrained by their sequential or unidirectional nature, such that…

This project explores emoji prediction from short text sequences using four deep learning architectures: a feed-forward network, CNN, transformer, and BERT. Using the TweetEval dataset, we address class imbalance through focal loss and…

计算与语言 · 计算机科学 2025-08-15 Ethan Gordon , Nishank Kuppa , Rigved Tummala , Sriram Anasuri