English
Related papers

Related papers: Traditional Machine Learning Models and Bidirectio…

200 papers

The need for skilled medical support is growing in the era of digital healthcare. This research presents an innovative strategy, utilizing the RuBERT model, for categorizing user inquiries in the field of medical consultation with a focus…

The prevalence of chronic stress represents a significant public health concern, with social media platforms like Twitter serving as important venues for individuals to share their experiences. This paper introduces StressRoBERTa, a…

Computation and Language · Computer Science 2026-01-01 Amal Alqahtani , Efsun Kayi , Mona Diab

This paper describes our participation in Task 3 and Task 5 of the #SMM4H (Social Media Mining for Health) 2024 Workshop, explicitly targeting the classification challenges within tweet data. Task 3 is a multi-class classification task…

Computation and Language · Computer Science 2024-05-01 Hoang-Thang Ta , Abu Bakar Siddiqur Rahman , Lotfollah Najjar , Alexander Gelbukh

Intent classification and slot filling are two essential tasks for natural language understanding. They often suffer from small-scale human-labeled training data, resulting in poor generalization capability, especially for rare words.…

Computation and Language · Computer Science 2019-03-01 Qian Chen , Zhu Zhuo , Wen Wang

Twitter data has been shown broadly applicable for public health surveillance. Previous public health studies based on Twitter data have largely relied on keyword-matching or topic models for clustering relevant tweets. However, both…

Computation and Language · Computer Science 2019-12-04 Xiaoyi Zhang , Rodoniki Athanasiadou , Narges Razavian

Online conversations can be toxic and subjected to threats, abuse, or harassment. To identify toxic text comments, several deep learning and machine learning models have been proposed throughout the years. However, recent studies…

Machine Learning · Computer Science 2023-11-09 Md Azim Khan

In this paper, we propose Stacked DeBERT, short for Stacked Denoising Bidirectional Encoder Representations from Transformers. This novel model improves robustness in incomplete data, when compared to existing systems, by designing a novel…

Computation and Language · Computer Science 2021-01-15 Gwenaelle Cunha Sergio , Minho Lee

Personal attacks in the context of social media conversations often lead to fast-paced derailment, leading to even more harmful exchanges being made. State-of-the-art systems for the detection of such conversational derailment often make…

Computation and Language · Computer Science 2023-11-20 Steven Leung , Filippos Papapolyzos

Today, the acquisition of various behavioral log data has enabled deeper understanding of customer preferences and future behaviors in the marketing field. In particular, multimodal deep learning has achieved highly accurate predictions by…

Computational Engineering, Finance, and Science · Computer Science 2024-05-14 Junichiro Niimi

In this work, we release COVID-Twitter-BERT (CT-BERT), a transformer-based model, pretrained on a large corpus of Twitter messages on the topic of COVID-19. Our model shows a 10-30% marginal improvement compared to its base model,…

Computation and Language · Computer Science 2020-05-18 Martin Müller , Marcel Salathé , Per E Kummervold

Social media channels, such as Facebook, Twitter, and Instagram, have altered our world forever. People are now increasingly connected than ever and reveal a sort of digital persona. Although social media certainly has several remarkable…

Social and Information Networks · Computer Science 2020-08-26 Hatoon S. AlSagri , Mourad Ykhlef

Teamwork is a necessary competency for students that is often inadequately assessed. Towards providing a formative assessment of student teamwork, an automated natural language processing approach was developed to identify teamwork…

Computation and Language · Computer Science 2023-12-12 Junyoung Lee , Elizabeth Koh

Self-supervised bidirectional transformer models such as BERT have led to dramatic improvements in a wide variety of textual classification tasks. The modern digital world is increasingly multimodal, however, and textual information is…

Computation and Language · Computer Science 2020-11-13 Douwe Kiela , Suvrat Bhooshan , Hamed Firooz , Ethan Perez , Davide Testuggine

The success of bidirectional encoders using masked language models, such as BERT, on numerous natural language processing tasks has prompted researchers to attempt to incorporate these pre-trained models into neural machine translation…

Computation and Language · Computer Science 2021-09-13 Haoran Xu , Benjamin Van Durme , Kenton Murray

In Natural Language Processing, the use of pre-trained language models has been shown to obtain state-of-the-art results in many downstream tasks such as sentiment analysis, author identification and others. In this work, we address the use…

Computation and Language · Computer Science 2022-07-12 Vitor Garcia dos Santos , Ivandré Paraboni

Hate speech is a widespread and harmful form of online discourse, encompassing slurs and defamatory posts that can have serious social, psychological, and sometimes physical impacts on targeted individuals and communities. As social media…

Machine Learning · Computer Science 2025-08-08 Santosh Chapagain , Shah Muhammad Hamdi , Soukaina Filali Boubrahimi

Objective: The objective of this study is to develop a deep learning pipeline to detect signals on dietary supplement-related adverse events (DS AEs) from Twitter. Material and Methods: We obtained 247,807 tweets ranging from 2012 to 2018…

Computation and Language · Computer Science 2021-06-23 Yefeng Wang , Yunpeng Zhao , Jiang Bian , Rui Zhang

Social media may disseminate medical claims that highlight misleading correlations between social identifiers and diseases due to not accounting for structural determinants of health. Our research aims to identify biased medical claims on…

Social and Information Networks · Computer Science 2023-12-27 Libby Tiderman , Juan Sanchez Mercedes , Fiona Romanoschi , Fabricio Murai

Social media has become an essential part of the modern lifestyle, with its usage being highly prevalent. This has resulted in unprecedented amounts of data generated from users in social media, such as users' attitudes, opinions,…

Computation and Language · Computer Science 2022-11-04 Mohammad Wali Ur Rahman , Sicong Shao , Pratik Satam , Salim Hariri , Chris Padilla , Zoe Taylor , Carlos Nevarez

Users of social platforms often perceive these sites as supportive spaces to post about their mental health issues. Those conversations contain important traces about individuals' health risks. Recently, researchers have exploited this…

Computation and Language · Computer Science 2024-08-21 Eliseo Bao , Anxo Pérez , Javier Parapar