English
Related papers

Related papers: TweetBERT: A Pretrained Language Representation Mo…

200 papers

This paper describes a language representation model which combines the Bidirectional Encoder Representations from Transformers (BERT) learning mechanism described in Devlin et al. (2018) with a generalization of the Universal Transformer…

Computation and Language · Computer Science 2019-05-17 Alon Rozental , Zohar Kelrich , Daniel Fleischer

Our paper studies the predictability of online speech -- that is, how well language models learn to model the distribution of user generated content on X (previously Twitter). We define predictability as a measure of the model's…

Computation and Language · Computer Science 2026-01-07 Mina Remeli , Moritz Hardt , Robert C. Williamson

In the last decade, social networks became most popular medium for communication and interaction. As an example, micro-blogging service Twitter has more than 200 million registered users who exchange more than 65 million posts per day.…

Information Retrieval · Computer Science 2020-01-29 Qadri Mishael , Aladdin Ayesh

With the advancement of web technology and its growth, there is a huge volume of data present in the web for internet users and a lot of data is generated too. Internet has become a platform for online learning, exchanging ideas and sharing…

Computation and Language · Computer Science 2016-11-04 Vishal. A. Kharde , Prof. Sheetal. Sonawane

Twitter as a new form of social media potentially contains useful information that opens new opportunities for content analysis on tweets. This paper examines the predictive power of Twitter regarding the US presidential election of 2012.…

Social and Information Networks · Computer Science 2014-07-03 Kazem Jahanbakhsh , Yumi Moon

The widespread use of text-based communication on social media-through chats, comments, and microblogs-has improved user interaction but has also led to an increase in offensive content, including hate speech, racism, and other forms of…

Computation and Language · Computer Science 2025-06-30 Reem Alothman , Hafida Benhidour , Said Kerrache

Pre-trained transformer models shine in many natural language processing tasks and therefore are expected to bear the representation of the input sentence or text meaning. These sentence-level embeddings are also important in…

Computation and Language · Computer Science 2025-02-21 Lukas Stankevičius , Mantas Lukoševičius

Text-based personality prediction by computational models is an emerging field with the potential to significantly improve on key weaknesses of survey-based personality assessment. We investigate 3848 profiles from Twitter with self-labeled…

Computation and Language · Computer Science 2021-09-15 Partha Kadambi

Artificial intelligence and machine learning have significantly bolstered the technological world. This paper explores the potential of transfer learning in natural language processing focusing mainly on sentiment analysis. The models…

Computation and Language · Computer Science 2023-11-29 Aman Yadav , Abhishek Vichare

Obtaining large-scale annotated data for NLP tasks in the scientific domain is challenging and expensive. We release SciBERT, a pretrained language model based on BERT (Devlin et al., 2018) to address the lack of high-quality, large-scale…

Computation and Language · Computer Science 2019-09-12 Iz Beltagy , Kyle Lo , Arman Cohan

Predictive analysis of social media data has attracted considerable attention from the research community as well as the business world because of the essential and actionable information it can provide. Over the years, extensive…

Social and Information Networks · Computer Science 2023-09-04 Ugur Kursuncu , Manas Gaur , Usha Lokala , Krishnaprasad Thirunarayan , Amit Sheth , I. Budak Arpinar

Social networking services have became an important communication channel in time of emergency. The aim of this study is to create a machine learning language model that is able to investigate if a person or area was in danger or not. The…

Computation and Language · Computer Science 2022-02-03 Anh Duc Le

Over the recent years, large pretrained language models (LM) have revolutionized the field of natural language processing (NLP). However, while pretraining on general language has been shown to work very well for common language, it has…

Computation and Language · Computer Science 2022-12-20 Nicolas Webersinke , Mathias Kraus , Julia Anna Bingler , Markus Leippold

Research in social media analysis is experiencing a recent surge with a large number of works applying representation learning models to solve high-level syntactico-semantic tasks such as sentiment analysis, semantic textual similarity…

Computation and Language · Computer Science 2016-11-16 J Ganesh , Manish Gupta , Vasudeva Varma

This study investigates Machine Learning (ML) in the prediction of emojis in Arabic tweets employing the (state-of-the-art) MARBERT model. A corpus of 11379 CA tweets representing multiple Arabic colloquial dialects was collected from X.com…

Computation and Language · Computer Science 2026-04-27 Mohammed Q. Shormani , Ibrahim Abdulmalik Hassan Muneef Y. Alshawsh

Much information available to applied researchers is contained within written language or spoken text. Deep language models such as BERT have achieved unprecedented success in many applications of computational linguistics. However, much…

Computation and Language · Computer Science 2022-06-07 Ingo Marquart

Social media user profiling through content analysis is crucial for tasks like misinformation detection, engagement prediction, hate speech monitoring, and user behavior modeling. However, existing profiling techniques, including tweet…

Social and Information Networks · Computer Science 2025-05-12 Vahid Rahimzadeh , Ali Hamzehpour , Azadeh Shakery , Masoud Asadpour

The social media network phenomenon leads to a massive amount of valuable data that is available online and easy to access. Many users share images, videos, comments, reviews, news and opinions on different social networks sites, with…

Computation and Language · Computer Science 2017-11-02 Abdulaziz M. Alayba , Vasile Palade , Matthew England , Rahat Iqbal

The need for a comprehensive study to explore various aspects of online social media has been instigated by many researchers. This paper gives an insight into the social platform, Twitter. In this present work, we have illustrated stepwise…

Social and Information Networks · Computer Science 2021-05-24 Shahab Saquib Sohail , Mohammad Muzammil Khan , M. Afshar Alam

Misinformation spread over social media has become an undeniable infodemic. However, not all spreading claims are made equal. If propagated, some claims can be destructive, not only on the individual level, but to organizations and even…

Computation and Language · Computer Science 2022-11-10 Maram Hasanain , Tamer Elsayed