English
Related papers

Related papers: Predicting Stock Movement with BERTweet and Transf…

200 papers

With the growing burden of training deep learning models with large data sets, transfer-learning has been widely adopted in many emerging deep learning algorithms. Transformer models such as BERT are the main player in natural language…

Cryptography and Security · Computer Science 2022-07-21 Mujahid Al Rafi , Yuan Feng , Hyeran Jeon

The content on the web is in a constant state of flux. New entities, issues, and ideas continuously emerge, while the semantics of the existing conversation topics gradually shift. In recent years, pre-trained language models like BERT…

Computation and Language · Computer Science 2021-06-14 Spurthi Amba Hombaiah , Tao Chen , Mingyang Zhang , Michael Bendersky , Marc Najork

Today, the acquisition of various behavioral log data has enabled deeper understanding of customer preferences and future behaviors in the marketing field. In particular, multimodal deep learning has achieved highly accurate predictions by…

Computational Engineering, Finance, and Science · Computer Science 2024-05-14 Junichiro Niimi

With the growth of social medias, such as Twitter, plenty of user-generated data emerge daily. The short texts published on Twitter -- the tweets -- have earned significant attention as a rich source of information to guide many…

Artificial Intelligence · Computer Science 2021-06-01 Sérgio Barreto , Ricardo Moura , Jonnathan Carvalho , Aline Paes , Alexandre Plastino

This research is aimed to solve the tweet/user geolocation prediction task and provide a flexible methodology for the geotagging of textual big data. The suggested approach implements neural networks for natural language processing (NLP) to…

Computation and Language · Computer Science 2025-01-13 Kateryna Lutsai , Christoph H. Lampert

Traditional sentiment construction in finance relies heavily on the dictionary-based approach, with a few exceptions using simple machine learning techniques such as Naive Bayes classifier. While the current literature has not yet invoked…

Statistical Finance · Quantitative Finance 2022-07-08 Joshua Zoen Git Hiew , Xin Huang , Hao Mou , Duan Li , Qi Wu , Yabo Xu

In this work, we release COVID-Twitter-BERT (CT-BERT), a transformer-based model, pretrained on a large corpus of Twitter messages on the topic of COVID-19. Our model shows a 10-30% marginal improvement compared to its base model,…

Computation and Language · Computer Science 2020-05-18 Martin Müller , Marcel Salathé , Per E Kummervold

This study explores the comparative performance of cutting-edge AI models, i.e., Finaance Bidirectional Encoder representations from Transsformers (FinBERT), Generatice Pre-trained Transformer GPT-4, and Logistic Regression, for sentiment…

Machine Learning · Computer Science 2024-12-11 Olamilekan Shobayo , Sidikat Adeyemi-Longe , Olusogo Popoola , Bayode Ogunleye

The field of NLP has seen unprecedented achievements in recent years. Most notably, with the advent of large-scale pre-trained Transformer-based language models, such as BERT, there has been a noticeable improvement in text representation.…

Computation and Language · Computer Science 2020-12-08 Lili Wang , Chongyang Gao , Jason Wei , Weicheng Ma , Ruibo Liu , Soroush Vosoughi

Social media platforms like Twitter have increasingly relied on Natural Language Processing NLP techniques to analyze and understand the sentiments expressed in the user generated content. One such state of the art NLP model is…

Computation and Language · Computer Science 2025-04-03 Akil Raj Subedi , Taniya Shah , Aswani Kumar Cherukuri , Thanos Vasilakos

Bitcoin, with its ever-growing popularity, has demonstrated extreme price volatility since its origin. This volatility, together with its decentralised nature, make Bitcoin highly subjective to speculative trading as compared to more…

Statistical Finance · Quantitative Finance 2024-06-13 Yanzhao Zou , Dorien Herremans

This paper is to explore the possibility to use alternative data and artificial intelligence techniques to trade stocks. The efficacy of the daily Twitter sentiment on predicting the stock return is examined using machine learning methods.…

Artificial Intelligence · Computer Science 2018-01-09 Catherine Xiao , Wanfeng Chen

Multimodal target/aspect sentiment classification combines multimodal sentiment analysis and aspect/target sentiment classification. The goal of the task is to combine vision and language to understand the sentiment towards a target entity…

Computation and Language · Computer Science 2021-08-09 Zaid Khan , Yun Fu

The emergence and rapid progress of the Internet have brought ever-increasing impact on financial domain. How to rapidly and accurately mine the key information from the massive negative financial texts has become one of the key issues for…

Computation and Language · Computer Science 2020-01-16 Lingyun Zhao , Lin Li , Xinhao Zheng

The proliferation of fake news and its propagation on social media has become a major concern due to its ability to create devastating impacts. Different machine learning approaches have been suggested to detect fake news. However, most of…

Computation and Language · Computer Science 2021-04-14 Junaed Younus Khan , Md. Tawkat Islam Khondaker , Sadia Afroz , Gias Uddin , Anindya Iqbal

Transformer-based models for transfer learning have the potential to achieve high prediction accuracies on text-based supervised learning tasks with relatively few training data instances. These models are thus likely to benefit social…

Computation and Language · Computer Science 2022-09-01 Sandra Wankmüller

Supervised deep learning requires large amounts of training data. In the context of the FIRE2019 Arabic irony detection shared task (IDAT@FIRE2019), we show how we mitigate this need by fine-tuning the pre-trained bidirectional encoders…

Computation and Language · Computer Science 2019-11-01 Chiyu Zhang , Muhammad Abdul-Mageed

The explosion in novel NLP word embedding and deep learning techniques has induced significant endeavors into potential applications. One of these directions is in the financial sector. Although there is a lot of work done in…

Computation and Language · Computer Science 2022-07-08 Tracy Qian , Andy Xie , Camille Bruckmann

The stock market has been a popular topic of interest in the recent past. The growth in the inflation rate has compelled people to invest in the stock and commodity markets and other areas rather than saving. Further, the ability of Deep…

Statistical Finance · Quantitative Finance 2021-07-21 Priyank Sonkiya , Vikas Bajpai , Anukriti Bansal

Experience has shown that trading in stock and cryptocurrency markets has the potential to be highly profitable. In this light, considerable effort has been recently devoted to investigate how to apply machine learning and deep learning to…

Machine Learning · Computer Science 2022-05-18 Mohammadmahdi Ghahramani , Hamid Esmaeili Najafabadi