English
Related papers

Related papers: Enhancing TinyBERT for Financial Sentiment Analysi…

200 papers

Many organizations lack computational resources to fine-tune large language models (LLMs) on private (unshareable) data for better utility, while fine-tuning tiny language models (TinyLMs) alone performs poorly. To address this bottleneck,…

Machine Learning · Computer Science 2026-05-28 Binh-Nguyen Nguyen , Khang Tran , NhatHai Phan , Issa Khalil

This paper investigates the role of expert-designed hint in enhancing sentiment analysis on financial social media posts. We explore the capability of large language models (LLMs) to empathize with writer perspectives and analyze…

Computation and Language · Computer Science 2024-09-27 Chung-Chi Chen , Hiroya Takamura , Ichiro Kobayashi , Yusuke Miyao

In the past decade, there has been much discussion about the issue of biased reporting in clinical research. Despite this attention, there have been limited tools developed for the systematic assessment of qualitative statements made in…

Computation and Language · Computer Science 2021-06-02 Joshua J Myszewski , Emily Klossowski , Patrick Meyer , Kristin Bevil , Lisa Klesius , Kristopher M Schroeder

The challenge of reducing the size of Large Language Models (LLMs) while maintaining their performance has gained significant attention. However, existing methods, such as model distillation and transfer learning, often fail to achieve high…

The rapid expansion of the digital world has propelled sentiment analysis into a critical tool across diverse sectors such as marketing, politics, customer service, and healthcare. While there have been significant advancements in sentiment…

Computation and Language · Computer Science 2024-04-08 Md. Arid Hasan , Shudipta Das , Afiyat Anjum , Firoj Alam , Anika Anjum , Avijit Sarker , Sheak Rashed Haider Noori

Crude oil, a critical component of the global economy, has its prices influenced by various factors such as economic trends, political events, and natural disasters. Traditional prediction methods based on historical data have their limits…

Information Retrieval · Computer Science 2024-10-17 Himmet Kaplan , Ralf-Peter Mundani , Heiko Rölke , Albert Weichselbraun , Martin Tschudy

Natural Language Processing (NLP) has transformed the financial industry, enabling advancements in areas such as textual analysis, risk management, and forecasting. Large language models (LLMs) like BloombergGPT and FinMA have set new…

Computation and Language · Computer Science 2025-12-08 Jawad Ibn Ahad , Muhammad Rafsan Kabir , Robin Krambroeckers , Sifat Momen , Nabeel Mohammed , Shafin Rahman

This paper studies the efficiency of transferring BERT learnings to low complexity models like BiLSTM, BiLSTM with attention and shallow CNNs using sentiment analysis on SST-2 dataset. It also compares the complexity of inference of the…

Computation and Language · Computer Science 2021-05-17 Bansidhar Mangalwedhekar

Most existing methods focus on sentiment analysis of textual data. However, recently there has been a massive use of images and videos on social platforms, motivating sentiment analysis from other modalities. Current studies show that…

Machine Learning · Computer Science 2022-10-13 Guilherme Lourenço de Toledo , Ricardo Marcondes Marcacini

While Large Language Models (LLMs) can accelerate text-heavy tasks in alternative investment due diligence, a gap remains in their ability to accurately extract and reason over structured tabular data from complex financial spreadsheets.…

Artificial Intelligence · Computer Science 2026-03-10 Jan Ravnik , Matjaž Ličen , Felix Bührmann , Bithiah Yuan , Felix Stinson , Tanvi Singh

Understanding emotions in the Indonesian language is essential for improving customer experiences in e-commerce. This study focuses on enhancing the accuracy of emotion classification in Indonesian by leveraging advanced language models,…

Computation and Language · Computer Science 2025-09-19 William Christian , Daniel Adamlu , Adrian Yu , Derwin Suhartono

LLMs have transformed NLP and shown promise in various fields, yet their potential in finance is underexplored due to a lack of comprehensive evaluation benchmarks, the rapid development of LLMs, and the complexity of financial tasks. In…

Large Language Models (LLMs), such as GPT-4 and Llama 2, show remarkable proficiency in a wide range of natural language processing (NLP) tasks. Despite their effectiveness, the high costs associated with their use pose a challenge. We…

Computation and Language · Computer Science 2024-03-26 Bálint Csanády , Lajos Muzsai , Péter Vedres , Zoltán Nádasdy , András Lukács

Large language models (LLMs), such as GPT-4, have demonstrated remarkable capabilities across a wide range of tasks, including health applications. In this paper, we study how LLMs can be used to scale biomedical knowledge curation. We find…

While pre-training and fine-tuning, e.g., BERT~\citep{devlin2018bert}, GPT-2~\citep{radford2019language}, have achieved great success in language understanding and generation tasks, the pre-trained models are usually too big for online…

Computation and Language · Computer Science 2020-04-28 Kaitao Song , Hao Sun , Xu Tan , Tao Qin , Jianfeng Lu , Hongzhi Liu , Tie-Yan Liu

This research develops a sentiment-driven quantitative trading system that leverages a large language model, FinGPT, for sentiment analysis, and explores a novel method for signal integration using a reinforcement learning algorithm, Twin…

Computational Finance · Quantitative Finance 2025-10-14 Wo Long , Wenxin Zeng , Xiaoyu Zhang , Ziyao Zhou

Named entity recognition (NER) is a fundamental task in numerous downstream applications. Recently, researchers have employed pre-trained language models (PLMs) and large language models (LLMs) to address this task. However, fully…

Computation and Language · Computer Science 2025-10-30 Yufei Zhao , Xiaoshi Zhong , Erik Cambria , Jagath C. Rajapakse

Financial sentiment analysis allows financial institutions like Banks and Insurance Companies to better manage the credit scoring of their customers in a better way. Financial domain uses specialized mechanisms which makes sentiment…

Computation and Language · Computer Science 2024-05-06 Tohida Rehman , Raghubir Bose , Samiran Chattopadhyay , Debarshi Kumar Sanyal

Running large-scale pre-trained language models in computationally constrained environments remains a challenging problem yet to be addressed, while transfer learning from these models has become prevalent in Natural Language Processing…

Computation and Language · Computer Science 2022-04-14 Andrei-Marius Avram , Darius Catrina , Dumitru-Clementin Cercel , Mihai Dascălu , Traian Rebedea , Vasile Păiş , Dan Tufiş

Although pre-trained language models (PLMs) have achieved state-of-the-art performance on various natural language processing (NLP) tasks, they are shown to be lacking in knowledge when dealing with knowledge driven tasks. Despite the many…

Computation and Language · Computer Science 2022-08-02 Qianglong Chen , Feng-Lin Li , Guohai Xu , Ming Yan , Ji Zhang , Yin Zhang