English
Related papers

Related papers: A Novel DeBERTa-based Model for Financial Question…

200 papers

Recent progress in pre-trained neural language models has significantly improved the performance of many natural language processing (NLP) tasks. In this paper we propose a new model architecture DeBERTa (Decoding-enhanced BERT with…

Computation and Language · Computer Science 2021-10-08 Pengcheng He , Xiaodong Liu , Jianfeng Gao , Weizhu Chen

Recent advancements in transformer-based language models have sparked research into their logical reasoning capabilities. Most of the benchmarks used to evaluate these models are simple: generated from short (fragments of) first-order logic…

Computation and Language · Computer Science 2024-10-15 Angelos Poulis , Eleni Tsalapati , Manolis Koubarakis

Financial decision-making in multilingual settings demands accurate numerical reasoning grounded in diverse modalities, yet existing benchmarks largely overlook this high-stakes, real-world challenge, especially for Indic languages. We…

Computation and Language · Computer Science 2026-05-14 Sarmistha Das , Vaibhav Vishal , Syed Ibrahim Ahmad , Manish Gupta , Sriparna Saha

Recent advancements in transformer-based models have initiated research interests in investigating their ability to learn to perform reasoning tasks. However, most of the contexts used for this purpose are in practice very simple: generated…

Computation and Language · Computer Science 2024-04-29 Angelos Poulis , Eleni Tsalapati , Manolis Koubarakis

The proliferation of artificial intelligence (AI) in financial services has prompted growing demand for tools that can systematically detect AI-related disclosures in corporate filings. While prior approaches often rely on keyword expansion…

Computational Finance · Quantitative Finance 2025-07-04 Muhammad Bilal Zafar

Financial sentiment analysis is a challenging task due to the specialized language and lack of labeled data in that domain. General-purpose models are not effective enough because of the specialized language used in a financial context. We…

Computation and Language · Computer Science 2019-08-28 Dogu Araci

In this paper, we introduce FAMMA, an open-source benchmark for \underline{f}in\underline{a}ncial \underline{m}ultilingual \underline{m}ultimodal question \underline{a}nswering (QA). Our benchmark aims to evaluate the abilities of large…

Computation and Language · Computer Science 2025-05-16 Siqiao Xue , Xiaojing Li , Fan Zhou , Qingyang Dai , Zhixuan Chu , Hongyuan Mei

Accurate and transparent financial information disclosure is essential for market efficiency, investor decision-making, and corporate governance. Chinese stock exchanges' investor interactive platforms provide a widely used channel through…

Computation and Language · Computer Science 2026-04-10 Peilin Zhou , Ziyue Xu , Xinyu Shi , Jiageng Wu , Yikang Jiang , Dading Chong , Wang Dong , Jun Chen , Bin Ke , Jie Yang

Traditional approaches to estimating beta in finance often involve rigid assumptions and fail to adequately capture beta dynamics, limiting their effectiveness in use cases like hedging. To address these limitations, we have developed a…

Statistical Finance · Quantitative Finance 2024-10-29 Yuxin Liu , Jimin Lin , Achintya Gopal

Existing literature on Question Answering (QA) mostly focuses on algorithmic novelty, data augmentation, or increasingly large pre-trained language models like XLNet and RoBERTa. Additionally, a lot of systems on the QA leaderboards do not…

Computation and Language · Computer Science 2019-09-13 Lin Pan , Rishav Chakravarti , Anthony Ferritto , Michael Glass , Alfio Gliozzo , Salim Roukos , Radu Florian , Avirup Sil

In recent years, general-purpose large language models (LLMs) such as GPT, Gemini, Claude, and DeepSeek have advanced at an unprecedented pace. Despite these achievements, their application to finance remains challenging, due to fragmented…

Recent research has shown that smaller language models can acquire substantial reasoning abilities when fine-tuned with reasoning exemplars crafted by a significantly larger teacher model. We explore this paradigm for the financial domain,…

Computation and Language · Computer Science 2024-08-23 Karmvir Singh Phogat , Sai Akhil Puranam , Sridhar Dasaratha , Chetan Harsha , Shashishekar Ramakrishna

Financial reports offer critical insights into a company's operations, yet their extensive length typically spanning 30 40 pages poses challenges for swift decision making in dynamic markets. To address this, we leveraged finetuned Large…

Computation and Language · Computer Science 2023-12-25 Abhinav Arun , Ashish Dhiman , Mehul Soni , Yibei Hu

Natural Language Query (NLQ) allows users to search and interact with information systems using plain, human language instead of structured query syntax. This paper presents a technical blueprint on the design of a modern NLQ system…

Information Retrieval · Computer Science 2026-01-27 Lalit Pant , Shivang Nagar

Answering questions within business and finance requires reasoning, precision, and a wide-breadth of technical knowledge. Together, these requirements make this domain difficult for large language models (LLMs). We introduce BizBench, a…

Computation and Language · Computer Science 2024-03-13 Rik Koncel-Kedziorski , Michael Krumdick , Viet Lai , Varshini Reddy , Charles Lovering , Chris Tanner

Financial document question answering (QA) demands complex multi-step numerical reasoning over heterogeneous evidence--structured tables, textual narratives, and footnotes--scattered across corporate filings. Existing retrieval-augmented…

Artificial Intelligence · Computer Science 2026-05-08 Yang Shu , Yingmin Liu , Zequn Xie

This study investigates an explainable reasoning method for financial decision-making based on knowledge-enhanced large language model agents. To address the limitations of traditional financial decision methods that rely on parameterized…

Computation and Language · Computer Science 2025-12-11 Qingyuan Zhang , Yuxi Wang , Cancan Hua , Yulin Huang , Ning Lyu

Question Answering (QA) is a task in natural language processing that has seen considerable growth after the advent of transformers. There has been a surge in QA datasets that have been proposed to challenge natural language processing…

Computation and Language · Computer Science 2021-10-08 Kate Pearce , Tiffany Zhan , Aneesh Komanduri , Justin Zhan

For large language models (LLMs) to be effective in the financial domain -- where each decision can have a significant impact -- it is necessary to investigate realistic tasks and data. Financial professionals often interact with documents…

Computation and Language · Computer Science 2025-10-28 Varshini Reddy , Rik Koncel-Kedziorski , Viet Dac Lai , Michael Krumdick , Charles Lovering , Chris Tanner

While Large Language Models (LLMs) have shown impressive capabilities in numerous Natural Language Processing (NLP) tasks, they still struggle with financial question answering (QA), particularly when numerical reasoning is required.…

Computation and Language · Computer Science 2024-10-30 Sorouralsadat Fatemi , Yuheng Hu