English
Related papers

Related papers: FinForge: Semi-Synthetic Financial Benchmark Gener…

200 papers

Large language models (LLMs) often produce unsupported or unverifiable content, known as "hallucinations." To mitigate this, retrieval-augmented LLMs incorporate citations, grounding the content in verifiable sources. Despite such…

Information Retrieval · Computer Science 2024-08-26 Weijia Zhang , Mohammad Aliannejadi , Yifei Yuan , Jiahuan Pei , Jia-Hong Huang , Evangelos Kanoulas

Current evaluations of mathematical reasoning in large language models (LLMs) are dominated by static benchmarks, either derived from competition-style problems or curated through costly expert effort, resulting in limited coverage of…

Computation and Language · Computer Science 2026-05-08 Jicheng Ma , Guohua Wang , Xinhua Feng , Yiming Liu , Zhichao Hu , Yuhong Liu

Large language models (LLMs) have demonstrated strong performance on function-level code generation benchmarks, yet real-world software development increasingly demands class-level implementations that integrate multiple methods,…

Software Engineering · Computer Science 2025-11-06 Musfiqur Rahman , SayedHassan Khatoonabadi , Emad Shihab

This paper investigates the application of large language models (LLMs) to financial tasks. We fine-tuned foundation models using the Open FinLLM Leaderboard as a benchmark. Building on Qwen2.5 and Deepseek-R1, we employed techniques…

Computation and Language · Computer Science 2025-04-18 Varun Rao , Youran Sun , Mahendra Kumar , Tejas Mutneja , Agastya Mukherjee , Haizhao Yang

As a seemingly self-explanatory task, problem-solving has been a significant component of science and engineering. However, a general yet concrete formulation of problem-solving itself is missing. With the recent development of AI-based…

Artificial Intelligence · Computer Science 2025-05-08 Qi Liu , Xinhao Zheng , Renqiu Xia , Xingzhi Qi , Qinxiang Cao , Junchi Yan

Recent smaller language models such Phi-3.5 and Phi-4 rely on synthetic data generated using larger Language models. Questions remain about leveraging synthetic data for other use cases, such as adapting LLMs to specific domains. A key…

Computation and Language · Computer Science 2025-11-06 Haris Riaz , Sourav Bhabesh , Vinayak Arannil , Miguel Ballesteros , Graham Horwood

The proliferation of financial misinformation poses a severe threat to market stability and investor trust, misleading market behavior and creating critical information asymmetry. Detecting such misleading narratives is inherently…

Computation and Language · Computer Science 2026-05-27 Cuong Hoang , Le-Minh Nguyen

Language Models (LMs) continue to advance, improving response quality and coherence. Given Internet-scale training datasets, LMs have likely encountered much of what users may ask them to generate in some form during their training. A…

Artificial Intelligence · Computer Science 2026-01-27 Michael Majurski , Cynthia Matuszek

This paper presents the system description of our entry for the COLING 2025 FMD challenge, focusing on misinformation detection in financial domains. We experimented with a combination of large language models, including Qwen, Mistral, and…

Computation and Language · Computer Science 2024-12-03 Jebish Purbey , Siddhant Gupta , Nikhil Manali , Siddartha Pullakhandam , Drishti Sharma , Ashay Srivastava , Ram Mohan Rao Kadiyala

Financial markets face growing threats from misinformation that can trigger billions in losses in minutes. Most existing approaches lack transparency in their decision-making and provide limited attribution to credible sources. We introduce…

Information Retrieval · Computer Science 2025-11-19 Daniel Berhane Araya , Duoduo Liao

Financial risk prediction plays a crucial role in the financial sector. Machine learning methods have been widely applied for automatically detecting potential risks and thus saving the cost of labor. However, the development in this field…

Risk Management · Quantitative Finance 2023-08-02 Yuwei Yin , Yazheng Yang , Jian Yang , Qi Liu

Finance decision-making often relies on in-depth data analysis across various data sources, including financial tables, news articles, stock prices, etc. In this work, we introduce FinTMMBench, the first comprehensive benchmark for…

Computational Finance · Quantitative Finance 2025-08-05 Fengbin Zhu , Junfeng Li , Liangming Pan , Wenjie Wang , Fuli Feng , Chao Wang , Huanbo Luan , Tat-Seng Chua

As the fundamental capability behind decision-making in finance, financial reasoning poses distinct challenges for LLMs. Although reinforcement learning (RL) have boosted generic reasoning, the progress in finance is hindered by the absence…

Computation and Language · Computer Science 2025-06-17 Lingfei Qian , Weipeng Zhou , Yan Wang , Xueqing Peng , Han Yi , Yilun Zhao , Jimin Huang , Qianqian Xie , Jian-yun Nie

Financial disclosures such as 10-K filings present challenging retrieval problems due to their length, regulatory section hierarchy, and domain-specific language, which standard retrieval-augmented generation (RAG) models underuse. We…

Computational Engineering, Finance, and Science · Computer Science 2025-09-16 Ying Li , Mengyu Wang , Miguel de Carvalho , Sotirios Sabanis , Tiejun Ma

Large language models (LLMs) often hallucinate, yet most existing fact-checking methods treat factuality evaluation as a binary classification problem, offering limited interpretability and failing to capture fine-grained error types. In…

Computation and Language · Computer Science 2026-01-13 Yuzhuo Bai , Shuzheng Si , Kangyang Luo , Qingyi Wang , Wenhao Li , Gang Chen , Fanchao Qi , Maosong Sun

Large Language Models (LLMs) frequently hallucinate to long-form questions, producing plausible yet factually incorrect answers. A common mitigation strategy is to provide attribution to LLM outputs. However, existing benchmarks primarily…

Computation and Language · Computer Science 2025-10-09 Yitao Long , Tiansheng Hu , Yilun Zhao , Arman Cohan , Chen Zhao

Financial decision-making in multilingual settings demands accurate numerical reasoning grounded in diverse modalities, yet existing benchmarks largely overlook this high-stakes, real-world challenge, especially for Indic languages. We…

Computation and Language · Computer Science 2026-05-14 Sarmistha Das , Vaibhav Vishal , Syed Ibrahim Ahmad , Manish Gupta , Sriparna Saha

Benchmarks are the de facto standard for tracking progress in large language models (LLMs), yet static test sets can rapidly saturate, become vulnerable to contamination, and are costly to refresh. Scalable evaluation of open-ended items…

Computation and Language · Computer Science 2026-03-24 Yandan Zheng , Haoran Luo , Zhenghong Lin , Wenjin Liu , Luu Anh Tuan

Large language models (LLMs) excel at generating human-like responses but often struggle with interactive tasks that require access to real-time information. This limitation poses challenges in finance, where models must access up-to-date…

Information Retrieval · Computer Science 2026-03-02 Ankur Sinha , Chaitanya Agarwal , Pekka Malo

Financial sentiment analysis plays a crucial role in uncovering latent patterns and detecting emerging trends, enabling individuals to make well-informed decisions that may yield substantial advantages within the constantly changing realm…

Machine Learning · Computer Science 2023-12-15 Sorouralsadat Fatemi , Yuheng Hu