English
Related papers

Related papers: FinVault: Benchmarking Financial Agent Safety in E…

200 papers

Large language models (LLMs) have demonstrated remarkable capabilities across various professional domains, with their performance typically evaluated through standardized benchmarks. In the financial field, the stringent demands for…

Computation and Language · Computer Science 2025-09-03 Feng Wang , Yiding Sun , Jiaxin Mao , Wei Xue , Danqing Xu

With the increasing deployment of Large Language Models (LLMs) in the finance domain, LLMs are increasingly expected to parse complex regulatory disclosures. However, existing benchmarks often focus on isolated details, failing to reflect…

Computational Engineering, Finance, and Science · Computer Science 2026-02-17 Yidong Jiang , Junrong Chen , Eftychia Makri , Jialin Chen , Peiwen Li , Ali Maatouk , Leandros Tassiulas , Eliot Brenner , Bing Xiang , Rex Ying

Large language models (LLMs) introduce new security risks, but there are few comprehensive evaluation suites to measure and reduce these risks. We present BenchmarkName, a novel benchmark to quantify LLM security risks and capabilities. We…

Recent LLMs have demonstrated promising ability in solving finance related problems. However, applying LLMs in real-world finance application remains challenging due to its high risk and high stakes property. This paper introduces FinTrust,…

Machine Learning · Computer Science 2025-10-20 Tiansheng Hu , Tongyan Hu , Liuyang Bai , Yilun Zhao , Arman Cohan , Chen Zhao

The rapid evolution of Large Multimodal Models (LMMs) has enabled agents to perform complex digital and physical tasks, yet their deployment as autonomous decision-makers introduces substantial unintentional behavioral safety risks.…

Artificial Intelligence · Computer Science 2026-03-30 Yuxuan Li , Yi Lin , Peng Wang , Shiming Liu , Xuetao Wei

With the integration of large language models (LLMs), embodied agents have strong capabilities to understand and plan complicated natural language instructions. However, a foreseeable issue is that those embodied agents can also flawlessly…

Cryptography and Security · Computer Science 2025-11-03 Sheng Yin , Xianghe Pang , Yuanzhuo Ding , Menglan Chen , Yutong Bi , Yichen Xiong , Wenhao Huang , Zhen Xiang , Jing Shao , Siheng Chen

Large Language Models (LLMs) exhibit substantial promise in enhancing task-planning capabilities within embodied agents due to their advanced reasoning and comprehension. However, the systemic safety of these agents remains an underexplored…

Artificial Intelligence · Computer Science 2025-04-22 Yuting Huang , Leilei Ding , Zhipeng Tang , Tianfu Wang , Xinrui Lin , Wuyang Zhang , Mingxiao Ma , Yanyong Zhang

Large language model (LLM) agents are vulnerable to prompt-injection attacks that propagate through multi-step workflows, tool interactions, and persistent context, making input-output filtering alone insufficient for reliable protection.…

Artificial Intelligence · Computer Science 2026-04-21 Hailin Liu , Eugene Ilyushin , Jie Ni , Min Zhu

Financial AI holds great promise for transforming modern finance, with the potential to support a wide range of tasks such as market forecasting, portfolio management, quantitative trading, and automated analysis. However, existing…

Artificial Intelligence · Computer Science 2025-12-09 Wentao Zhang , Yilei Zhao , Chuqiao Zong , Xinrun Wang , Bo An

We introduce KFinEval-Pilot, a benchmark suite specifically designed to evaluate large language models (LLMs) in the Korean financial domain. Addressing the limitations of existing English-centric benchmarks, KFinEval-Pilot comprises over…

Large Language Models (LLMs) have been increasingly integrated into computer-use agents, which can autonomously operate tools on a user's computer to accomplish complex tasks. However, due to the inherently unstable and unpredictable nature…

Cryptography and Security · Computer Science 2025-09-10 Haitao Hu , Peng Chen , Yanpeng Zhao , Yuqi Chen

FinanceQA is a testing suite that evaluates LLMs' performance on complex numerical financial analysis tasks that mirror real-world investment work. Despite recent advances, current LLMs fail to meet the strict accuracy requirements of…

Machine Learning · Computer Science 2025-01-31 Spencer Mateega , Carlos Georgescu , Danny Tang

Recent advances in AI agents capable of solving complex, everyday tasks, from scheduling to customer service, have enabled deployment in real-world settings, but their possibilities for unsafe behavior demands rigorous evaluation. While…

Artificial Intelligence · Computer Science 2026-02-18 Sanidhya Vijayvargiya , Aditya Bharat Soni , Xuhui Zhou , Zora Zhiruo Wang , Nouha Dziri , Graham Neubig , Maarten Sap

Large language models (LLMs) have demonstrated notable potential in conducting complex tasks and are increasingly utilized in various financial applications. However, high-quality sequential financial investment decision-making remains…

We propose a new long-context financial benchmark, FailSafeQA, designed to test the robustness and context-awareness of LLMs against six variations in human-interface interactions in LLM-based query-answer systems within finance. We…

Computation and Language · Computer Science 2025-02-11 Kiran Kamble , Melisa Russak , Dmytro Mozolevskyi , Muayad Ali , Mateusz Russak , Waseem AlShikh

Large Language Models (LLMs) have demonstrated strong capabilities as autonomous agents through tool use, planning, and decision-making abilities, leading to their widespread adoption across diverse tasks. As task complexity grows,…

Multiagent Systems · Computer Science 2025-11-10 Ishan Kavathekar , Hemang Jain , Ameya Rathod , Ponnurangam Kumaraguru , Tanuja Ganu

Financial report generation tasks range from macro- to micro-economics analysis, also requiring extensive data analysis. Existing LLM models are usually fine-tuned on simple QA tasks and cannot comprehensively analyze real financial…

Computational Engineering, Finance, and Science · Computer Science 2025-07-15 Yingqian Wu , Qiushi Wang , Zefei Long , Rong Ye , Zhongtian Lu , Xianyin Zhang , Bingxuan Li , Wei Chen , Liwen Zhang , Zhongyu Wei

The rapid deployment of LLM-based autonomous agents has introduced safety risks that extend far beyond traditional LLM concerns, prompting a proliferation of safety benchmarks since late 2023. However, these benchmarks have developed…

Computers and Society · Computer Science 2026-05-19 Miles Q. Li , Benjamin C. M. Fung , Boyang Li , Heba Ismail , Farkhund Iqbal

Finance LLM agents must simultaneously block prompt-induced unauthorized actions and approve legitimate multi-step business workflows. However, boundary filters often miss irreversible mid-trajectory tool calls, while post-hoc LLM judges…

Computation and Language · Computer Science 2026-05-27 Haoxuan Jia , Yang Liu , Bin Chong , Yingguang Yang , Yancheng Chen , Jiayu Liang , Qian Li , Hanning Lu , Kefu Xu , Hao Zheng , Chongyang Zhang , Hao Peng , Philip S. Yu

Large Language Model (LLM) agents show considerable promise for automating complex tasks using contextual reasoning; however, interactions involving multiple agents and the system's susceptibility to prompt injection and other forms of…

Cryptography and Security · Computer Science 2025-06-02 Kaiyuan Zhang , Zian Su , Pin-Yu Chen , Elisa Bertino , Xiangyu Zhang , Ninghui Li