English
Related papers

Related papers: Is ChatGPT a Financial Expert? Evaluating Language…

200 papers

With the rapid evolution of Natural Language Processing (NLP), Large Language Models (LLMs) like ChatGPT have emerged as powerful tools capable of transforming various sectors. Their vast knowledge base and dynamic interaction capabilities…

Computers and Society · Computer Science 2024-01-02 Kevin Wang , Jason Ramos , Ramon Lawrence

Developing high-performing dialogue systems benefits from the automatic identification of undesirable behaviors in system responses. However, detecting such behaviors remains challenging, as it draws on a breadth of general knowledge and…

Computation and Language · Computer Science 2023-09-14 Sarah E. Finch , Ellie S. Paek , Jinho D. Choi

$\textbf{Objectives}$: Large Language Models (LLMs) such as ChatGPT and Med-PaLM have excelled in various medical question-answering tasks. However, these English-centric models encounter challenges in non-English clinical settings,…

Computation and Language · Computer Science 2024-01-31 Jiageng Wu , Xian Wu , Zhaopeng Qiu , Minghui Li , Yingying Zhang , Yefeng Zheng , Changzheng Yuan , Jie Yang

This paper investigates the performance of the Large Language Models (LLMs) ChatGPT-3.5 and GPT-4 in solving introductory programming tasks. Based on the performance, implications for didactic scenarios and assessment formats utilizing LLMs…

Software Engineering · Computer Science 2023-08-21 Natalie Kiesler , Daniel Schiffner

Large language models (LLMs) have significantly advanced Natural Language Processing (NLP) tasks in recent years. However, their universal nature poses limitations in scenarios requiring personalized responses, such as recommendation…

Computation and Language · Computer Science 2024-11-08 Stanisław Woźniak , Bartłomiej Koptyra , Arkadiusz Janz , Przemysław Kazienko , Jan Kocoń

Large language models (LLMs) have demonstrated remarkable potential in handling multilingual machine translation (MMT). In this paper, we systematically investigate the advantages and challenges of LLMs for MMT by answering two questions:…

Computation and Language · Computer Science 2024-06-17 Wenhao Zhu , Hongyi Liu , Qingxiu Dong , Jingjing Xu , Shujian Huang , Lingpeng Kong , Jiajun Chen , Lei Li

Trading is a highly competitive task that requires a combination of strategy, knowledge, and psychological fortitude. With the recent success of large language models(LLMs), it is appealing to apply the emerging intelligence of LLM agents…

Trading and Market Microstructure · Quantitative Finance 2026-03-03 Han Ding , Yinheng Li , Junhao Wang , Hang Chen , Doudou Guo , Yunbai Zhang

Large Language Models (LLMs) generate responses to questions; however, their effectiveness is often hindered by sub-optimal quality of answers and occasional failures to provide accurate responses to questions. To address these challenges,…

Computation and Language · Computer Science 2024-02-06 Liang Zhang , Katherine Jijo , Spurthi Setty , Eden Chung , Fatima Javid , Natan Vidra , Tommy Clifford

Large Language Models (LLMs) have shown great potential in solving complex problems in various fields, including oil and gas engineering and other industrial engineering disciplines like factory automation, PLC programming etc. However,…

Computation and Language · Computer Science 2023-04-28 Oluwatosin Ogundare , Srinath Madasu , Nathanial Wiggins

Large Language Models (LLMs) have recently been leveraged for asset pricing tasks and stock trading applications, enabling AI agents to generate investment decisions from unstructured financial data. However, most evaluations of LLM…

Trading and Market Microstructure · Quantitative Finance 2026-05-26 Weixian Waylon Li , Hyeonjun Kim , Mihai Cucuringu , Tiejun Ma

Large Language Models (LLMs) have garnered considerable interest within both academic and industrial. Yet, the application of LLMs to graph data remains under-explored. In this study, we evaluate the capabilities of four LLMs in addressing…

Artificial Intelligence · Computer Science 2023-09-12 Chang Liu , Bo Wu

Large language models (LLMs) have become powerful tools for advancing natural language processing applications in the financial industry. However, existing financial LLMs often face challenges such as hallucinations or superficial parameter…

Computation and Language · Computer Science 2024-08-06 Shujuan Zhao , Lingfeng Qiao , Kangyang Luo , Qian-Wen Zhang , Junru Lu , Di Yin

Financial risk prediction plays a crucial role in the financial sector. Machine learning methods have been widely applied for automatically detecting potential risks and thus saving the cost of labor. However, the development in this field…

Risk Management · Quantitative Finance 2023-08-02 Yuwei Yin , Yazheng Yang , Jian Yang , Qi Liu

Large Language Models (LLMs) hold immense promise for revolutionizing financial analysis and decision-making, yet their direct application is often hampered by issues of data hallucination and lack of access to real-time, verifiable…

Computational Engineering, Finance, and Science · Computer Science 2025-06-13 Yifan Zeng

Large Language Models (LLMs) are reshaping consumer decision-making, particularly in communication with firms, yet our understanding of their impact remains limited. This research explores the effect of LLMs on consumer complaints submitted…

Human-Computer Interaction · Computer Science 2025-02-17 Minkyu Shin , Jin Kim , Jiwoong Shin

Nowadays, pretrained language models (PLMs) have dominated the majority of NLP tasks. While, little research has been conducted on systematically evaluating the language abilities of PLMs. In this paper, we present a large-scale empirical…

Computation and Language · Computer Science 2022-05-04 Junyi Li , Tianyi Tang , Zheng Gong , Lixin Yang , Zhuohao Yu , Zhipeng Chen , Jingyuan Wang , Wayne Xin Zhao , Ji-Rong Wen

Large Language Models (LLMs) could be a useful tool for lawyers. However, empirical research on their effectiveness in conducting legal tasks is scant. We study securities cases involving cryptocurrencies as one of numerous contexts where…

Artificial Intelligence · Computer Science 2024-02-23 Arianna Trozze , Toby Davies , Bennett Kleinberg

Automatic evaluation is an integral aspect of dialogue system research. The traditional reference-based NLG metrics are generally found to be unsuitable for dialogue assessment. Consequently, recent studies have suggested various unique,…

Computation and Language · Computer Science 2024-01-23 Chen Zhang , Luis Fernando D'Haro , Yiming Chen , Malu Zhang , Haizhou Li

The creation of Business Process Model and Notation (BPMN) models is a complex and time-consuming task requiring both domain knowledge and proficiency in modeling conventions. Recent advances in large language models (LLMs) have…

Software Engineering · Computer Science 2026-01-30 Chantale Lauer , Peter Pfeiffer , Alexander Rombach , Nijat Mehdiyev

The startling success of ChatGPT and other large language models (LLMs) using transformer-based generative neural network architecture in applications such as natural language processing and image synthesis has many researchers excited…

Artificial Intelligence · Computer Science 2024-11-05 Venkat Venkatasubramanian , Arijit Chakraborty