English
Related papers

Related papers: Better Call GPT, Comparing Large Language Models A…

200 papers

Large language models (LLMs) have changed the reality of how software is produced. Within the wider software engineering community, among many other purposes, they are explored for code generation use cases from different types of input. In…

Software Engineering · Computer Science 2025-08-01 Fabian Stiehle , Hans Weytjens , Ingo Weber

With the recent undeniable advancement in reasoning abilities in large language models (LLMs) like ChatGPT and GPT-4, there is a growing trend for using LLMs on various tasks. One area where LLMs can be employed is as an alternative…

Computation and Language · Computer Science 2023-10-23 Chenhui Shen , Liying Cheng , Xuan-Phi Nguyen , Yang You , Lidong Bing

With the advancement of Artificial Intelligence (AI) and Large Language Models (LLMs), there is a profound transformation occurring in the realm of natural language processing tasks within the legal domain. The capabilities of LLMs are…

Computation and Language · Computer Science 2024-04-02 Weicong Qin , Zhongxiang Sun

The legal landscape encompasses a wide array of lawsuit types, presenting lawyers with challenges in delivering timely and accurate information to clients, particularly concerning critical aspects like potential imprisonment duration or…

Artificial Intelligence · Computer Science 2024-07-30 Jia-Hong Huang , Chao-Chun Yang , Yixian Shen , Alessio M. Pacces , Evangelos Kanoulas

To reduce the need for human annotations, large language models (LLMs) have been proposed as judges of the quality of other candidate models. The performance of LLM judges is typically evaluated by measuring the correlation with human…

Computation and Language · Computer Science 2025-05-14 Andreas Stephan , Dawei Zhu , Matthias Aßenmacher , Xiaoyu Shen , Benjamin Roth

In this study, we investigate the capabilities and inherent biases of advanced large language models (LLMs) such as GPT-3.5 and GPT-4 in the context of debate evaluation. We discover that LLM's performance exceeds humans and surpasses the…

Computation and Language · Computer Science 2024-06-05 Xinyi Liu , Pinxin Liu , Hangfeng He

Large Language Models (LLMs) have lately been on the spotlight of researchers, businesses, and consumers alike. While the linguistic capabilities of such models have been studied extensively, there is growing interest in investigating them…

Computation and Language · Computer Science 2023-08-17 Sotiris Lamprinidis

Large language models (LLMs) have shown promise for automatic summarization but the reasons behind their successes are poorly understood. By conducting a human evaluation on ten LLMs across different pretraining methods, prompts, and model…

Computation and Language · Computer Science 2023-02-01 Tianyi Zhang , Faisal Ladhak , Esin Durmus , Percy Liang , Kathleen McKeown , Tatsunori B. Hashimoto

This research explores the application of Large Language Models (LLMs) for automating the extraction of requirement-related legal content in the food safety domain and checking legal compliance of regulatory artifacts. With Industry 4.0…

Software Engineering · Computer Science 2024-04-29 Shabnam Hassani

Unlocking the potential of Large Language Models (LLMs) in data classification represents a promising frontier in natural language processing. In this work, we evaluate the performance of different LLMs in comparison with state-of-the-art…

Computation and Language · Computer Science 2025-01-16 Arina Kostina , Marios D. Dikaiakos , Dimosthenis Stefanidis , George Pallis

Large language models (LLMs) have recently gained prominence in the field of software development, significantly boosting productivity and simplifying teamwork. Although prior studies have examined task-specific applications, the…

Software Engineering · Computer Science 2025-11-14 Antonio Collante , Samuel Abedu , SayedHassan Khatoonabadi , Ahmad Abdellatif , Ebube Alor , Emad Shihab

Realizing the recent advances in Natural Language Processing (NLP) to the legal sector poses challenging problems such as extremely long sequence lengths, specialized vocabulary that is usually only understood by legal professionals, and…

Computation and Language · Computer Science 2023-11-16 Thanmay Jayakumar , Fauzan Farooqui , Luqman Farooqui

In an era dominated by Large Language Models (LLMs), understanding their capabilities and limitations, especially in high-stakes fields like law, is crucial. While LLMs such as Meta's LLaMA, OpenAI's ChatGPT, Google's Gemini, DeepSeek, and…

Computation and Language · Computer Science 2025-09-29 Antreas Ioannou , Andreas Shiamishis , Nora Hollenstein , Nezihe Merve Gürel

Large language models (LLMs) have shown exceptional performance across various text generation tasks but remain under-explored in the patent domain, which offers highly structured and precise language. This paper constructs a dataset to…

Computation and Language · Computer Science 2025-05-27 Lekang Jiang , Caiqi Zhang , Pascal A Scherz , Stephan Goetz

Countless terms of service (ToS) are being signed everyday by users all over the world while interacting with all kinds of apps and websites. More often than not, these online contracts spanning double-digit pages are signed blindly by…

Computation and Language · Computer Science 2024-09-09 Mirgita Frasheri , Arian Bakhtiarnia , Lukas Esterle , Alexandros Iosifidis

Large language models (LLMs) have transformed many fields, including natural language processing, computer vision, and reinforcement learning. These models have also made a significant impact in the field of law, where they are being…

Computation and Language · Computer Science 2023-03-17 Zhongxiang Sun

Large Language Models (LLMs) have significantly advanced the development of Legal Artificial Intelligence (Legal AI) in recent years, enhancing the efficiency and accuracy of legal tasks. To advance research and applications of LLM-based…

Computation and Language · Computer Science 2025-09-15 Zhitian Hou , Zihan Ye , Nanli Zeng , Tianyong Hao , Kun Zeng

Smart contracts can implement and automate parts of legal contracts, but ensuring their legal compliance remains challenging. Existing approaches such as formal specification, verification, and model-based development require expertise in…

Software Engineering · Computer Science 2025-06-03 Chanuka Wijayakoon , Hai Dong , H. M. N. Dilum Bandara , Zahir Tari , Anurag Soin

This article presents a comparative study of large language models (LLMs) in the task of sentiment analysis of financial market news. This work aims to analyze the performance difference of these models in this important natural language…

Statistical Finance · Quantitative Finance 2025-10-21 Lucas Eduardo Pereira Teles , Carlos M. S. Figueiredo

We investigate whether large language models (LLMs) can successfully perform financial statement analysis in a way similar to a professional human analyst. We provide standardized and anonymous financial statements to GPT4 and instruct the…

Statistical Finance · Quantitative Finance 2025-02-24 Alex Kim , Maximilian Muhn , Valeri Nikolaev