English
Related papers

Related papers: Equitable Access to Justice: Logical LLMs Show Pro…

200 papers

Large language models (LLMs) are increasingly explored as general-purpose reasoners, particularly in agentic contexts. However, their outputs remain prone to mathematical and logical errors. This is especially challenging in open-ended…

Artificial Intelligence · Computer Science 2025-05-30 Agnieszka Mensfelt , Kostas Stathis , Vince Trencsenyi

Large Language Models (LLMs) have been increasingly used to optimize the analysis and synthesis of legal documents, enabling the automation of tasks such as summarization, classification, and retrieval of legal information. This study aims…

Computation and Language · Computer Science 2025-04-02 Matheus Belarmino , Rackel Coelho , Roberto Lotudo , Jayr Pereira

Large language models (LLMs) have demonstrated remarkable capabilities in natural language understanding, reasoning, and problem-solving across various domains. However, their ability to perform complex, multi-step reasoning task-essential…

In this thesis, I evaluate the performance of Large Language Models (LLMs) on the Law School Admissions Test (LSAT), specifically the Logic Games section of the test. I focus on this section because it presents a complex logical reasoning…

Computation and Language · Computer Science 2024-10-01 Saumya Malik

Large Language Models (LLMs) have emerged as promising solutions for a variety of medical and clinical decision support applications. However, LLMs are often subject to different types of biases, which can lead to unfair treatment of…

Computation and Language · Computer Science 2024-08-23 Raphael Poulain , Hamed Fayyaz , Rahmatollah Beheshti

This survey explores recent advancements in reasoning large language models (LLMs) designed to mimic "slow thinking" - a reasoning process inspired by human cognition, as described in Kahneman's Thinking, Fast and Slow. These models, like…

Artificial Intelligence · Computer Science 2025-05-09 Qianjun Pan , Wenkai Ji , Yuyang Ding , Junsong Li , Shilian Chen , Junyi Wang , Jie Zhou , Qin Chen , Min Zhang , Yulan Wu , Liang He

The advancement of generative AI, particularly large language models (LLMs), has a significant impact on politics and democracy, offering potential across various domains, including policymaking, political communication, analysis, and…

Computation and Language · Computer Science 2024-12-17 Goshi Aoki

Large Language Models (LLMs) could struggle to fully understand legal theories and perform complex legal reasoning tasks. In this study, we introduce a challenging task (confusing charge prediction) to better evaluate LLMs' understanding of…

Artificial Intelligence · Computer Science 2024-10-04 Weikang Yuan , Junjie Cao , Zhuoren Jiang , Yangyang Kang , Jun Lin , Kaisong Song , tianqianjin lin , Pengwei Yan , Changlong Sun , Xiaozhong Liu

Psychological consultation is essential for improving mental health and well-being, yet challenges such as the shortage of qualified professionals and scalability issues limit its accessibility. To address these challenges, we explore the…

Computation and Language · Computer Science 2024-08-30 Rafael Souza , Jia-Hao Lim , Alexander Davis

Interpreting the meaning of legal open-textured terms is a key task of legal professionals. An important source for this interpretation is how the term was applied in previous court cases. In this paper, we evaluate the performance of GPT-4…

Computation and Language · Computer Science 2023-06-23 Jaromir Savelka , Kevin D. Ashley , Morgan A. Gray , Hannes Westermann , Huihui Xu

More than half of the global population struggles to meet their civil justice needs due to limited legal resources. While Large Language Models (LLMs) have demonstrated impressive reasoning capabilities, significant challenges remain even…

Computation and Language · Computer Science 2026-04-22 Fanyu Wang , Xiaoxi Kang , Paul Burgess , Aashish Srivastava , Chetan Arora , Adnan Trakic , Lay-Ki Soon , Md Khalid Hossain , Lizhen Qu

This paper presents a groundbreaking comparison between Large Language Models and traditional legal contract reviewers, Junior Lawyers and Legal Process Outsourcers. We dissect whether LLMs can outperform humans in accuracy, speed, and cost…

Computers and Society · Computer Science 2024-01-30 Lauren Martin , Nick Whitehouse , Stephanie Yiu , Lizzie Catterson , Rivindu Perera

Logical reasoning is a fundamental aspect of human intelligence and a key component of tasks like problem-solving and decision-making. Recent advancements have enabled Large Language Models (LLMs) to potentially exhibit reasoning…

Computation and Language · Computer Science 2023-11-13 Jiazhan Feng , Ruochen Xu , Junheng Hao , Hiteshi Sharma , Yelong Shen , Dongyan Zhao , Weizhu Chen

This paper explores the economic underpinnings of open sourcing advanced large language models (LLMs) by for-profit companies. Empirical analysis reveals that: (1) LLMs are compatible with R&D portfolios of numerous technologically…

General Economics · Economics 2025-01-22 Mahyar Habibi

Healthcare systems around the world are grappling with issues like inefficient diagnostics, rising costs, and limited access to specialists. These problems often lead to delays in treatment and poor health outcomes. Most current AI and deep…

Artificial Intelligence · Computer Science 2025-12-22 Maliha Tabassum , M Shamim Kaiser

As large language models (LLMs) have demonstrated strong reasoning abilities in structured tasks (e.g., coding and mathematics), we explore whether these abilities extend to strategic multi-agent environments. We investigate strategic…

General Economics · Economics 2025-10-23 Gavin Kader , Dongwoo Lee

While Large Reasoning Models (LRMs) have demonstrated exceptional logical capabilities in mathematical domains, their application to the legal field remains hindered by the strict requirements for procedural rigor and adherence to legal…

Artificial Intelligence · Computer Science 2026-01-13 Yujin Zhou , Chuxue Cao , Jinluan Yang , Lijun Wu , Conghui He , Sirui Han , Yike Guo

Recent advances in large language models (LLMs) like GPT-3.5 and GPT-4 promise automation with better results and less programming, opening up new opportunities for text analysis in political science. In this study, we evaluate LLMs on…

Computation and Language · Computer Science 2024-08-29 Lorenzo Lupo , Oscar Magnusson , Dirk Hovy , Elin Naurin , Lena Wängnerud

Large Language Models (LLMs) are widely applied to downstream domains. However, current LLMs for high-stakes domain tasks, such as financial investment and legal QA, typically generate brief answers without reasoning processes and…

Computation and Language · Computer Science 2025-05-29 Xu Chu , Zhijie Tan , Hanlin Xue , Guanyu Wang , Tong Mo , Weiping Li

As the legal community increasingly examines the use of large language models (LLMs) for various legal applications, legal AI developers have turned to retrieval-augmented LLMs ("RAG" systems) to improve system performance and robustness.…

Computation and Language · Computer Science 2025-05-08 Lucia Zheng , Neel Guha , Javokhir Arifov , Sarah Zhang , Michal Skreta , Christopher D. Manning , Peter Henderson , Daniel E. Ho