English
Related papers

Related papers: AnnoCaseLaw: A Richly-Annotated Dataset For Benchm…

200 papers

A well-known limitation of AI systems is presumptuousness: the tendency of AI systems to provide confident answers when information may be lacking. This challenge is particularly acute in legal applications, where a core task for attorneys,…

Artificial Intelligence · Computer Science 2026-04-23 Mohamed Afane , Emily Robitschek , Derek Ouyang , Daniel E. Ho

Legal judgment prediction (LJP) has become increasingly important in the legal field. In this paper, we identify that existing large language models (LLMs) have significant problems of insufficient reasoning due to a lack of legal…

Artificial Intelligence · Computer Science 2025-08-25 Xinyu Yang , Chenlong Deng , Zhicheng Dou

Legal Judgment Prediction (LJP) aims to automatically predict a law case's judgment results based on the text description of its facts. In practice, the confusing law articles (or charges) problem frequently occurs, reflecting that the law…

Computation and Language · Computer Science 2024-08-20 Nuo Xu , Pinghui Wang , Junzhou Zhao , Feiyang Sun , Lin Lan , Jing Tao , Li Pan , Xiaohong Guan

The process of annotating data within the legal sector is filled with distinct challenges that differ from other fields, primarily due to the inherent complexities of legal language and documentation. The initial task usually involves…

Information Retrieval · Computer Science 2024-07-26 Harshil Darji , Jelena Mitrović , Michael Granitzer

Legal Judgment Prediction (LJP) aims to predict judgment outcomes based on case description. Several researchers have developed techniques to assist potential clients by predicting the outcome in the legal profession. However, none of the…

Artificial Intelligence · Computer Science 2023-09-04 Salwa Abbara , Mona Hafez , Aya Kazzaz , Areej Alhothali , Alhanouf Alsolami

The language used by US courtroom actors in criminal trials has long been studied for biases. However, systematic studies for bias in high-stakes court trials have been difficult, due to the nuanced nature of bias and the legal expertise…

Computation and Language · Computer Science 2024-07-30 Andrea W Wen-Yi , Kathryn Adamson , Nathalie Greenfield , Rachel Goldberg , Sandra Babcock , David Mimno , Allison Koenecke

Legal judgment prediction (LJP) aims to function as a judge by making final rulings based on case claims and facts, which plays a vital role in the judicial domain for supporting court decision-making and improving judicial efficiency.…

Artificial Intelligence · Computer Science 2025-06-10 Weijie Shi , Han Zhu , Jiaming Ji , Mengze Li , Jipeng Zhang , Ruiyuan Zhang , Jia Zhu , Jiajie Xu , Sirui Han , Yike Guo

Multiple defendants in a criminal fact description generally exhibit complex interactions, and cannot be well handled by existing Legal Judgment Prediction (LJP) methods which focus on predicting judgment results (e.g., law articles,…

Computation and Language · Computer Science 2023-12-12 Yougang Lyu , Jitai Hao , Zihan Wang , Kai Zhao , Shen Gao , Pengjie Ren , Zhumin Chen , Fang Wang , Zhaochun Ren

This paper demonstrate how NLP can be used to address an unmet need of the legal community and increase access to justice. The paper introduces Legal Precedent Prediction (LPP), the task of predicting relevant passages from precedential…

Computation and Language · Computer Science 2021-07-01 Robert Zev Mahari

Unlike the courts in western countries, public records of Indian judiciary are completely unstructured and noisy. No large scale publicly available annotated datasets of Indian legal documents exist till date. This limits the scope for…

Computation and Language · Computer Science 2021-10-26 Vedant Parikh , Vidit Mathur , Parth Mehta , Namita Mittal , Prasenjit Majumder

Legal NLP remains underdeveloped in regions like India due to the scarcity of structured datasets. We introduce IndianBailJudgments-1200, a new benchmark dataset comprising 1200 Indian court judgments on bail decisions, annotated across 20+…

Computation and Language · Computer Science 2025-07-04 Sneha Deshmukh , Prathmesh Kamble

Tabular data is ubiquitous in real-world applications and abundant on the web, yet its annotation has traditionally required human labor, posing a significant scalability bottleneck for tabular machine learning. Our methodology can…

Machine Learning · Computer Science 2024-06-25 Yaojie Hu , Ilias Fountalis , Jin Tian , Nikolaos Vasiloglou

Current medical language model (LM) benchmarks often over-simplify the complexities of day-to-day clinical practice tasks and instead rely on evaluating LMs on multiple-choice board exam questions. In psychiatry especially, these challenges…

High annotation costs from hiring or crowdsourcing complicate the creation of large, high-quality datasets needed for training reliable text classifiers. Recent research suggests using Large Language Models (LLMs) to automate the annotation…

Computation and Language · Computer Science 2025-01-27 Tomas Horych , Christoph Mandl , Terry Ruas , Andre Greiner-Petter , Bela Gipp , Akiko Aizawa , Timo Spinde

We present the Legal Passage Retrieval Dataset LePaRD. LePaRD is a massive collection of U.S. federal judicial citations to precedent in context. The dataset aims to facilitate work on legal passage prediction, a challenging…

Computation and Language · Computer Science 2024-10-02 Robert Mahari , Dominik Stammbach , Elliott Ash , Alex `Sandy' Pentland

We present a new NLP task and dataset from the domain of the U.S. civil procedure. Each instance of the dataset consists of a general introduction to the case, a particular question, and a possible solution argument, accompanied by a…

Computation and Language · Computer Science 2022-11-08 Leonard Bongard , Lena Held , Ivan Habernal

In this paper, we introduce the \textbf{C}hinese \textbf{AI} and \textbf{L}aw challenge dataset (CAIL2018), the first large-scale Chinese legal dataset for judgment prediction. \dataset contains more than $2.6$ million criminal cases…

Computation and Language · Computer Science 2018-07-09 Chaojun Xiao , Haoxi Zhong , Zhipeng Guo , Cunchao Tu , Zhiyuan Liu , Maosong Sun , Yansong Feng , Xianpei Han , Zhen Hu , Heng Wang , Jianfeng Xu

Legal Judgment Prediction (LJP) is a judicial assistance system that recommends the legal components such as applicable statues, prison term and penalty term by analyzing the given input case document. Indian legal system is in the need of…

Computation and Language · Computer Science 2023-12-14 Prameela Madambakam , Shathanaa Rajmohan , Himangshu Sharma , Tummepalli Anka Chandrahas Purushotham Gupta

In this work, we create a web application to highlight the output of NLP models trained to parse and label discourse segments in law text. Our system is built primarily with journalists and legal interpreters in mind, and we focus on…

Computation and Language · Computer Science 2022-07-01 Alexander Spangher , Jonathan May

Mainstream methods for Legal Judgment Prediction (LJP) based on Pre-trained Language Models (PLMs) heavily rely on the statistical correlation between case facts and judgment results. This paradigm lacks explicit modeling of legal…

Computation and Language · Computer Science 2026-03-13 Yuzhi Liang , Lixiang Ma , Xinrong Zhu