English
Related papers

Related papers: A Multi-Task Benchmark for Korean Legal Language U…

200 papers

Legal Judgment Prediction (LJP) has become an increasingly crucial task in Legal AI, i.e., predicting the judgment of the case in terms of case fact description. Precedents are the previous legal cases with similar facts, which are the…

Computation and Language · Computer Science 2023-10-16 Yiquan Wu , Siying Zhou , Yifei Liu , Weiming Lu , Xiaozhong Liu , Yating Zhang , Changlong Sun , Fei Wu , Kun Kuang

While large language models (LLMs) have showcased impressive capabilities, they struggle with addressing legal queries due to the intricate complexities and specialized expertise required in the legal field. In this paper, we introduce…

Computation and Language · Computer Science 2024-06-24 Zhiwei Fei , Songyang Zhang , Xiaoyu Shen , Dawei Zhu , Xiao Wang , Maosong Cao , Fengzhe Zhou , Yining Li , Wenwei Zhang , Dahua Lin , Kai Chen , Jidong Ge

Crime situations are race against time. An AI-assisted criminal investigation system, providing prompt but precise legal counsel is in need for police officers. We introduce LAPIS (Language Model Augmented Police Investigation System), an…

Computation and Language · Computer Science 2024-08-01 Heedou Kim , Dain Kim , Jiwoo Lee , Chanwoong Yoon , Donghee Choi , Mogan Gim , Jaewoo Kang

Recent advances in test-time scaling of large language models (LLMs), exemplified by DeepSeek-R1 and OpenAI's o1, show that extending the chain of thought during inference can significantly improve general reasoning performance. However,…

Computation and Language · Computer Science 2025-11-11 Yinghao Hu , Yaoyao Yu , Leilei Gan , Bin Wei , Kun Kuang , Fei Wu

The research field of Legal Natural Language Processing (NLP) has been very active recently, with Legal Judgment Prediction (LJP) becoming one of the most extensively studied tasks. To date, most publicly released LJP datasets originate…

Computation and Language · Computer Science 2022-11-02 Gil Semo , Dor Bernsohn , Ben Hagag , Gila Hayat , Joel Niklaus

The legal landscape encompasses a wide array of lawsuit types, presenting lawyers with challenges in delivering timely and accurate information to clients, particularly concerning critical aspects like potential imprisonment duration or…

Artificial Intelligence · Computer Science 2024-07-30 Jia-Hong Huang , Chao-Chun Yang , Yixian Shen , Alessio M. Pacces , Evangelos Kanoulas

In this report, we introduce our first-generation reasoning model, LexPro-1.0, a large language model designed for the highly specialized Chinese legal domain, offering comprehensive capabilities to meet diverse realistic needs. Existing…

Computation and Language · Computer Science 2025-03-12 Haotian Chen , Yanyu Xu , Boyan Wang , Chaoyue Zhao , Xiaoyu Han , Fang Wang , Lizhen Cui , Yonghui Xu

Given the large size and volumes of contracts and their underlying inherent complexity, manual reviews become inefficient and prone to errors, creating a clear need for automation. Automatic Legal Contract Classification (LCC)…

Computation and Language · Computer Science 2025-07-30 Amrita Singh , Aditya Joshi , Jiaojiao Jiang , Hye-young Paik

To undertake computational research of the law, efficiently identifying datasets of court decisions that relate to a specific legal issue is a crucial yet challenging endeavour. This study addresses the gap in the literature working with…

Computation and Language · Computer Science 2024-03-11 Ahmed Izzidien , Holli Sargeant , Felix Steffek

Prior benchmarks for evaluating the domain-specific knowledge of large language models (LLMs) lack the scalability to handle complex academic tasks. To address this, we introduce \texttt{ScholarBench}, a benchmark centered on deep expert…

Computation and Language · Computer Science 2025-10-17 Dongwon Noh , Donghyeok Koh , Junghun Yuk , Gyuwan Kim , Jaeyong Lee , Kyungtae Lim , Cheoneum Park

Large Language Models (LLMs) have shown exceptional capabilities in Natural Language Processing (NLP) across diverse domains. However, their application in specialized tasks such as Legal Judgment Prediction (LJP) for low-resource languages…

Computation and Language · Computer Science 2025-03-03 Mohamed Bayan Kmainasi , Ali Ezzat Shahroor , Amani Al-Ghraibah

Legal NLP benchmarks overwhelmingly evaluate a single language or aggregate tasks that differ fundamentally across jurisdictions, making cross-lingual comparison impossible. We introduce Multi-Legal-Bench, the first cross-jurisdictional…

Computation and Language · Computer Science 2026-05-29 Volodymyr Ovcharov

Legal judgment prediction offers a compelling method to aid legal practitioners and researchers. However, the research question remains relatively under-explored: Should multiple defendants and charges be treated separately in LJP? To…

Computation and Language · Computer Science 2025-07-10 Xiao Wang , Jiahuan Pei , Diancheng Shui , Zhiguang Han , Xin Sun , Dawei Zhu , Xiaoyu Shen

Inspired by humans comprehending speech in a multi-modal manner, various audio-visual datasets have been constructed. However, most existing datasets focus on English, induce dependencies with various prediction models during dataset…

We introduce KoBALT (Korean Benchmark for Advanced Linguistic Tasks), a comprehensive linguistically-motivated benchmark comprising 700 multiple-choice questions spanning 24 phenomena across five linguistic domains: syntax, semantics,…

Computation and Language · Computer Science 2025-05-23 Hyopil Shin , Sangah Lee , Dongjun Jang , Wooseok Song , Jaeyoon Kim , Chaeyoung Oh , Hyemi Jo , Youngchae Ahn , Sihyun Oh , Hyohyeong Chang , Sunkyoung Kim , Jinsik Lee

This paper introduces LongBench v2, a benchmark designed to assess the ability of LLMs to handle long-context problems requiring deep understanding and reasoning across real-world multitasks. LongBench v2 consists of 503 challenging…

Computation and Language · Computer Science 2025-01-06 Yushi Bai , Shangqing Tu , Jiajie Zhang , Hao Peng , Xiaozhi Wang , Xin Lv , Shulin Cao , Jiazheng Xu , Lei Hou , Yuxiao Dong , Jie Tang , Juanzi Li

Existing benchmarks for visual document retrieval (VDR) largely overlook non-English languages and the structural complexity of official publications. To address this gap, we introduce SDS KoPub VDR, the first large-scale, public benchmark…

Computation and Language · Computer Science 2025-11-11 Jaehoon Lee , Sohyun Kim , Wanggeun Park , Geon Lee , Seungkyung Kim , Minyoung Lee

While large language models (LLMs) have demonstrated remarkable performance on high-level semantic tasks, they often struggle with fine-grained, token-level understanding and structural reasoning--capabilities that are essential for…

Computation and Language · Computer Science 2025-08-08 Chenzhuo Zhao , Xinda Wang , Yue Huang , Junting Lu , Ziqian Liu

With the growth of online services, the need for advanced text classification algorithms, such as sentiment analysis and biased text detection, has become increasingly evident. The anonymous nature of online services often leads to the…

Computation and Language · Computer Science 2023-11-14 Dasol Choi , Jooyoung Song , Eunsun Lee , Jinwoo Seo , Heejune Park , Dongbin Na

We introduce the Cambridge Law Corpus (CLC), a dataset for legal AI research. It consists of over 250 000 court cases from the UK. Most cases are from the 21st century, but the corpus includes cases as old as the 16th century. This paper…

Computation and Language · Computer Science 2024-01-03 Andreas Östling , Holli Sargeant , Huiyuan Xie , Ludwig Bull , Alexander Terenin , Leif Jonsson , Måns Magnusson , Felix Steffek