中文
相关论文

相关论文: RLJP: Legal Judgment Prediction via First-Order Lo…

200 篇论文

Legal practitioners, particularly those early in their careers, face complex, high-stakes tasks that require adaptive, context-sensitive reasoning. While AI holds promise in supporting legal work, current datasets and models are narrowly…

General and legal domain LLMs have demonstrated strong performance in various tasks of LegalAI. However, the current evaluations of these LLMs in LegalAI are defined by the experts of computer science, lacking consistency with the logic of…

计算与语言 · 计算机科学 2024-02-20 Yongfu Dai , Duanyu Feng , Jimin Huang , Haochen Jia , Qianqian Xie , Yifang Zhang , Weiguang Han , Wei Tian , Hao Wang

Large language models (LLMs) have demonstrated strong reasoning abilities in mathematical tasks, often enhanced through reinforcement learning (RL). However, RL-trained models frequently produce unnecessarily long reasoning traces -- even…

计算与语言 · 计算机科学 2025-05-27 Jinyan Su , Claire Cardie

Legal proposition generation is central to legal reasoning and doctrinal scholarship, yet remain under-examined in Legal NLP. This paper investigates the automatic generation and evaluation of legal propositions from decisions of the Court…

计算与语言 · 计算机科学 2026-05-20 Shanshan Xu , Johan Lindholm , Amogh Raina , Henrik Palmer Olsen , Daniel Hershcovich

This paper introduces a Korean legal judgment prediction (LJP) dataset for insurance disputes. Successful LJP models on insurance disputes can benefit insurance companies and their customers. It can save both sides' time and money by…

计算与语言 · 计算机科学 2024-01-29 Alice Saebom Kwak , Cheonkam Jeong , Ji Weon Lim , Byeongcheol Min

Large Reasoning Models (LRMs) like DeepSeek-R1 and OpenAI-o1 have demonstrated remarkable reasoning capabilities, raising important questions about their biases in LLM-as-a-judge settings. We present a comprehensive benchmark comparing…

计算机与社会 · 计算机科学 2025-04-21 Qian Wang , Zhanzhi Lou , Zhenheng Tang , Nuo Chen , Xuandong Zhao , Wenxuan Zhang , Dawn Song , Bingsheng He

This work aims to improve the generalization of logic-based legal reasoning systems by integrating recent advances in NLP with legal-domain adaptive few-shot learning techniques using LLMs. Existing logic-based legal reasoning pipelines…

计算与语言 · 计算机科学 2026-04-14 Jieying Xue , Phuong Minh Nguyen , Ha Thanh Nguyen , May Myo Zin , Ken Satoh

Legal case retrieval (LCR) aims to automatically scour for comparable legal cases based on a given query, which is crucial for offering relevant precedents to support the judgment in intelligent legal systems. Due to similar goals, it is…

计算与语言 · 计算机科学 2025-02-26 Nuo Xu , Pinghui Wang , Zi Liang , Junzhou Zhao , Xiaohong Guan

Large Language Models (LLMs) have demonstrated remarkable capabilities in various NLP tasks. However, previous works have shown these models are sensitive towards prompt wording, and few-shot demonstrations and their order, posing…

计算与语言 · 计算机科学 2023-08-23 Pouya Pezeshkpour , Estevam Hruschka

Large language models (LLMs) have become widely adopted as automated judges for evaluating AI-generated content. Despite their success, aligning LLM-based evaluations with human judgments remains challenging. While supervised fine-tuning on…

人工智能 · 计算机科学 2026-02-13 Bo Pan , Xuan Kan , Kaitai Zhang , Yan Yan , Shunwen Tan , Zihao He , Zixin Ding , Junjie Wu , Liang Zhao

LLM-as-a-Judge has been widely utilized as an evaluation method in various benchmarks and served as supervised rewards in model training. However, despite their excellence in many domains, potential issues are under-explored, undermining…

This paper presents CaseGPT, an innovative approach that combines Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) technology to enhance case-based reasoning in the healthcare and legal sectors. The system addresses the…

信息检索 · 计算机科学 2024-07-12 Rui Yang

Large language models (LLMs) are empowering decision-making in several applications, including tool or API usage and answering multiple-choice questions (MCQs). However, incorrect outputs pose significant risks in high-stakes domains like…

机器学习 · 计算机科学 2025-07-15 Harit Vishwakarma , Alan Mishler , Thomas Cook , Niccolò Dalmasso , Natraj Raman , Sumitra Ganesh

To reduce the need for human annotations, large language models (LLMs) have been proposed as judges of the quality of other candidate models. The performance of LLM judges is typically evaluated by measuring the correlation with human…

计算与语言 · 计算机科学 2025-05-14 Andreas Stephan , Dawei Zhu , Matthias Aßenmacher , Xiaoyu Shen , Benjamin Roth

Cross-lingual transfer learning has proven useful in a variety of Natural Language Processing (NLP) tasks, but it is understudied in the context of legal NLP, and not at all in Legal Judgment Prediction (LJP). We explore transfer learning…

计算与语言 · 计算机科学 2022-09-27 Joel Niklaus , Matthias Stürmer , Ilias Chalkidis

This paper presents a new system of logic, LF, that is intended to be used as the foundation of the formalization of science. That is, deductive validity according to LF is to be used as the criterion for assessing what follows from the…

逻辑 · 数学 2024-01-23 Zachary Goodsell , Juhani Yli-Vakkuri

A common technique for aligning large language models (LLMs) relies on acquiring human preferences by comparing multiple generations conditioned on a fixed context. This method, however, relies solely on pairwise comparisons, where the…

计算与语言 · 计算机科学 2025-01-09 Hritik Bansal , Ashima Suvarna , Gantavya Bhatt , Nanyun Peng , Kai-Wei Chang , Aditya Grover

Autoformalization plays a crucial role in formal mathematical reasoning by enabling the automatic translation of natural language statements into formal languages. While recent advances using large language models (LLMs) have shown…

计算与语言 · 计算机科学 2025-06-13 Lan Zhang , Marco Valentino , Andre Freitas

Existing large language models (LLMs) face challenges of following complex instructions, especially when multiple constraints are present and organized in paralleling, chaining, and branching structures. One intuitive solution, namely…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Yulei Qin , Gang Li , Zongyi Li , Zihan Xu , Yuchen Shi , Zhekai Lin , Xiao Cui , Ke Li , Xing Sun

The advancement of Large Language Models (LLMs) has greatly improved our ability to process complex language. However, accurately detecting logical fallacies remains a significant challenge. This study presents a novel and effective prompt…

人工智能 · 计算机科学 2025-04-01 Jiwon Jeong , Hyeju Jang , Hogun Park