English
Related papers

Related papers: Can GPT-3 Perform Statutory Reasoning?

200 papers

Generating step-by-step "chain-of-thought" rationales improves language model performance on complex reasoning tasks like mathematics or commonsense question-answering. However, inducing language model rationale generation currently…

Machine Learning · Computer Science 2022-05-23 Eric Zelikman , Yuhuai Wu , Jesse Mu , Noah D. Goodman

Our work is the first attempt to apply Natural Language Processing to automate the development of simulation models of systems vitally important for logistics. We demonstrated that the framework built on top of the fine-tuned GPT-3 Codex, a…

Artificial Intelligence · Computer Science 2023-04-03 Ilya Jackson , Maria Jesus Saenz

Recent work has demonstrated substantial gains on many NLP tasks and benchmarks by pre-training on a large corpus of text followed by fine-tuning on a specific task. While typically task-agnostic in architecture, this method still requires…

Zero-shot reasoning methods with Large Language Models (LLMs) offer significant advantages including great generalization to novel tasks and reduced dependency on human-crafted examples. However, the current zero-shot methods still have…

Machine Learning · Computer Science 2024-10-28 Pengfei He , Zitao Li , Yue Xing , Yaling Li , Jiliang Tang , Bolin Ding

Training on verifiable symbolic data is a promising way to expand the reasoning frontier of language models beyond what standard pre-training corpora provide. Yet existing procedural generators often rely on fixed puzzles or templates and…

Computation and Language · Computer Science 2026-03-03 Valentin Lacombe , Valentin Quesnel , Damien Sileo

In medical dialogue summarization, summaries must be coherent and must capture all the medically relevant information in the dialogue. However, learning effective models for summarization require large amounts of labeled data which is…

Computation and Language · Computer Science 2021-10-15 Bharath Chintagunta , Namit Katariya , Xavier Amatriain , Anitha Kannan

We have recently witnessed a number of impressive results on hard mathematical reasoning problems with language models. At the same time, the robustness of these models has also been called into question; recent works have shown that models…

Computation and Language · Computer Science 2023-06-09 Alessandro Stolfo , Zhijing Jin , Kumar Shridhar , Bernhard Schölkopf , Mrinmaya Sachan

Thinking aloud is an effective meta-cognitive strategy human reasoners apply to solve difficult problems. We suggest to improve the reasoning ability of pre-trained neural language models in a similar way, namely by expanding a task's…

Computation and Language · Computer Science 2021-03-25 Gregor Betz , Kyle Richardson , Christian Voigt

Recent advancements in transformer-based models have initiated research interests in investigating their ability to learn to perform reasoning tasks. However, most of the contexts used for this purpose are in practice very simple: generated…

Computation and Language · Computer Science 2024-04-29 Angelos Poulis , Eleni Tsalapati , Manolis Koubarakis

Recent advancements in Large Language Models (LLMs) harness linguistic associations in vast natural language data for practical applications. However, their ability to understand the physical world using only language data remains a…

Computation and Language · Computer Science 2023-05-10 Nigel H. Collier , Fangyu Liu , Ehsan Shareghi

Law has long been a domain that has been popular in natural language processing (NLP) applications. Reasoning (ratiocination and the ability to make connections to precedent) is a core part of the practice of the law in the real world.…

Artificial Intelligence · Computer Science 2025-06-13 Lucas Irwin , Arda Kaz , Peiyao Sheng , Sewoong Oh , Pramod Viswanath

Statutory reasoning refers to the application of legislative provisions to a series of case facts described in natural language. We re-frame statutory reasoning as an analogy task, where each instance of the analogy task involves a…

Computation and Language · Computer Science 2024-01-15 Xinrui Zou , Ming Zhang , Nathaniel Weir , Benjamin Van Durme , Nils Holzenberger

GPT-3 and GPT-4 models are powerful, achieving high performance on a variety of Natural Language Processing tasks. However, there is a relative lack of detailed published analysis of their performance on the task of grammatical error…

Computation and Language · Computer Science 2023-05-31 Steven Coyne , Keisuke Sakaguchi , Diana Galvan-Sosa , Michael Zock , Kentaro Inui

We examine how well the state-of-the-art (SOTA) models used in legal reasoning support abductive reasoning tasks. Abductive reasoning is a form of logical inference in which a hypothesis is formulated from a set of observations, and that…

Logic in Computer Science · Computer Science 2023-06-30 Ha-Thanh Nguyen , Randy Goebel , Francesca Toni , Kostas Stathis , Ken Satoh

We evaluated the capability of a state-of-the-art generative pre-trained transformer (GPT) model to perform semantic annotation of short text snippets (one to few sentences) coming from legal documents of various types. Discussions of…

Computation and Language · Computer Science 2023-05-09 Jaromir Savelka

Law at large underpins modern society, codifying and governing many aspects of citizens' daily lives. Oftentimes, law is subject to interpretation, debate and challenges throughout various courts and jurisdictions. But in some other areas,…

Programming Languages · Computer Science 2021-07-06 Denis Merigoux , Nicolas Chataing , Jonathan Protzenko

Large language models that are capable of zero or few-shot prompting approaches have given rise to the new research area of prompt engineering. Recent advances showed that for example Chain-of-Thought (CoT) prompts can improve arithmetic or…

Computation and Language · Computer Science 2022-12-12 Fangyi Yu , Lee Quartey , Frank Schilder

Large-scale generative language models such as GPT-3 are competitive few-shot learners. While these models are known to be able to jointly represent many different languages, their training data is dominated by English, potentially limiting…

Artificial intelligence has made significant progress in natural language processing, with models like GPT-3 demonstrating impressive capabilities. However, these models still have limitations when it comes to complex tasks that require an…

Computation and Language · Computer Science 2023-06-26 Yuetian Chen , Bowen Shi , Mei Si

LawGPT 1.0 is a virtual legal assistant built on the state-of-the-art language model GPT-3, fine-tuned for the legal domain. The system is designed to provide legal assistance to users in a conversational manner, helping them with tasks…

Computation and Language · Computer Science 2023-02-15 Ha-Thanh Nguyen