English
Related papers

Related papers: Are manual annotations necessary for statutory int…

200 papers

Automated interpretability systems aim to reduce the need for human labor and scale analysis to increasingly large models and diverse tasks. Recent efforts toward this goal leverage large language models (LLMs) at increasing levels of…

Artificial Intelligence · Computer Science 2026-03-23 Tal Haklay , Nikhil Prakash , Sana Pandey , Antonio Torralba , Aaron Mueller , Jacob Andreas , Tamar Rott Shaham , Yonatan Belinkov

Automatic summarization of legal case judgements, which are known to be long and complex, has traditionally been tried via extractive summarization models. In recent years, generative models including abstractive summarization models and…

Computation and Language · Computer Science 2024-07-23 Aniket Deroy , Kripabandhu Ghosh , Saptarshi Ghosh

Creating linguistic annotations requires more than just a reliable annotation scheme. Annotation can be a complex endeavour potentially involving many people, stages, and tools. This chapter outlines the process of creating end-to-end…

Computation and Language · Computer Science 2016-02-19 Mark A. Finlayson , Tomaž Erjavec

Automatically understanding the rhetorical roles of sentences in a legal case judgement is an important problem to solve, since it can help in several downstream tasks like summarization of legal judgments, legal search, and so on. The task…

Information Retrieval · Computer Science 2019-11-14 Paheli Bhattacharya , Shounak Paul , Kripabandhu Ghosh , Saptarshi Ghosh , Adam Wyner

Large language models (LLMs) are increasingly used by researchers in the social sciences and humanities (SSH) for text analysis, particularly to automate text annotation. However, many researchers still face challenges in adopting LLMs,…

Computers and Society · Computer Science 2026-05-28 Qixiang Fang , Javier Garcia Bernardo , Erik-Jan van Kesteren

Factors are a foundational component of legal analysis and computational models of legal reasoning. These factor-based representations enable lawyers, judges, and AI and Law researchers to reason about legal cases. In this paper, we…

Computation and Language · Computer Science 2024-10-11 Morgan Gray , Jaromir Savelka , Wesley Oliver , Kevin Ashley

Recent state-of-the-art authorship attribution methods learn authorship representations of texts in a latent, non-interpretable space, hindering their usability in real-world applications. Our work proposes a novel approach to interpreting…

Computation and Language · Computer Science 2024-09-12 Milad Alshomary , Narutatsu Ri , Marianna Apidianaki , Ajay Patel , Smaranda Muresan , Kathleen McKeown

In this paper, we propose a new annotation scheme to classify different types of clauses in Terms-and-Conditions contracts with the ultimate goal of supporting legal experts to quickly identify and assess problematic issues in this type of…

Computation and Language · Computer Science 2024-05-28 Pietro Giovanni Bizzaro , Elena Della Valentina , Maurizio Napolitano , Nadia Mana , Massimo Zancanaro

Human evaluation is increasingly critical for assessing large language models, capturing linguistic nuances, and reflecting user preferences more accurately than traditional automated metrics. However, the resource-intensive nature of this…

Computation and Language · Computer Science 2023-10-24 Meriem Boubdir , Edward Kim , Beyza Ermis , Marzieh Fadaee , Sara Hooker

Systematic reviews are crucial for synthesizing scientific evidence but remain labor-intensive, especially when extracting detailed methodological information. Large language models (LLMs) offer potential for automating methodological…

Computation and Language · Computer Science 2025-10-14 Wenqing Zhang , Trang Nguyen , Elizabeth A. Stuart , Yiqun T. Chen

Semantic annotation, the process of identifying key-phrases in texts and linking them to concepts in a knowledge base, is an important basis for semantic information retrieval and the Semantic Web uptake. Despite the emergence of semantic…

Computation and Language · Computer Science 2018-11-15 Gagnon Michel , Zouaq Amal , Aranha Francisco , Ensan Faezeh , Jean-Louis Ludovic

Supervised learning relies on high-quality labeled data, but obtaining such data through human annotation is both expensive and time-consuming. Recent work explores using large language models (LLMs) for annotation, but LLM-generated labels…

Machine Learning · Computer Science 2026-03-23 Lequan Lin , Dai Shi , Andi Han , Feng Chen , Qiuzheng Chen , Jiawen Li , Zhaoyang Li , Jiyuan Li , Zhenbang Sun , Junbin Gao

A document which elaborates opinions and arguments related to the previous court cases is known as a legal opinion text. Lawyers and legal officials have to spend considerable effort and time to obtain the required information manually from…

This study proposes a novel way of identifying the sentiment of the phrases used in the legal domain. The added complexity of the language used in law, and the inability of the existing systems to accurately predict the sentiments of words…

Computation and Language · Computer Science 2018-10-05 Viraj Gamage , Menuka Warushavithana , Nisansa de Silva , Amal Shehan Perera , Gathika Ratnayaka , Thejan Rupasinghe

We propose a scalable method for constructing a temporal opinion knowledge base with large language models (LLMs) as automated annotators. Despite the demonstrated utility of time-series opinion analysis of text for downstream applications…

Computation and Language · Computer Science 2025-09-03 Gaurav Negi , Atul Kr. Ojha , Omnia Zayed , Paul Buitelaar

Nowadays, the need for system interoperability in or across enterprises has become more and more ubiquitous. Lots of research works have been carried out in the information exchange, transformation, discovery and reuse. One of the main…

Software Engineering · Computer Science 2014-11-17 Y. Liao , M. Lezoche , H. Panetto , N. Boudjlida , Eduardo Rocha Loures

Human annotation of training samples is expensive, laborious, and sometimes challenging, especially for Natural Language Processing (NLP) tasks. To reduce the labeling cost and enhance the sample efficiency, Active Learning (AL) technique…

Computation and Language · Computer Science 2024-01-17 Xuesong Wang

One useful application of NLP models is to support people in reading complex text from unfamiliar domains (e.g., scientific articles). Simplifying the entire text makes it understandable but sometimes removes important details. On the…

Computation and Language · Computer Science 2025-01-28 Sumit Asthana , Hannah Rashkin , Elizabeth Clark , Fantine Huot , Mirella Lapata

Prompting Large Language Models (LLMs), or providing context on the expected model of operation, is an effective way to steer the outputs of such models to satisfy human desiderata after they have been trained. But in rapidly evolving…

Machine Learning · Computer Science 2025-08-08 Younwoo Choi , Muhammad Adil Asif , Ziwen Han , John Willes , Rahul G. Krishnan

Large language models (LLMs) have shown promise for automated text annotation, raising hopes that they might accelerate cross-cultural research by extracting structured data from ethnographic texts. We evaluated 7 state-of-the-art LLMs on…

Computation and Language · Computer Science 2026-01-21 Leonardo S. Goodall , Dor Shilton , Daniel A. Mullins , Harvey Whitehouse