English
Related papers

Related papers: Fine-Grained Perspectives: Modeling Explanations w…

200 papers

Textual data annotation, the process of labeling or tagging text with relevant information, is typically costly, time-consuming, and labor-intensive. While large language models (LLMs) have demonstrated their potential as direct…

Computation and Language · Computer Science 2025-08-12 Yu-Min Tseng , Wei-Lin Chen , Chung-Chi Chen , Hsin-Hsi Chen

Understanding covert narratives and implicit messaging is essential for analyzing bias and sentiment. Traditional NLP methods struggle with detecting subtle phrasing and hidden agendas. This study tackles two key challenges: (1) multi-label…

Computation and Language · Computer Science 2025-09-05 Rishit Tyagi , Rahul Bouri , Mohit Gupta

Existing text classification methods mainly focus on a fixed label set, whereas many real-world applications require extending to new fine-grained classes as the number of samples per label increases. To accommodate such requirements, we…

Computation and Language · Computer Science 2021-09-23 Dheeraj Mekala , Varun Gangal , Jingbo Shang

Generalization is an important attribute of machine learning models, particularly for those that are to be deployed in a medical context, where unreliable predictions can have real world consequences. While the failure of models to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Brennan Nichyporuk , Jillian Cardinell , Justin Szeto , Raghav Mehta , Jean-Pierre R. Falet , Douglas L. Arnold , Sotirios A. Tsaftaris , Tal Arbel

In this work, we introduce a methodology for alignment designed to enhance the ability of large language models (LLMs) to articulate their reasoning (self-explanation) even in the absence of annotated rationale explanations. Our alignment…

Artificial Intelligence · Computer Science 2024-10-18 Luis Felipe Villa-Arenas , Ata Nizamoglu , Qianli Wang , Sebastian Möller , Vera Schmitt

Phrase mining is a fundamental text mining task that aims to identify quality phrases from context. Nevertheless, the scarcity of extensive gold labels datasets, demanding substantial annotation efforts from experts, renders this task…

Computation and Language · Computer Science 2024-01-01 Zhihao Zhang , Yuan Zuo , Chenghua Lin , Junjie Wu

The increasing use of complex and opaque black box models requires the adoption of interpretable measures, one such option is extractive rationalizing models, which serve as a more interpretable alternative. These models, also known as…

Computation and Language · Computer Science 2024-11-13 Wei Jie Yeo , Ranjan Satapathy , Erik Cambria

The assessment of argument quality depends on well-established logical, rhetorical, and dialectical properties that are unavoidably subjective: multiple valid assessments may exist, there is no unequivocal ground truth. This aligns with…

Computation and Language · Computer Science 2025-02-21 Julia Romberg , Maximilian Maurer , Henning Wachsmuth , Gabriella Lapesa

Natural language inference (NLI) aims at predicting the relationship between a given pair of premise and hypothesis. However, several works have found that there widely exists a bias pattern called annotation artifacts in NLI datasets,…

Computation and Language · Computer Science 2019-10-08 Guanhua Zhang , Bing Bai , Junqi Zhang , Kun Bai , Conghui Zhu , Tiejun Zhao

Post-training (via supervised fine-tuning) improves instruction-following, but often induces semantic mode collapse by biasing models toward low-entropy fine-tuning data at the expense of the high-entropy pretraining distribution.…

We describe a formal model for annotating linguistic artifacts, from which we derive an application programming interface (API) to a suite of tools for manipulating these annotations. The abstract logical model provides for a range of…

Computation and Language · Computer Science 2007-05-23 Steven Bird , David Day , John Garofolo , John Henderson , Christophe Laprun , Mark Liberman

Explainability methods are used to benchmark the extent to which model predictions align with human rationales i.e., are 'right for the right reasons'. Previous work has failed to acknowledge, however, that what counts as a rationale is…

Computation and Language · Computer Science 2023-10-16 Terne Sasha Thorn Jakobsen , Laura Cabello , Anders Søgaard

Computational methods to aid journalists in the task often require adapting a model to specific domains and generating explanations. However, most automated fact-checking methods rely on three-class datasets, which do not accurately reflect…

Computation and Language · Computer Science 2024-10-08 Jing Yang , Anderson Rocha

This position paper argues that annotation disagreement in Natural Language Inference (NLI) is not mere noise but often reflects meaningful variation, especially when triggered by ambiguity in the premise or hypothesis. While underspecified…

Computation and Language · Computer Science 2025-09-03 Chathuri Jayaweera , Bonnie J. Dorr

To fully capture the meaning of a sentence, semantic representations should encode aspect, which describes the internal temporal structure of events. In graph-based meaning representation frameworks such as Uniform Meaning Representations…

In this project, we have investigated the use of advanced machine learning methods, specifically fine-tuned large language models, for pre-annotating data for a lexical extension task, namely adding descriptive words (verbs) to an existing…

Computation and Language · Computer Science 2023-08-11 Jana Straková , Eva Fučíková , Jan Hajič , Zdeňka Urešová

Prior studies show that adopting the annotation diversity shaped by different backgrounds and life experiences and incorporating them into the model learning, i.e. multi-perspective approach, contribute to the development of more…

Computation and Language · Computer Science 2025-03-04 Benedetta Muscato , Praveen Bushipaka , Gizem Gezici , Lucia Passaro , Fosca Giannotti , Tommaso Cucinotta

Explanation methods in Interpretable NLP often explain the model's decision by extracting evidence (rationale) from the input texts supporting the decision. Benchmark datasets for rationales have been released to evaluate how good the…

Computation and Language · Computer Science 2022-04-12 Cheng-Han Chiang , Hung-yi Lee

While deep neural networks have achieved impressive performance on a range of NLP tasks, these data-hungry models heavily rely on labeled data, which restricts their applications in scenarios where data annotation is expensive. Natural…

Computation and Language · Computer Science 2020-02-17 Ziqi Wang , Yujia Qin , Wenxuan Zhou , Jun Yan , Qinyuan Ye , Leonardo Neves , Zhiyuan Liu , Xiang Ren

For natural language processing systems, two kinds of evidence support the use of text representations from neural language models "pretrained" on large unannotated corpora: performance on application-inspired benchmarks (Peters et al.,…

Computation and Language · Computer Science 2021-12-17 Zhaofeng Wu , Hao Peng , Noah A. Smith