English
Related papers

Related papers: A Multilingual Perspective Towards the Evaluation …

200 papers

Natural Language Inference (NLI) is foundational for evaluating language understanding in AI. However, progress has plateaued, with models failing on ambiguous examples and exhibiting poor generalization. We argue that this stems from…

Computation and Language · Computer Science 2024-05-21 Claudiu Creanga , Liviu P. Dinu

Recent state-of-the-art authorship attribution methods learn authorship representations of texts in a latent, non-interpretable space, hindering their usability in real-world applications. Our work proposes a novel approach to interpreting…

Computation and Language · Computer Science 2024-09-12 Milad Alshomary , Narutatsu Ri , Marianna Apidianaki , Ajay Patel , Smaranda Muresan , Kathleen McKeown

Natural language inference (NLI) is among the most challenging tasks in natural language understanding. Recent work on unsupervised pretraining that leverages unsupervised signals such as language-model and sentence prediction objectives…

Computation and Language · Computer Science 2019-04-30 Tianda Li , Xiaodan Zhu , Quan Liu , Qian Chen , Zhigang Chen , Si Wei

Large language models (LLMs) not only exhibit human-like performance but also share computational principles with the brain's language processing mechanisms. While prior research has focused on mapping LLMs' internal representations to…

Computation and Language · Computer Science 2025-04-07 Maryam Rahimi , Yadollah Yaghoobzadeh , Mohammad Reza Daliri

Motivated by distinct, though related, criteria, a growing number of attribution methods have been developed tointerprete deep learning. While each relies on the interpretability of the concept of "importance" and our ability to visualize…

Artificial Intelligence · Computer Science 2020-04-07 Zifan Wang , Piotr Mardziel , Anupam Datta , Matt Fredrikson

This paper presents our system description and error analysis of our entry for NLLP 2024 shared task on Legal Natural Language Inference (L-NLI) \citep{hagag2024legallenssharedtask2024}. The task required classifying these relationships as…

Computation and Language · Computer Science 2024-10-22 Ram Mohan Rao Kadiyala , Siddartha Pullakhandam , Kanwal Mehreen , Subhasya Tippareddy , Ashay Srivastava

Machine learning models can reach high performance on benchmark natural language processing (NLP) datasets but fail in more challenging settings. We study this issue when a pre-trained model learns dataset artifacts in natural language…

Computation and Language · Computer Science 2023-03-20 Zhenyuan Lu

With the enhancement in the field of generative artificial intelligence (AI), contextual question answering has become extremely relevant. Attributing model generations to the input source document is essential to ensure trustworthiness and…

Computation and Language · Computer Science 2024-05-29 Anirudh Phukan , Shwetha Somasundaram , Apoorv Saxena , Koustava Goswami , Balaji Vasan Srinivasan

XNLI is a popular Natural Language Inference (NLI) benchmark widely used to evaluate cross-lingual Natural Language Understanding (NLU) capabilities across languages. In this paper, we expand XNLI to include Basque, a low-resource language…

Computation and Language · Computer Science 2024-04-11 Maite Heredia , Julen Etxaniz , Muitze Zulaika , Xabier Saralegi , Jeremy Barnes , Aitor Soroa

Cross-lingual representations have the potential to make NLP techniques available to the vast majority of languages in the world. However, they currently require large pretraining corpora or access to typologically similar languages. In…

Computation and Language · Computer Science 2021-06-22 Wei Zhao , Steffen Eger , Johannes Bjerva , Isabelle Augenstein

The aim of this article is to investigate the fine-tuning potential of natural language inference (NLI) data to improve information retrieval and ranking. We demonstrate this for both English and Polish languages, using data from one of the…

Computation and Language · Computer Science 2023-08-08 Roman Dušek , Aleksander Wawer , Christopher Galias , Lidia Wojciechowska

Recent years have witnessed the emergence of a variety of post-hoc interpretations that aim to uncover how natural language processing (NLP) models make predictions. Despite the surge of new interpretation methods, it remains an open…

Computation and Language · Computer Science 2022-04-04 Fan Yin , Zhouxing Shi , Cho-Jui Hsieh , Kai-Wei Chang

Scientific Natural Language Inference (NLI) is the task of predicting the semantic relation between a pair of sentences extracted from research articles. The automatic annotation method based on distant supervision for the training set of…

Computation and Language · Computer Science 2024-06-24 Mobashir Sadat , Cornelia Caragea

Multilingual transformers (XLM, mT5) have been shown to have remarkable transfer skills in zero-shot settings. Most transfer studies, however, rely on automatically translated resources (XNLI, XQuAD), making it hard to discern the…

Computation and Language · Computer Science 2021-06-09 Hai Hu , He Zhou , Zuoyu Tian , Yiwen Zhang , Yina Ma , Yanting Li , Yixin Nie , Kyle Richardson

Explainable NLP techniques primarily explain by answering "Which tokens in the input are responsible for this prediction?''. We argue that for NLP models that make predictions by comparing two input texts, it is more useful to explain by…

Computation and Language · Computer Science 2023-12-05 Eleftheria Briakou , Navita Goyal , Marine Carpuat

Deep neural networks are very successful on many vision tasks, but hard to interpret due to their black box nature. To overcome this, various post-hoc attribution methods have been proposed to identify image regions most influential to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Sukrut Rao , Moritz Böhle , Bernt Schiele

The task of scientific Natural Language Inference (NLI) involves predicting the semantic relation between two sentences extracted from research articles. This task was recently proposed along with a new dataset called SciNLI derived from…

Computation and Language · Computer Science 2024-04-15 Mobashir Sadat , Cornelia Caragea

Natural language inference (NLI) is an increasingly important task for natural language understanding, which requires one to infer the relationship between the sentence pair (premise and hypothesis). Many recent works have used contrastive…

Computation and Language · Computer Science 2022-05-02 Shu'ang Li , Xuming Hu , Li Lin , Lijie Wen

RNN models have achieved the state-of-the-art performance in a wide range of text mining tasks. However, these models are often regarded as black-boxes and are criticized due to the lack of interpretability. In this paper, we enhance the…

Computation and Language · Computer Science 2019-03-28 Mengnan Du , Ninghao Liu , Fan Yang , Shuiwang Ji , Xia Hu

Data attribution methods quantify the influence of training data on model outputs and are becoming increasingly relevant for a wide range of LLM research and applications, including dataset curation, model interpretability, data valuation.…

Computation and Language · Computer Science 2025-10-28 Cathy Jiao , Yijun Pan , Emily Xiao , Daisy Sheng , Niket Jain , Hanzhang Zhao , Ishita Dasgupta , Jiaqi W. Ma , Chenyan Xiong
‹ Prev 1 4 5 6 7 8 10 Next ›