English
Related papers

Related papers: Exploring Automatically Perturbed Natural Language…

200 papers

We advance a novel explanation of similarity-based interference effects in subject-verb and reflexive pronoun agreement processing, grounded in surprisal values computed from a pretrained large-scale Transformer model, GPT-2. Specifically,…

Computation and Language · Computer Science 2021-04-28 Soo Hyun Ryu , Richard L. Lewis

Languages are shaped by the inductive biases of their users. Using a classical referential game, we investigate how artificial languages evolve when optimised for inductive biases in humans and large language models (LLMs) via Human-Human,…

Computation and Language · Computer Science 2025-05-29 Tom Kouwenhoven , Max Peeperkorn , Roy de Kleijn , Tessa Verhoef

Universal Dependencies (UD), while widely regarded as the most successful linguistic framework for cross-lingual syntactic representation, remains underexplored in terms of its effectiveness. This paper addresses this gap by integrating UD…

Computation and Language · Computer Science 2025-06-06 Wenxi Li

A recent study (Kuribayashi et al., 2025) has shown that human sentence processing behavior, typically measured on syntactically unchallenging constructions, can be effectively modeled using surprisal from early layers of large language…

Computation and Language · Computer Science 2026-04-21 Tatsuki Kuribayashi , Alex Warstadt , Yohei Oseki , Ethan Gotlieb Wilcox

Sequence-processing neural networks led to remarkable progress on many NLP tasks. As a consequence, there has been increasing interest in understanding to what extent they process language as humans do. We aim here to uncover which biases…

Computation and Language · Computer Science 2019-06-17 Rahma Chaabouni , Eugene Kharitonov , Alessandro Lazaric , Emmanuel Dupoux , Marco Baroni

Rigorous evaluation of the causal effects of semantic features on language model predictions can be hard to achieve for natural language reasoning problems. However, this is such a desirable form of analysis from both an interpretability…

Computation and Language · Computer Science 2024-04-04 Julia Rozanova , Marco Valentino , André Freitas

We present an interpretable neural network approach to predicting and understanding politeness in natural language requests. Our models are based on simple convolutional neural networks directly on raw text, avoiding any manual…

Computation and Language · Computer Science 2016-10-11 Malika Aubakirova , Mohit Bansal

State-of-the-art deep-learning-based approaches to Natural Language Processing (NLP) are credited with various capabilities that involve reasoning with natural language texts. In this paper we carry out a large-scale empirical study…

Computation and Language · Computer Science 2022-11-11 Viktor Schlegel , Kamen V. Pavlov , Ian Pratt-Hartmann

The emergence of large-scale pretrained language models has posed unprecedented challenges in deriving explanations of why the model has made some predictions. Stemmed from the compositional nature of languages, spurious correlations have…

Computation and Language · Computer Science 2023-05-04 Ruochen Zhao , Shafiq Joty , Yongjie Wang , Tan Wang

Explanation constitutes an archetypal feature of human rationality, underpinning learning and generalisation, and representing one of the media supporting scientific discovery and communication. Due to the importance of explanations in…

Computation and Language · Computer Science 2024-10-08 Marco Valentino , André Freitas

Contrastive learning is a popular form of self-supervised learning that encourages augmentations (views) of the same input to have more similar representations compared to augmentations of different inputs. Recent attempts to theoretically…

Machine Learning · Computer Science 2022-03-01 Nikunj Saunshi , Jordan Ash , Surbhi Goel , Dipendra Misra , Cyril Zhang , Sanjeev Arora , Sham Kakade , Akshay Krishnamurthy

Most prior works on communication in multi-agent reinforcement learning have focused on emergent communication, which often results in inefficient and non-interpretable systems. Inspired by the role of language in natural intelligence, we…

Multiagent Systems · Computer Science 2025-08-08 Maxime Toquebiau , Jae-Yun Jun , Faïz Benamar , Nicolas Bredeche

Recommender systems are central to digital platforms, yet they face a fundamental trade-off between accuracy and explainability. Black-box models achieve strong performance but lack interpretability needed for trust and adoption. Existing…

Information Retrieval · Computer Science 2026-05-05 Yuyan Wang , Pan Li , Minmin Chen

Data availability and quality are major challenges in natural language processing for low-resourced languages. In particular, there is significantly less data available than for higher-resourced languages. This data is also often of low…

Computation and Language · Computer Science 2023-11-28 Manuel Fokam , Michael Beukman

Language technologies that accurately model the dynamics of events must perform commonsense reasoning. Existing work evaluating commonsense reasoning focuses on making inferences about common, everyday situations. To instead investigate the…

Computation and Language · Computer Science 2024-05-02 Wenting Zhao , Justin T Chiu , Jena D. Hwang , Faeze Brahman , Jack Hessel , Sanjiban Choudhury , Yejin Choi , Xiang Lorraine Li , Alane Suhr

Transformer language models are state of the art in a multitude of NLP tasks. Despite these successes, their opaqueness remains problematic. Recent methods aiming to provide interpretability and explainability to black-box models primarily…

Computation and Language · Computer Science 2022-03-14 Felix Friedrich , Patrick Schramowski , Christopher Tauchmann , Kristian Kersting

Natural language processing (NLP) models trained on people-generated data can be unreliable because, without any constraints, they can learn from spurious correlations that are not relevant to the task. We hypothesize that enriching models…

Computation and Language · Computer Science 2022-03-18 Alissa Ostapenko , Shuly Wintner , Melinda Fricke , Yulia Tsvetkov

Explainability of neural network prediction is essential to understand feature importance and gain interpretable insight into neural network performance. However, explanations of neural network outcomes are mostly limited to visualization,…

Machine Learning · Computer Science 2023-07-13 Arnab Neelim Mazumder , Niall Lyons , Ashutosh Pandey , Avik Santra , Tinoosh Mohsenin

A fundamental result in psycholinguistics is that less predictable words take a longer time to process. One theoretical explanation for this finding is Surprisal Theory (Hale, 2001; Levy, 2008), which quantifies a word's predictability as…

Computation and Language · Computer Science 2025-04-15 Ethan Gotlieb Wilcox , Tiago Pimentel , Clara Meister , Ryan Cotterell , Roger P. Levy

Drawing on constructs from psychology, prior work has identified a distinction between explicit and implicit bias in large language models (LLMs). While many LLMs undergo post-training alignment and safety procedures to avoid expressions of…

Computers and Society · Computer Science 2026-02-05 Molly Apsel , Michael N. Jones