English
Related papers

Related papers: Interpreting Recurrent and Attention-Based Neural …

200 papers

Attributional inference, the ability to predict latent intentions behind observed actions, is a critical yet underexplored capability for large language models (LLMs) operating in multi-agent environments. Traditional natural language…

Computation and Language · Computer Science 2026-01-14 Xin Quan , Jiafeng Xiong , Marco Valentino , André Freitas

State of the art models using deep neural networks have become very good in learning an accurate mapping from inputs to outputs. However, they still lack generalization capabilities in conditions that differ from the ones encountered during…

Computation and Language · Computer Science 2018-08-28 Alexey Romanov , Chaitanya Shivade

Natural language inference (NLI) is a central problem in language understanding. End-to-end artificial neural networks have reached state-of-the-art performance in NLI field recently. In this paper, we propose Character-level Intra…

Computation and Language · Computer Science 2017-07-25 Han Yang , Marta R. Costa-jussà , José A. R. Fonollosa

Natural Language Inference (NLI) is the task of determining whether a sentence pair represents entailment, contradiction, or a neutral relationship. While NLI models perform well on many inference tasks, their ability to handle fine-grained…

Computation and Language · Computer Science 2025-06-09 Tara Azin , Daniel Dumitrescu , Diana Inkpen , Raj Singh

In the interest of interpreting neural NLI models and their reasoning strategies, we carry out a systematic probing study which investigates whether these models capture the crucial semantic features central to natural logic: monotonicity…

Computation and Language · Computer Science 2023-11-09 Julia Rozanova , Deborah Ferreira , Marco Valentino , Mokanrarangan Thayaparan , Andre Freitas

In order for machine learning to garner widespread public adoption, models must be able to provide interpretable and robust explanations for their decisions, as well as learn from human-provided explanations at train time. In this work, we…

Computation and Language · Computer Science 2018-12-07 Oana-Maria Camburu , Tim Rocktäschel , Thomas Lukasiewicz , Phil Blunsom

We introduce a novel approach to incorporate syntax into natural language inference (NLI) models. Our method uses contextual token-level vector representations from a pretrained dependency parser. Like other contextual embedders, our method…

Computation and Language · Computer Science 2019-09-19 Deric Pang , Lucy H. Lin , Noah A. Smith

Recurrent Neural Networks (RNNs), and specifically a variant with Long Short-Term Memory (LSTM), are enjoying renewed interest as a result of successful applications in a wide range of machine learning problems that involve sequential data.…

Machine Learning · Computer Science 2015-11-18 Andrej Karpathy , Justin Johnson , Li Fei-Fei

Sentence-level representations are necessary for various NLP tasks. Recurrent neural networks have proven to be very effective in learning distributed representations and can be trained efficiently on natural language inference tasks. We…

Computation and Language · Computer Science 2019-08-15 Aarne Talman , Anssi Yli-Jyrä , Jörg Tiedemann

Large Language Models (LLMs) are claimed to be capable of Natural Language Inference (NLI), necessary for applied tasks like question answering and summarization. We present a series of behavioral studies on several LLM families (LLaMA,…

Computation and Language · Computer Science 2023-10-24 Nick McKenna , Tianyi Li , Liang Cheng , Mohammad Javad Hosseini , Mark Johnson , Mark Steedman

Natural Language Inference (NLI) is the task of determining whether a premise entails, contradicts, or is neutral with respect to a given hypothesis. The task is often framed as emulating human inferential processes, in which commonsense…

Computation and Language · Computer Science 2026-01-27 Chathuri Jayaweera , Brianna Yanqui , Bonnie Dorr

Attention mechanism has been proven effective on natural language processing. This paper proposes an attention boosted natural language inference model named aESIM by adding word attention and adaptive direction-oriented attention…

Computation and Language · Computer Science 2018-12-07 Guanyu Li , Pengfei Zhang , Caiyan Jia

We present a novel deep learning architecture to address the natural language inference (NLI) task. Existing approaches mostly rely on simple reading mechanisms for independent encoding of the premise and hypothesis. Instead, we propose a…

Computation and Language · Computer Science 2019-05-21 Reza Ghaeini , Sadid A. Hasan , Vivek Datla , Joey Liu , Kathy Lee , Ashequl Qadir , Yuan Ling , Aaditya Prakash , Xiaoli Z. Fern , Oladimeji Farri

We analyze two Natural Language Inference data sets with respect to their linguistic features. The goal is to identify those syntactic and semantic properties that are particularly hard to comprehend for a machine learning model. To this…

Computation and Language · Computer Science 2022-10-20 Maren Pielka , Felix Rode , Lisa Pucknat , Tobias Deußer , Rafet Sifa

In this paper, we proposed a sentence encoding-based model for recognizing text entailment. In our approach, the encoding of sentence is a two-stage process. Firstly, average pooling was used over word-level bidirectional LSTM (biLSTM) to…

Computation and Language · Computer Science 2016-05-31 Yang Liu , Chengjie Sun , Lei Lin , Xiaolong Wang

This paper argues that the judicial use of formal language theory and grammatical inference are invaluable tools in understanding how deep neural networks can and cannot represent and learn long-term dependencies in temporal sequences.…

Computation and Language · Computer Science 2017-10-17 Enes Avcu , Chihiro Shibata , Jeffrey Heinz

Recognizing implicit discourse relations is a challenging but important task in the field of Natural Language Processing. For such a complex text processing task, different from previous studies, we argue that it is necessary to repeatedly…

Computation and Language · Computer Science 2016-09-22 Yang Liu , Sujian Li

Although large language models (LLMs) have demonstrated remarkable performance, the lack of transparency in their inference logic raises concerns about their trustworthiness. To gain a better understanding of LLMs, we conduct a detailed…

Computation and Language · Computer Science 2024-07-26 Jie Ren , Qipeng Guo , Hang Yan , Dongrui Liu , Quanshi Zhang , Xipeng Qiu , Dahua Lin

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated remarkable progress in visual understanding. This impressive leap raises a compelling question: how can language models, initially trained solely on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Jing Bi , Junjia Guo , Yunlong Tang , Lianggong Bruce Wen , Zhang Liu , Chenliang Xu

We propose a general method to break down a main complex task into a set of intermediary easier sub-tasks, which are formulated in natural language as binary questions related to the final target task. Our method allows for representing…

Computation and Language · Computer Science 2024-02-02 Felipe Urrutia , Cristian Buc , Valentin Barriere