English
Related papers

Related papers: LIREx: Augmenting Language Inference with Relevant…

200 papers

While the activations of neurons in deep neural networks usually do not have a simple human-understandable interpretation, sparse autoencoders (SAEs) can be used to transform these activations into a higher-dimensional latent space which…

Machine Learning · Computer Science 2025-08-07 Gonçalo Paulo , Alex Mallen , Caden Juang , Nora Belrose

This position paper argues that annotation disagreement in Natural Language Inference (NLI) is not mere noise but often reflects meaningful variation, especially when triggered by ambiguity in the premise or hypothesis. While underspecified…

Computation and Language · Computer Science 2025-09-03 Chathuri Jayaweera , Bonnie J. Dorr

Neural networks are widely regarded as black-box models, creating significant challenges in understanding their inner workings, especially in natural language processing (NLP) applications. To address this opacity, model explanation…

Computation and Language · Computer Science 2025-01-10 Melkamu Mersha , Mingiziem Bitewa , Tsion Abay , Jugal Kalita

Large Language Models (LLM) have revolutionized Natural Language Processing (NLP), improving state-of-the-art and exhibiting emergent capabilities across various tasks. However, their application in extracting information from visually rich…

Computation and Language · Computer Science 2024-06-25 Vincent Perot , Kai Kang , Florian Luisier , Guolong Su , Xiaoyu Sun , Ramya Sree Boppana , Zilong Wang , Zifeng Wang , Jiaqi Mu , Hao Zhang , Chen-Yu Lee , Nan Hua

Pretrained neural models such as BERT, when fine-tuned to perform natural language inference (NLI), often show high accuracy on standard datasets, but display a surprising lack of sensitivity to word order on controlled challenge sets. We…

Computation and Language · Computer Science 2020-04-28 Junghyun Min , R. Thomas McCoy , Dipanjan Das , Emily Pitler , Tal Linzen

Learning from rationales seeks to augment model prediction accuracy using human-annotated rationales (i.e. subsets of input tokens) that justify their chosen labels, often in the form of intermediate or multitask supervision. While…

Machine Learning · Computer Science 2022-03-30 Samuel Carton , Surya Kanoria , Chenhao Tan

Human label variation (HLV) is a valuable source of information that arises when multiple human annotators provide different labels for valid reasons. In Natural Language Inference (NLI) earlier approaches to capturing HLV involve either…

Computation and Language · Computer Science 2024-10-07 Beiduo Chen , Xinpeng Wang , Siyao Peng , Robert Litschko , Anna Korhonen , Barbara Plank

Large language models (LLMs) have emerged as a widely-used tool for information seeking, but their generated outputs are prone to hallucination. In this work, our aim is to allow LLMs to generate text with citations, improving their factual…

Computation and Language · Computer Science 2023-11-01 Tianyu Gao , Howard Yen , Jiatong Yu , Danqi Chen

Natural language inference (NLI) is the task of determining if a natural language hypothesis can be inferred from a given premise in a justifiable manner. NLI was proposed as a benchmark task for natural language understanding. Existing…

Computation and Language · Computer Science 2018-06-15 Aakanksha Naik , Abhilasha Ravichander , Norman Sadeh , Carolyn Rose , Graham Neubig

Natural language understanding (NLU) and Natural language generation (NLG) tasks hold a strong dual relationship, where NLU aims at predicting semantic labels based on natural language utterances and NLG does the opposite. The prior work…

Computation and Language · Computer Science 2020-10-16 Shang-Yu Su , Yung-Sung Chuang , Yun-Nung Chen

Retrieval-augmented large language models (R-LLMs) combine pre-trained large language models (LLMs) with information retrieval systems to improve the accuracy of factual question-answering. However, current libraries for building R-LLMs…

Computation and Language · Computer Science 2023-10-17 Yasuto Hoshi , Daisuke Miyashita , Youyang Ng , Kento Tatsuno , Yasuhiro Morioka , Osamu Torii , Jun Deguchi

Natural Language Inference (NLI) has been a cornerstone task in evaluating language models' inferential reasoning capabilities. However, the standard three-way classification scheme used in NLI has well-known shortcomings in evaluating…

Computation and Language · Computer Science 2023-06-19 Animesh Nighojkar , Antonio Laverghetta , John Licato

We revisit the reference determinacy (RD) assumption in the task of natural language inference (NLI), i.e., the premise and hypothesis are assumed to refer to the same context when human raters annotate a label. While RD is a practical…

Computation and Language · Computer Science 2025-02-11 Sihao Chen , Chaitanya Malaviya , Alex Fabrikant , Hagai Taitelbaum , Tal Schuster , Senaka Buthpitiya , Dan Roth

In response to the demand for Explainable Artificial Intelligence (XAI), we investigate the use of Large Language Models (LLMs) to transform ML explanations into natural, human-readable narratives. Rather than directly explaining ML models…

Artificial Intelligence · Computer Science 2024-05-13 Alexandra Zytek , Sara Pidò , Kalyan Veeramachaneni

Existing approaches to constructing training data for Natural Language Inference (NLI) tasks, such as for semi-structured table reasoning, are either via crowdsourcing or fully automatic methods. However, the former is expensive and…

Computation and Language · Computer Science 2022-10-25 Dibyakanti Kumar , Vivek Gupta , Soumya Sharma , Shuo Zhang

Many natural language inference (NLI) datasets contain biases that allow models to perform well by only using a biased subset of the input, without considering the remainder features. For instance, models are able to make a classification…

Computation and Language · Computer Science 2021-09-01 Dimion Asael , Zachary Ziegler , Yonatan Belinkov

Natural Language Inference (NLI) models have been used in various ways to improve the factuality of LLM outputs. This is typically done by applying an NLI model to judge whether the model output is entailed from the supposed evidence,…

Computation and Language · Computer Science 2025-11-04 Sapir Harary , Eran Hirsch , Aviv Slobodkin , David Wan , Mohit Bansal , Ido Dagan

Controllers for structured LM reasoning (e.g., Chain-of-Thought, self-consistency, and Tree-of-Thoughts) often entangle what to try next with how to execute it, exposing only coarse global knobs and yielding brittle, compute-inefficient,…

Artificial Intelligence · Computer Science 2025-10-07 Abhinav Madahar

This paper presents ReasoningRec, a reasoning-based recommendation framework that leverages Large Language Models (LLMs) to bridge the gap between recommendations and human-interpretable explanations. In contrast to conventional…

Information Retrieval · Computer Science 2024-10-31 Millennium Bismay , Xiangjue Dong , James Caverlee

Objective: Narrative text in Electronic health records (EHR) contain rich information for medical and data science studies. This paper introduces the design and performance of Narrative Information Linear Extraction (NILE), a natural…

Computation and Language · Computer Science 2019-07-17 Sheng Yu , Tianrun Cai , Tianxi Cai