English
Related papers

Related papers: Rationalizing Neural Predictions

200 papers

Paraphrasing natural language sentences is a multifaceted process: it might involve replacing individual words or short phrases, local rearrangement of content, or high-level restructuring like topicalization or passivization. Past…

Computation and Language · Computer Science 2020-05-06 Tanya Goyal , Greg Durrett

Multimodal reasoning is a challenging task that requires models to reason across multiple modalities to answer questions. Existing approaches have made progress by incorporating language and visual modalities into a two-stage reasoning…

Artificial Intelligence · Computer Science 2024-07-04 Cheng Tan , Jingxuan Wei , Zhangyang Gao , Linzhuang Sun , Siyuan Li , Ruifeng Guo , Bihui Yu , Stan Z. Li

Reviews contain rich information about product characteristics and user interests and thus are commonly used to boost recommender system performance. Specifically, previous work show that jointly learning to perform review generation…

Information Retrieval · Computer Science 2022-09-13 Zhouhang Xie , Julian McAuley , Bodhisattwa Prasad Majumder

The choice of sentence encoder architecture reflects assumptions about how a sentence's meaning is composed from its constituent words. We examine the contribution of these architectures by holding them randomly initialised and fixed,…

Computation and Language · Computer Science 2019-10-09 Joseph Enguehard , Dan Busbridge , Vitalii Zhelezniak , Nils Hammerla

Human reasoning involves recognising common underlying principles across many examples. The by-products of such reasoning are invariants that capture patterns such as "if someone went somewhere then they are there", expressed using…

Machine Learning · Computer Science 2020-10-27 Nuri Cingillioglu , Alessandra Russo

In many settings it is important for one to be able to understand why a model made a particular prediction. In NLP this often entails extracting snippets of an input text `responsible for' corresponding model output; when such a snippet…

Computation and Language · Computer Science 2020-05-04 Sarthak Jain , Sarah Wiegreffe , Yuval Pinter , Byron C. Wallace

Neural language models (LMs) have achieved impressive results on various language-based reasoning tasks by utilizing latent knowledge encoded in their own pretrained parameters. To make this reasoning process more explicit, recent works…

Computation and Language · Computer Science 2023-04-10 Peifeng Wang , Aaron Chan , Filip Ilievski , Muhao Chen , Xiang Ren

Significant work has been done on learning regular expressions from a set of data values. Depending on the domain, this approach can be very successful. However, significant time is required to learn these expressions and the resulting…

Databases · Computer Science 2024-03-18 Michael J. Mior

With the blooming of various Pre-trained Language Models (PLMs), Machine Reading Comprehension (MRC) has embraced significant improvements on various benchmarks and even surpass human performances. However, the existing works only target on…

Computation and Language · Computer Science 2020-11-16 Yiming Cui , Ting Liu , Shijin Wang , Guoping Hu

Bayesian inference has theoretical attractions as a principled framework for reasoning about beliefs. However, the motivations of Bayesian inference which claim it to be the only 'rational' kind of reasoning do not apply in practice. They…

Machine Learning · Statistics 2022-11-14 Sebastian Farquhar

A distinction is often drawn between a model's ability to predict a label for an evaluation sample that is directly memorised from highly similar training samples versus an ability to predict the label via some method of generalisation. In…

Computation and Language · Computer Science 2023-11-22 Tim Hartill , Joshua Bensemann , Michael Witbrock , Patricia J. Riddle

We explore various methods for computing sentence representations from pre-trained word embeddings without any training, i.e., using nothing but random parameterizations. Our aim is to put sentence embeddings on more solid footing by 1)…

Computation and Language · Computer Science 2019-01-30 John Wieting , Douwe Kiela

We propose a method for unsupervised opinion summarization that encodes sentences from customer reviews into a hierarchical discrete latent space, then identifies common opinions based on the frequency of their encodings. We are able to…

Computation and Language · Computer Science 2023-05-22 Tom Hosking , Hao Tang , Mirella Lapata

Most existing work on automated fact checking is concerned with predicting the veracity of claims based on metadata, social network spread, language used in claims, and, more recently, evidence supporting or denying claims. A crucial piece…

Computation and Language · Computer Science 2020-04-14 Pepa Atanasova , Jakob Grue Simonsen , Christina Lioma , Isabelle Augenstein

Models that generate extractive rationales (i.e., subsets of features) or natural language explanations (NLEs) for their predictions are important for explainable AI. While an extractive rationale provides a quick view of the features most…

Computation and Language · Computer Science 2022-09-19 Bodhisattwa Prasad Majumder , Oana-Maria Camburu , Thomas Lukasiewicz , Julian McAuley

A self-explaining rationalization model is generally constructed by a cooperative game where a generator selects the most human-intelligible pieces from the input text as rationales, followed by a predictor that makes predictions based on…

Machine Learning · Computer Science 2023-06-27 Wei Liu , Jun Wang , Haozhao Wang , Ruixuan Li , Yang Qiu , YuanKai Zhang , Jie Han , Yixiong Zou

Distributional regression aims to estimate the full conditional distribution of a target variable, given covariates. Popular methods include linear and tree-ensemble based quantile regression. We propose a neural network-based…

Methodology · Statistics 2024-07-08 Xinwei Shen , Nicolai Meinshausen

Artificial Intelligence models are increasingly used in manufacturing to inform decision-making. Responsible decision-making requires accurate forecasts and an understanding of the models' behavior. Furthermore, the insights into models'…

Artificial Intelligence · Computer Science 2022-04-13 Jože M. Rožanec , Elena Trajkova , Inna Novalija , Patrik Zajec , Klemen Kenda , Blaž Fortuna , Dunja Mladenić

Most of the existing work that focus on the identification of implicit knowledge in arguments generally represent implicit knowledge in the form of commonsense or factual knowledge. However, such knowledge is not sufficient to understand…

Computation and Language · Computer Science 2021-10-27 Keshav Singh , Naoya Inoue , Farjana Sultana Mim , Shoichi Naitoh , Kentaro Inui

A long-standing issue with paraphrase generation is how to obtain reliable supervision signals. In this paper, we propose an unsupervised paradigm for paraphrase generation based on the assumption that the probabilities of generating two…

Computation and Language · Computer Science 2021-09-02 Yuxian Meng , Xiang Ao , Qing He , Xiaofei Sun , Qinghong Han , Fei Wu , Chun fan , Jiwei Li