English
Related papers

Related papers: Prediction or Comparison: Toward Interpretable Qua…

200 papers

Recent years have seen a boom in interest in machine learning systems that can provide a human-understandable rationale for their predictions or decisions. However, exactly what kinds of explanation are truly human-interpretable remains…

Machine Learning · Computer Science 2019-08-30 Isaac Lage , Emily Chen , Jeffrey He , Menaka Narayanan , Been Kim , Sam Gershman , Finale Doshi-Velez

Language models (LMs) are said to be exhibiting reasoning, but what does this entail? We assess definitions of reasoning and how key papers in the field of natural language processing (NLP) use the notion and argue that the definitions…

Computation and Language · Computer Science 2025-11-18 Bertram Højer

Despite the increasing effectiveness of language models, their reasoning capabilities remain underdeveloped. In particular, causal reasoning through counterfactual question answering is lacking. This work aims to bridge this gap. We first…

Computation and Language · Computer Science 2025-03-18 Alihan Hüyük , Xinnuo Xu , Jacqueline Maasch , Aditya V. Nori , Javier González

Covariational reasoning -- how one thinks about the way changes in one quantity affect another quantity -- is essential to calculus and physics instruction alike. As physics is often centered on understanding and predicting changes in…

Physics Education · Physics 2019-11-20 Charlotte Zimmerman , Alexis Olsho , Michael Loverude , Suzanne White Brahmia

The success of neural networks comes hand in hand with a desire for more interpretability. We focus on text classifiers and make them more interpretable by having them provide a justification, a rationale, for their predictions. We approach…

Computation and Language · Computer Science 2020-06-22 Jasmijn Bastings , Wilker Aziz , Ivan Titov

Interpretable machine learning models offer understandable reasoning behind their decision-making process, though they may not always match the performance of their black-box counterparts. This trade-off between interpretability and model…

Artificial Intelligence · Computer Science 2025-03-12 Pranjal Atrey , Michael P. Brundage , Min Wu , Sanghamitra Dutta

Quantitative reasoning is a critical skill to analyze data, yet the assessment of such ability remains limited. To address this gap, we introduce the Quantitative Reasoning with Data (QRData) benchmark, aiming to evaluate Large Language…

Computation and Language · Computer Science 2024-06-11 Xiao Liu , Zirui Wu , Xueqing Wu , Pan Lu , Kai-Wei Chang , Yansong Feng

Reasoning is key to many decision making processes. It requires consolidating a set of rule-like premises that are often associated with degrees of uncertainty and observations to draw conclusions. In this work, we address both the case…

Computation and Language · Computer Science 2024-10-15 Timo Pierre Schrader , Lukas Lange , Simon Razniewski , Annemarie Friedrich

Correspondence identifies relationships among objects via similarities among their components; it is ubiquitous in the analysis of spatial datasets, including images, weather maps, and computational simulations. This paper develops a novel…

Artificial Intelligence · Computer Science 2007-05-23 Chris Bailey-Kellogg , Naren Ramakrishnan

Qualitative Spatial Reasoning is a well explored area of Knowledge Representation and Reasoning and has multiple applications ranging from Geographical Information Systems to Robotics and Computer Vision. Recently, many claims have been…

Computation and Language · Computer Science 2024-12-02 Anthony G Cohn , Robert E Blackwell

Predictions about people, such as their expected educational achievement or their credit risk, can be performative and shape the outcome that they aim to predict. Understanding the causal effect of these predictions on the eventual outcomes…

Machine Learning · Statistics 2022-10-19 Celestine Mendler-Dünner , Frances Ding , Yixin Wang

The human capability to reason about one domain by using knowledge of other domains has been researched for more than 50 years, but models that are formally sound and predict cognitive process are sparse. We propose a formally sound method…

Artificial Intelligence · Computer Science 2022-01-10 Claudia Schon , Ulrich Furbach , Marco Ragni

Causal reasoning is a cornerstone of human intelligence and a critical capability for artificial systems aiming to achieve advanced understanding and decision-making. This thesis delves into various dimensions of causal reasoning and…

Computation and Language · Computer Science 2025-04-22 Zhijing Jin

Reasoning about time is of fundamental importance. Many facts are time-dependent. For example, athletes change teams from time to time, and different government officials are elected periodically. Previous time-dependent question answering…

Computation and Language · Computer Science 2023-06-28 Qingyu Tan , Hwee Tou Ng , Lidong Bing

Interpretability provides a toolset for understanding how and why neural networks behave in certain ways. However, there is little unity in the field: most studies employ ad-hoc evaluations and do not share theoretical foundations, making…

In complex inferential tasks like question answering, machine learning models must confront two challenges: the need to implement a compositional reasoning process, and, in many applications, the need for this reasoning process to be…

Computer Vision and Pattern Recognition · Computer Science 2019-03-08 Ronghang Hu , Jacob Andreas , Trevor Darrell , Kate Saenko

Causal reasoning and logical reasoning are two important types of reasoning abilities for human intelligence. However, their relationship has not been extensively explored under machine intelligence context. In this paper, we explore how…

Information Retrieval · Computer Science 2023-07-06 Jianchao Ji , Zelong Li , Shuyuan Xu , Max Xiong , Juntao Tan , Yingqiang Ge , Hao Wang , Yongfeng Zhang

Compositional vector space models of meaning promise new solutions to stubborn language understanding problems. This paper makes two contributions toward this end: (i) it uses automatically-extracted paraphrase examples as a source of…

Computation and Language · Computer Science 2018-02-01 Avneesh Saluja , Chris Dyer , Jean-David Ruvini

Causal reasoning (CR) is a crucial aspect of intelligence, essential for problem-solving, decision-making, and understanding the world. While language models (LMs) can generate rationales for their outputs, their ability to reliably perform…

Artificial Intelligence · Computer Science 2025-02-19 Longxuan Yu , Delin Chen , Siheng Xiong , Qingyang Wu , Qingzhen Liu , Dawei Li , Zhikai Chen , Xiaoze Liu , Liangming Pan

Interpretability and explainability have gained more and more attention in the field of machine learning as they are crucial when it comes to high-stakes decisions and troubleshooting. Since both provide information about predictors and…

Machine Learning · Computer Science 2024-04-26 Benjamin Leblanc , Pascal Germain