中文
相关论文

相关论文: When Can Models Learn From Explanations? A Formal …

200 篇论文

NLP practitioners often want to take existing trained models and apply them to data from new domains. While fine-tuning or few-shot learning can be used to adapt a base model, there is no single recipe for making these techniques work;…

计算与语言 · 计算机科学 2022-03-16 Xi Ye , Greg Durrett

Software architecture knowledge transfer is essential for software development, but related documentation is often incomplete or ambiguous, making oral explanations a common means. Our broader aim is to explore how such explanations might…

软件工程 · 计算机科学 2025-09-03 Satrio Adi Rukmono , Filip Zamfirov , Lina Ochoa , Floris Pex , Michel Chaudron

In order for machine learning to garner widespread public adoption, models must be able to provide interpretable and robust explanations for their decisions, as well as learn from human-provided explanations at train time. In this work, we…

计算与语言 · 计算机科学 2018-12-07 Oana-Maria Camburu , Tim Rocktäschel , Thomas Lukasiewicz , Phil Blunsom

Commonsense reasoning benchmarks have been largely solved by fine-tuning language models. The downside is that fine-tuning may cause models to overfit to task-specific data and thereby forget their knowledge gained during pre-training.…

计算与语言 · 计算机科学 2021-09-08 Kaixin Ma , Filip Ilievski , Jonathan Francis , Satoru Ozaki , Eric Nyberg , Alessandro Oltramari

Explainability of a classification model is crucial when deployed in real-world decision support systems. Explanations make predictions actionable to the user and should inform about the capabilities and limitations of the system. Existing…

机器学习 · 计算机科学 2022-12-13 Erwin Walraven , Ajaya Adhikari , Cor J. Veenman

Time series are critical for decision-making in fields like finance and healthcare. Their importance has driven a recent influx of works passing time series into language models, leading to non-trivial forecasting on some datasets. But it…

计算与语言 · 计算机科学 2024-04-19 Mike A. Merrill , Mingtian Tan , Vinayak Gupta , Tom Hartvigsen , Tim Althoff

Large-scale high-quality training data is important for improving the performance of models. After trained with data that has rationales (reasoning steps), models gain reasoning capability. However, the dataset with high-quality rationales…

计算与语言 · 计算机科学 2024-05-01 Yunlong Feng , Yang Xu , Libo Qin , Yasheng Wang , Wanxiang Che

For neural models to garner widespread public trust and ensure fairness, we must have human-intelligible explanations for their predictions. Recently, an increasing number of works focus on explaining the predictions of neural models in…

计算与语言 · 计算机科学 2020-12-15 Oana-Maria Camburu , Eleonora Giunchiglia , Jakob Foerster , Thomas Lukasiewicz , Phil Blunsom

Acquiring and training on large-scale labeled data can be impractical due to cost constraints. Additionally, the use of small training datasets can result in considerable variability in model outcomes, overfitting, and learning of spurious…

机器学习 · 计算机科学 2025-07-08 Jiashu Tao , Reza Shokri

The increasing number of regulations and expectations of predictive machine learning models, such as so called right to explanation, has led to a large number of methods promising greater interpretability. High demand has led to a…

One of the motivations for explainable AI is to allow humans to make better and more informed decisions regarding the use and deployment of AI models. But careful evaluations are needed to assess whether this expectation has been fulfilled.…

人工智能 · 计算机科学 2023-12-12 Shawn Im , Jacob Andreas , Yilun Zhou

Recommender systems play a fundamental role in web applications in filtering massive information and matching user interests. While many efforts have been devoted to developing more effective models in various scenarios, the exploration on…

机器学习 · 计算机科学 2020-08-24 Ninghao Liu , Yong Ge , Li Li , Xia Hu , Rui Chen , Soo-Hyun Choi

Composing basic skills from simple tasks to accomplish composite tasks is crucial for modern intelligent systems. We investigate the in-context composition ability of language models to perform composite tasks that combine basic skills…

机器学习 · 计算机科学 2025-10-28 Zidong Liu , Zhuoyan Xu , Zhenmei Shi , Yingyu Liang

Research on reasoning in language models (LMs) predominantly focuses on improving the correctness of their outputs. But some important applications require modeling reasoning patterns that are incorrect. For example, automated systems that…

机器学习 · 计算机科学 2025-10-14 Alexis Ross , Jacob Andreas

Natural language free-text explanation generation is an efficient approach to train explainable language processing models for commonsense-knowledge-requiring tasks. The most predominant form of these models is the explain-then-predict…

计算与语言 · 计算机科学 2021-10-06 Myeongjun Jang , Thomas Lukasiewicz

We reformulate explanation quality assessment as a ranking problem rather than a generation problem. Instead of optimizing models to produce a single "best" explanation token-by-token, we train reward models to discriminate among multiple…

人工智能 · 计算机科学 2026-04-28 Thomas Bailleux , Tanmoy Mukherjee , Emmanuel Lonca , Pierre Marquis , Zied Bouraoui

Recent work has shown how to prompt large language models with explanations to obtain strong performance on textual reasoning tasks, i.e., the chain-of-thought paradigm. However, subtly different explanations can yield widely varying…

计算与语言 · 计算机科学 2023-10-19 Xi Ye , Greg Durrett

The impressive advances and applications of large language and joint language-and-visual understanding models has led to an increased need for methods of probing their potential reasoning capabilities. However, the difficulty of gather…

机器学习 · 计算机科学 2023-06-05 Nathan Vaska , Victoria Helus

Most Reading Comprehension methods limit themselves to queries which can be answered using a single sentence, paragraph, or document. Enabling models to combine disjoint pieces of textual evidence would extend the scope of machine…

计算与语言 · 计算机科学 2018-06-12 Johannes Welbl , Pontus Stenetorp , Sebastian Riedel

Much of explainable AI research treats explanations as a means for model inspection. Yet, this neglects findings from human psychology that describe the benefit of self-explanations in an agent's learning process. Motivated by this, we…

人工智能 · 计算机科学 2024-09-18 Wolfgang Stammer , Felix Friedrich , David Steinmann , Manuel Brack , Hikaru Shindo , Kristian Kersting