English
Related papers

Related papers: DISCO: DISCovering Overfittings as Causal Rules fo…

200 papers

Discovering causal relationships between different variables from time series data has been a long-standing challenge for many domains such as climate science, finance, and healthcare. Given the complexity of real-world relationships and…

Machine Learning · Computer Science 2022-10-27 Wenbo Gong , Joel Jennings , Cheng Zhang , Nick Pawlowski

Despite their success and widespread adoption, the opaque nature of deep neural networks (DNNs) continues to hinder trust, especially in critical applications. Current interpretability solutions often yield inconsistent or oversimplified…

Machine Learning · Computer Science 2024-10-10 Alec F. Diallo , Vaishak Belle , Paul Patras

A variety of recent methods guide large language model outputs via the inference-time addition of steering vectors to residual-stream or attention-head representations. In contrast, we propose to inject steering vectors directly into the…

Machine Learning · Computer Science 2025-09-23 Max Torop , Aria Masoomi , Masih Eskandar , Jennifer Dy

Neural Language Models of Code, or Neural Code Models (NCMs), are rapidly progressing from research prototypes to commercial developer tools. As such, understanding the capabilities and limitations of such models is becoming critical.…

Software Engineering · Computer Science 2024-03-29 David N. Palacio , Alejandro Velasco , Nathan Cooper , Alvaro Rodriguez , Kevin Moran , Denys Poshyvanyk

Machine-learning models are ubiquitous. In some domains, for instance, in medicine, the models' predictions must be interpretable. Decision trees, classification rules, and subgroup discovery are three broad categories of supervised…

Machine Learning · Computer Science 2022-04-29 Vadim Arzamasov , Benjamin Jochum , Klemens Böhm

State-of-the-art recommender systems have the ability to generate high-quality recommendations, but usually cannot provide intuitive explanations to humans due to the usage of black-box prediction models. The lack of transparency has…

Information Retrieval · Computer Science 2021-02-24 Shuyuan Xu , Yunqi Li , Shuchang Liu , Zuohui Fu , Xu Chen , Yongfeng Zhang

Deep learning models (DLMs) achieve increasingly high performance both on structured and unstructured data. They significantly extended applicability of machine learning to various domains. Their success in making predictions, detecting…

Artificial Intelligence · Computer Science 2025-01-03 Matej Mihelčić , Ivan Grubišić , Miha Keber

Causal inference from observational data provides strong evidence for the best action in decision-making without performing expensive randomized trials. The effect of an action is usually not identifiable under unobserved confounding, even…

Machine Learning · Computer Science 2026-02-02 Md Musfiqur Rahman , Ziwei Jiang , Hilaf Hasson , Murat Kocaoglu

This paper formalizes an emerging learning paradigm that uses a trained model as a reference to guide and enhance the training of a target model through strategic data selection or weighting, named $\textbf{model steering}$. While ad-hoc…

Machine Learning · Computer Science 2025-05-21 Xiyuan Wei , Ming Lin , Fanjiang Ye , Fengguang Song , Liangliang Cao , My T. Thai , Tianbao Yang

We investigate whether post-hoc model explanations are effective for diagnosing model errors--model debugging. In response to the challenge of explaining a model's prediction, a vast array of explanation methods have been proposed. Despite…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Julius Adebayo , Michael Muelly , Ilaria Liccardi , Been Kim

Local decision rules are commonly understood to be more explainable, due to the local nature of the patterns involved. With numerical optimization methods such as gradient boosting, ensembles of local decision rules can gain good predictive…

Machine Learning · Computer Science 2025-08-27 Xin Du , Subramanian Ramamoorthy , Wouter Duivesteijn , Jin Tian , Mykola Pechenizkiy

Causality has been combined with machine learning to produce robust representations for domain generalization. Most existing methods of this type require massive data from multiple domains to identify causal features by cross-domain…

Machine Learning · Computer Science 2024-03-01 Yang Chen , Yitao Liang , Zhouchen Lin

Large Language Models (LLMs) are increasingly aligned with human preferences through Reinforcement Learning from Human Feedback (RLHF). Among RLHF methods, Group Relative Policy Optimization (GRPO) has gained attention for its simplicity…

Computation and Language · Computer Science 2025-09-25 Yuhang Zhou , Jing Zhu , Shengyi Qian , Zhuokai Zhao , Xiyao Wang , Xiaoyu Liu , Ming Li , Paiheng Xu , Wei Ai , Furong Huang

The emergence of large-scale pretrained language models has posed unprecedented challenges in deriving explanations of why the model has made some predictions. Stemmed from the compositional nature of languages, spurious correlations have…

Computation and Language · Computer Science 2023-05-04 Ruochen Zhao , Shafiq Joty , Yongjie Wang , Tan Wang

Recent work has suggested post-hoc explainers might be ineffective for detecting spurious correlations in Deep Neural Networks (DNNs). However, we show there are serious weaknesses with the existing evaluation frameworks for this setting.…

Machine Learning · Computer Science 2022-11-16 Shea Cardozo , Gabriel Islas Montero , Dmitry Kazhdan , Botty Dimanov , Maleakhi Wijaya , Mateja Jamnik , Pietro Lio

Circuit discovery aims to explain how language models (LMs) implement a specific task by localizing and interpreting a circuit, a computational subgraph responsible for the LM's behavior. Existing circuit discovery methods are…

Artificial Intelligence · Computer Science 2026-05-12 Daking Rai , Mor Geva , Ziyu Yao

Accurate cell instance segmentation is foundational for digital pathology analysis. Existing methods based on contour detection and distance mapping still face significant challenges in processing complex and dense cellular regions. Graph…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Rui Sun , Yiwen Yang , Kaiyu Guo , Chen Jiang , Dongli Xu , Zhaonan Liu , Tan Pan , Limei Han , Xue Jiang , Wu Wei , Yuan Cheng

Language-conditioned manipulation policies typically process instructions and observations through shared network parameters. This task-state entanglement provides a pathway for observation leakage -- networks learn scene-to-action…

Robotics · Computer Science 2026-05-21 Hanxiang Ren , Pei Zhou , Xunzhe Zhou , Yanchao Yang

Emerging reasoning models hold promise for automating scientific discovery. However, their training is hindered by a critical supervision gap: experimental outcomes are abundant, whereas intermediate reasoning steps are rarely documented at…

Biomolecules · Quantitative Biology 2026-03-24 Zequn Liu , Kehan Wu , Shufang Xie , Zekun Guo , Wei Zhang , Tao Qin , Renhe Liu , Yingce Xia

Rule sets are highly interpretable logical models in which the predicates for decision are expressed in disjunctive normal form (DNF, OR-of-ANDs), or, equivalently, the overall model comprises an unordered collection of if-then decision…

Machine Learning · Computer Science 2022-06-09 Fan Yang , Kai He , Linxiao Yang , Hongxia Du , Jingbang Yang , Bo Yang , Liang Sun